* Posts by metooaswell

3 publicly visible posts • joined 24 Nov 2015

Cheat codes for LLM performance: An introduction to speculative decoding

metooaswell

These systems are useful

These LLM systems are indeed very useful, accurate and practical for a wider variety of problems.

One example I implemented last week at work, was a system for helping to write Cypress tests for journeys through an insurance company website. Writing a system to fireup a browser and navigate to the site, and then giving the LLM the DOM of the loaded page a human can write something like 'accept cookies and then select that you want to purchase Dog Insurance'. The LLM can then take that (along with the serialized DOM) and return Cypress code to perform the action on the site, which we can then concatenante to our test code file and also execute to change the state of the website. We can then pass the new DOM and a new instruction 'fill out the form with my dog 'Geoff's' details. He is 10 years old and a border collie.

Using an LLM in this way generates accurate results and usable test files. The advantage over writing the tests directly oneself are that if the structure of the website changes you can just regenerate the test file at the click of a button. A human would have to go in and start looking at the DOM all over again to rewrite the tests to ensure that any DOM changes haven't affected his test commands.

This is just one practical use of LLMs doing something that we needed humans to do for us previously. To say they have no utility, or a trivial is a very misguided way to think about this new technology.

'Hobbit' heads aren't human says bone boffin

metooaswell

very strange skull indeed if

"the new analysis shows that the skull shares no characteristics with skulls of genus Homo."

Really, no shared characteristics at all? 2 eyes? Nasal cavity? hinged jawbone? A little hollow where a brain might sit?

Perhaps they meant to say it didn't share any of the characteristics uniquely exhibited by skulls of the genus Homo.

A font farewell to Fontdeck as website service closes

metooaswell

Pedant alert

I think you will find that Clearleft are based in Brighton and not Bristol.