Re: A simple definition
Exactly! It's amazing how many commentards seem to think that AI is a passing fad and even more astonishing is how many of these commentards have no idea how LLMs work. Are we sure this is still a tech forum?
I've got quantised AI models working on Raspberry Pi's...granted, they're not as broadly powerful as say GPT4...but for the specific use cases the models were trained for, they exceed GPT4 in at least one area.
I took an existing, "good enough", LLM and performed some additional training with it to make it competent at wifi surveys, network analysis and device fingerprinting...it's a 1.5GB quantised model that runs pretty well on a Raspberry Pi Zero 2W that I built into a handheld device that I carry around for doing network surveys and audits with...it isn't lightning fast, but that doesn't really matter because no matter how fast your LLM runs, the quality of the results will be the same...also, you don't need instant results...you just need the speed of the results to be faster than a human...which they are, no matter what speed they run at...because for a human to complete a basic report on a network based on the collected data, it would take at least a day...my Pi based LLM will have a basic report for me within 5-10 minutes...using that report, I can bang out my own report (after carefully reading the AI one, just in case, the AI hasn't provided any barking mad results yet, but you always have to be vigilant, as with any person / machine you farm out a task to) in about an hour.