Locally-installed AI models are getting pretty good
Notes de l’épisode
This week on The Kettle, host Brandon Vigliarolo is joined by systems editor Tobias Mann and senior reporter Tom Claburn to discuss the current state of locally-installed coding assistant LLMs. After some experimentation, both Claburn and Mann have concluded they're actually getting pretty good.
What does that mean for the computing power crunch? Hopefully it means cash-strapped developers will be able to get off the train of increased prices from AI vendors and actually run a useful local code assistant - just don't expect to give up on the big guys entirely - you might still need them to okay that smaller AI's work.