#inference

llama.cpp Hits 100K Stars; Creator Predicts 90% of Agents Will Run Locally

llama.cpp hits 100K GitHub stars; creator @ggerganov predicts 90% of AI agents will run locally within 3–6 months as local model quality crosses the agentic threshold.