Local AI: What is Ollama? Introduction to the AI model management tool

[rcjordan]

https://www.hostinger.com/tutorials/what-is-ollama


https://ollama.com/download


Ollama running Llama 3.2 was recommended in an ai dev-to-dev BSky conversation, which sent me down the rabbit hole.

ollama/README.md at main · ollama/ollama · GitHub
https://github.com/ollama/ollama/blob/main/README.md#quickstart

[rcjordan]

>hole

Deeper...

LocalLlama
https://old.reddit.com/r/LocalLLaMA/

[rcjordan]

Why local?

Microsoft's newest Copilot plan for business is pay-as-you-go | TechCrunch
https://techcrunch.com/2025/01/15/microsofts-newest-copilot-plan-for-business-is-pay-as-you-go/

[rcjordan]

>https://ollama.com/download

>Ollama running Llama 3.2 was recommended

My 17yo grandson built his own gaming pc (Win) last year. His geek-project adrenaline rush had turned to boredom by christmas and he asked about ad blockers and ai.  I had my own uptick of adrenaline and suggested he switch to FF & install TMky.  Done. I pointed him to greasyfork and an ad-blocker for reddit. A day or 2 ago, he said he was going to check out 'native LLMs' and I sent him the above --told him I'd been down the rabbit hole but that was all I knew.  He pinged me last night and said he has Llama 3.3 running.

[ergophobe]

Is he teaching his peers to block ads and install Ollama?

I forget what platform(s) people are using, but there 's a fair bit of talk on the fitness forum about loading their fitness data into models and either doing data analysis or getting coaching. The forum owner, who is a coach to some elite athletes and generally considered an "authority" has a model going where he coaches himself based on various personas he creates.

[rcjordan]

> peers

Dunno. He tends to play his cards *very* close ...I have no idea where he got that. hhh

>ollama

working on a new thread. will post next

https://th3core.com/talk/hardware-technology/local-ai-deepseek-r11-5b-running-now/