Author Topic: Local AI: What is Ollama? Introduction to the AI model management tool  (Read 822 times)

rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 17149
  • Debbie says...
    • View Profile
https://www.hostinger.com/tutorials/what-is-ollama


https://ollama.com/download


Ollama running Llama 3.2 was recommended in an ai dev-to-dev BSky conversation, which sent me down the rabbit hole.

ollama/README.md at main · ollama/ollama · GitHub
https://github.com/ollama/ollama/blob/main/README.md#quickstart


rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 17149
  • Debbie says...
    • View Profile
Re: Local AI: What is Ollama? Introduction to the AI model management tool
« Reply #1 on: January 12, 2025, 09:02:14 PM »
>hole

Deeper...

LocalLlama
https://old.reddit.com/r/LocalLLaMA/

rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 17149
  • Debbie says...
    • View Profile
Re: Local AI: What is Ollama? Introduction to the AI model management tool
« Reply #2 on: January 15, 2025, 02:11:45 PM »
Why local?

Microsoft's newest Copilot plan for business is pay-as-you-go | TechCrunch
https://techcrunch.com/2025/01/15/microsofts-newest-copilot-plan-for-business-is-pay-as-you-go/

rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 17149
  • Debbie says...
    • View Profile
Re: Local AI: What is Ollama? Introduction to the AI model management tool
« Reply #3 on: January 19, 2025, 12:10:36 PM »
>https://ollama.com/download

>Ollama running Llama 3.2 was recommended

My 17yo grandson built his own gaming pc (Win) last year. His geek-project adrenaline rush had turned to boredom by christmas and he asked about ad blockers and ai.  I had my own uptick of adrenaline and suggested he switch to FF & install TMky.  Done. I pointed him to greasyfork and an ad-blocker for reddit. A day or 2 ago, he said he was going to check out 'native LLMs' and I sent him the above --told him I'd been down the rabbit hole but that was all I knew.  He pinged me last night and said he has Llama 3.3 running.
« Last Edit: January 19, 2025, 12:13:35 PM by rcjordan »

ergophobe

  • Inner Core
  • Hero Member
  • *
  • Posts: 9824
    • View Profile
Re: Local AI: What is Ollama? Introduction to the AI model management tool
« Reply #4 on: February 02, 2025, 10:26:04 PM »
Is he teaching his peers to block ads and install Ollama?

I forget what platform(s) people are using, but there 's a fair bit of talk on the fitness forum about loading their fitness data into models and either doing data analysis or getting coaching. The forum owner, who is a coach to some elite athletes and generally considered an "authority" has a model going where he coaches himself based on various personas he creates.

rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 17149
  • Debbie says...
    • View Profile
Re: Local AI: What is Ollama? Introduction to the AI model management tool
« Reply #5 on: February 02, 2025, 11:26:19 PM »
> peers

Dunno. He tends to play his cards *very* close ...I have no idea where he got that. hhh

>ollama

working on a new thread. will post next

https://th3core.com/talk/hardware-technology/local-ai-deepseek-r11-5b-running-now/

« Last Edit: February 02, 2025, 11:49:24 PM by rcjordan »