Run the newest LLM's locally! No GPU needed, no configuration, fast and stable LLM's!
This is crazy, it can run LLM’s without needing a gpu at all, and it runs it fast enough that it is usable! Setup your own AI chatbots, AI coder, AI medical bot, AI creative writer, and more!
Install on Linux or Windows Subsystem for Linux 2
curl https://ollama.ai/install.sh | sh
Install on Mac:
https://ollama.ai/download/mac
Pull and run a model
ollama run [modelname]
Pull and run a 13b model
ollama run [modelname]:13b
Exit out from running ollama
/bye
Ollama website:
https://ollama.ai/
Ollama Github
https://github.com/jmorganca/ollama
Start Ollama if it is not running
sudo systemctl start ollama
Stop Ollama if you wanted to for some reason
sudo systemctl stop ollama
Stop ollama from booting up on system boot
sudo systemctl disable ollama
by FE-Engineer
linux foundation
I tried this out on my MacBook Pro M1 Max, it seems to be running on the GPU, and it's wicked fast! Either that, or the default settings are different and I'm using some other configuration.
i'd love to see more about ollama and running it on a server (:
Dude, this fairy tale is bullshit. Just read it 🙂
if this is what i think it is, ive been using the one thats under microsofts 4gb .exe file size limit.
its been working fairly quickly considering my laptop has an i5-8250u in it.
ive just chucked wsl on said laptop and am attempting to install it the proper version through that and see if it "just works"
for those who wish to run llms on windows i would suggest lm studio. it's easy and has many features.
yesterday i found your channel, I have watched at least 20 videos of your, greater content bro, I have bought 6750xt which is cheaper and have equal performance then 3080. I thought I would never do ai in this card, but after watching your video, I started AI again after 1 year gap :))))))))))
Dude, you keep consistently drop great videos. I hope your channel grows. Mine is a 7900X Ryzen, I'm certain it should be enough