How to run an LLM Locally on Ubuntu Linux
Here’s a step by step guide to running a ChatGPT like LLM on your own machine with Ollama. Includes how to install Ollama on your machine, how to access it with CURL, Python, and how to install a web interface.
Perfect for beginners to LLMs.
Instructions from this article:
https://www.jeremymorgan.com/blog/generative-ai/run-llm-locally-ubuntu/
Ollama website:
https://ollama.com/
Open WebUI:
https://github.com/open-webui/open-webui
NVidia Container Toolkit:
https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html
—
Follow me on YouTube: https://www.youtube.com/jeremymorgan?sub_confirmation=1
Yell at me on Twitter: https://twitter.com/jeremycmorgan
Check out my Blog: https://www.jeremymorgan.com
ubuntu
