LM Studio: The Easiest and Best Way to Run Local LLMs
In this video, we will explore LM studio, the best way to run local LLMs. It’s a competitor to something like Oobabooga Text generation webUI. The easy installation makes it best option for testing LLMs locally.
CONNET:
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Support my work on Patreon: Patreon.com/PromptEngineering
🦾 Discord: https://discord.com/invite/t4eYQRUcXB
📧 Business Contact: engineerprompt@gmail.com
💼Consulting: https://calendly.com/engineerprompt/consulting-call
LINKS:
LM Studio: https://lmstudio.ai/
Timestamps:
[00:00] Intro
[02:05] How to Download Models
[06:20] LM Studio – All available Options
[09:07] LM Studio API
by Prompt Engineering
linux foundation
Want to connect?
💼Consulting: https://calendly.com/engineerprompt/consulting-call
🦾 Discord: https://discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Join Patreon: Patreon.com/PromptEngineering
great thank, will be great if you can make a video of (LM Studio API + your LocalGPT) , thank you for great content!
WORTHLESS, why would i need to send my data off to hugginface with their loader AND WHY THE FUCK DO I NEED TO REQUEST ON DISCORD TO INSTALL ON FUCKING LINUX!
the ai face in the right hand corner is super weird
Possible to create embedding studio?
Thank you 🤩
So does this work regardless of me having a 7900xtx as a gpu and not a nvidia card considering rocm isn't fully ported to windows?
Great channel, will you do an instructional video using "LM Studio" and it's local server to host a version of an open source large language model, and then configuring "Open Interpreter" to interact with this local server instead of the OpenAI API key?
u seem much older in your voice hehe
It is possible to fine tune the model in lm studio?
When u have an intel MacBook Pro 🥲
Thanks as always for great videos. Could you please possibly look into making a video on LLM quantization (using huggingface or Kagle or any other). The options available (GGUF, GPTQ..etc) and resources required. It is a hot topic. Thanks!
♦ I believe we are meant to be like Jesus in our hearts and not in our flesh. But be careful of AI, for it is just our flesh and that is it. It knows only things of the flesh (our fleshly desires) and cannot comprehend things of the spirit such as peace of heart (which comes from obeying God's Word). Whereas we are a spirit and we have a soul but live in the body (in the flesh). When you go to bed it is your flesh that sleeps but your spirit never sleeps (otherwise you have died physically) that is why you have dreams. More so, true love that endures and last is a thing of the heart (when I say 'heart', I mean 'spirit'). But fake love, pretentious love, love with expectations, love for classic reasons, love for material reasons and love for selfish reasons that is a thing of our flesh. In the beginning God said let us make man in our own image, according to our likeness. Take note, God is Spirit and God is Love. As Love He is the source of it. We also know that God is Omnipotent, for He creates out of nothing and He has no beginning and has no end. That means, our love is but a shadow of God's Love. True love looks around to see who is in need of your help, your smile, your possessions, your money, your strength, your quality time. Love forgives and forgets. Love wants for others what it wants for itself. Take note, love works in conjunction with other spiritual forces such as faith and patience. We should let the Word of God be the standard of our lives not AI. If not, God will let us face AI on our own and it will cast the truth down to the ground, it will be the cause of so much destruction like never seen before, it will deceive many and take many captive in order to enslave them into worshipping it and abiding in lawlessness. We can only destroy ourselves but with God all things are possible. God knows us better because He is our Creater and He knows our beginning and our end. Our prove text is taken from the book of John 5:31-44, 2 Thessalonians 2:1-12, Daniel 7-9, Revelation 13-15, Matthew 24-25 and Luke 21. Let us watch and pray… God bless you as you share this message to others.
Your videos get better and better. Most useful focus and very informative. Your focus on the best tools for Local and Private and fine-tuning LLMs is vital content. Patreon donation on its way
Except it not run on Mac with Intel and else 🙁
LOL why are you using fake head ?
On a serious note the problem with LM studio i have is that it is actually CLOSED source, not open source.
The avatar is quite creepy. Ads no value at all to the content.
Basically you read the right panel like we all do but you didn't explain anything about their use 😂😂😂😂
Do you use SadTalker for the avatar? Does it work for long audio?