OPERATING SYSTEMSOS Linux

This new AI is powerful and uncensored… Let’s run it

Learn how to run Mistral’s 8x7B model and its uncensored varieties using open-source tools. Let’s find out if Mixtral is a good alternative to GPT-4, and learn how to fine tune it with your own data.

#ai #programming #thecodereport

💬 Chat with Me on Discord

https://discord.gg/fireship

🔗 Resources

Mixtral 8x7b https://mistral.ai/news/mixtral-of-experts/
Uncensored AI models https://erichartford.com/uncensored-models
Ollama Github https://github.com/jmorganca/ollama
Grok AI breakdown https://youtu.be/CgruI1RjH_c?si=lgkIAs-LbW1VypXv

🔥 Get More Content – Upgrade to PRO

Upgrade at https://fireship.io/pro
Use code YT25 for 25% off PRO access

🎨 My Editor Settings

– Atom One Dark
– vscode-icons
– Fira Code Font

🔖 Topics Covered

– Mixtral 8x7B explained
– How to run Mistral models locally
– Best ChatGPT alternatives
– What is a mixture of experts AI model?
– How do you fine tune your own AI models?

source by Fireship

linux foundation

41 thoughts on “This new AI is powerful and uncensored… Let’s run it

  • i only wanna have some AI that write nasty stuff without paying my Soul each month 🙁

  • and 90% of the viewers hopes and dreams went to the abyss, bc im very sure most of them don't have 48 gb of ram i my self have 32 and 8 gb is in use in normal idiling and just browsing 💀

  • I can just see some devs spending hours and thousands of dollars renting cloud GPUs to try and prove the Flat Earth

  • Ngl this was not very responsible to make seeing as how terrorists exists.

  • with this stuff, I'm gonna make Mr. hands look like a grade school track and field day.

  • Almost $1200 for 3 days? How is that cheaper than running locally? How long would it take to train it on a $1200 PC?

  • Thankfully there is at least some sort of a push in the right direction. A future in which AI is just controlled by governments and mega corporations is terrifying. People need to understand that the only future in which we have both freedom and AI is one in which the public has the power to level the playing field. This is very much like the introduction of the internet and the rise of both hackers and anti virus defense systems. The same must be true going forward, for every negative we must ensure that the environment exists where it is possible to counter it with a positive. AI I fear will eventually become impossible to compete without, every strategy will begin to fall short without it's aid, like trying to play the stock market without a bank account using only a broker and cash, the old ways of life will become dangerously inefficient regardless of if we like it or not. When that time comes, education into the design and implementation of these tools should change to be something that you can buy with the caveat of conforming to the terms and conditions and privacy policies of an entity providing the service. Open sources and full documentation should also be available for free so that people can create personalized assistants without having to incur extreme difficulty, legal issues and costs. These should become personal to each person and ideally protected with blockchain technology. If we do it right we will see a golden age for the world, if not then I fear that it is selfish use of this very technology that will return us to the stone age.

  • Finally an AI that can explain how to hack the election to make sure Trump gets elected

  • In plain English, what would be a good plain rig, ie something you just run at home as a normal PC, in a normal case, plugged into a normal power socket, that would be good for this sort of stuff? What type of board, CPU and GPU, and what PSU would it need?

  • yea… he lost me when he said it takes 40gb in ram to run, everything else up till that point sounded reasonable

  • What if my computer isn't powerful enough to run it? Can I rent a powerful machine in the cloud and do it from there?

  • I don't know what to be afraid anymore, the ai teaching me how to do inappropriate things or python…

  • I was thinking what if openai provided ultra rich people with open source of chatgpt4 and they custom trained it for them to do things

  • I know for a fact…Unless I AM FUCKING DELUSIONAL…You had instructions on how to train this on your work pc/code….was like 3 steps somewhere in the time between 3:30 and 4:00.

  • holy shit i knew having 64gb of ddr5 ram would COME IN CLUTH ONE DAY LETS GO

  • this is the most retarded thing i've seen all day and it's only noon

  • i just want an ai that’ll tell me about stocks when to buy and sell so i can make money with options more consistently tbh

  • How can one who is new into everything related to informatics learn about all of this. I feel as lost as in the astrophysics channels

  • It's about fucking time open source language models hit the public. Tired of the bullshit censorship. Worst possible Era for artifical intelligence to be created.

  • Now i have a good reason to buy that aliexpress dual socket xeon with 512gb of ECC ram that i always wanted. Thx

  • can anybody send me the Reddit link of such stuff relating to LLMs?

  • I run Mixtral on koboldccp and it's working like a dogshit honestly. Quality of responses is worse than openhermes 2.5, wich is only 7b, and mixtral's resposes constantly devolves to word salad even with low temperature. Anyone faced this problem too? What I do wrong?

  • Does the training on a server expose your data? Eg security concerns if the company gets hacked — anyone know if they retain the data?

  • I dont really know what I'm supposed to do with this information now lol

  • I have been messing with uncensored models for months. They really bring home how badly lobotomized and slanted the other models are.

  • So this is the beginning of the singularity.

  • Lmao telling people you can't compete is a good way to get wooped

  • It’s not going to be AI vs people it’s going to be People with AI vs Big-corp with AI. 🍿🥤

  • I wanna put together a collective of anarchist coders who will work on these to produce an AI assistant we can use to strategize how to most effectively eat the rich.

  • now i finally know how to make a pipe bomb from scratch without the swat team pulling up to my house

  • I cant lie I thought openai was called openai because it was open source… Though apparently they did at one point have an open source product.

  • Im going to train this thing on my old 2016 Lenovo PC that has 8 gb of ram, I'll tell you all when it finished training.

Comments are closed.