I Built a CoPilot+ AI PC (without Windows)
Raspberry Pi AI enters the chat.
The new AI Kit is $70 and you can find more on Raspberry Pi’s website: https://www.raspberrypi.com/news/raspberry-pi-ai-kit-available-now-at-70/
Full disclosure: Raspberry Pi sent the AI Kit I’ve been testing for this video—they did not sponsor the video nor did they have any input into the content of this video (or a chance to review it before it was published).
Some of the things I mentioned in this video:
– Frigate NVR video: https://youtu.be/7wkVGcdI2vk
– Hailo AI: https://hailo.ai
– Google Coral TPUs: https://coral.ai
– Pineboards (the HATs I used): https://pineboards.io
– Tam Hanna’s video on the AI Camera: https://www.youtube.com/watch?v=tY–kw0tVd0
– Alftel 12-slot M.2 PCIe expansion card: https://pipci.jeffgeerling.com/cards_m2/alftel-12x-pcie-m2-carrier-board.html
– My Pi PCI Express Database site: https://pipci.jeffgeerling.com/
– Hailo examples for Pi 5: https://github.com/hailo-ai/hailo-rpi5-examples
– Raspberry Pi AI Kit docs:
https://www.raspberrypi.com/documentation/accessories/ai-kit.html
Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff
Contents:
00:00 – Total Recall
00:33 – Raspberry Pi AI Kit
01:05 – AI AI oh.
01:38 – Cameras
02:59 – AI architecture
04:22 – YOLO (and other Demos)
06:04 – LLMs and Generative AI
06:28 – 51 TOPS attempt – the build
09:42 – No magic smoke!
11:02 – Any other way?
11:49 – Other AI options (that are actually useful)
how to repair windows 7
0:53 – My brain must've been turned off when I was making that slide. The Coral does 4 TOPS, not 2. And the Hailo-8L is more like 3-4 TOPS/W, not the 8 I put in the slide.
Sorry about that, wish I could edit that bit in the video but YouTube doesn't have any mechanism to allow it! Thanks to @thijsp for pointing out my glaring mistake!
Good night, I'm getting some sleep—it's morning in the UK, middle of the night here 😉
we are only 93% certain Jeff is a person
Jeff sir pineboard is not available in India & no online deliveries for India, is there any alternatives?
I'm neck deep in NPU coding but glad to see its spreading more outside the corporate prison walls! Subbed!
i just want ai to tell me which one of my cats shit on my floor xD
Sorry but you really don't know about AI.
THIS IS SUPER DUPER
I just started building one of these! Excited to see your build
How about an LLM? Can this coprocessor help with something like Ollama based coding copilot?
Who cares about running AI. All the power comes from the training data. A $70 kit is going to lose to the $1000000000000 that M$ et al have invested in this scam.
CAN WE FURBY IT?
YES AND FAAAAK NO.. NO CAUSE someone gonna Eww that or Stickit to a furby.
Yes Cause I CAN ADD A GIGAPET BEAR STYLE PIXEL LCD FACE
any additional setup needed?
Could you use the geekworm x1011 to do this?
try llama.cpp on that 128 core arm cpu.
Jeff. You must get a cricket ball and dispense with the baseball ball and glove. From the UK!! 😂
Fired&Wired 😉
Yeah, so you did nothing at all at the end… spoiler alert!
Who needs m4 or snapdragon elite anyway when you have raspberry pi
Title is… "I Built a CoPilot+ AI PC (without Windows)"
-ingenous wording for CoPilot+, however the contraption… did not run Copilot+
-AI… well NPUs are there, and models were run, so that's fair.
-PC… that currently do not have architecturally… ARM SoCs?
-Without Windows… that's indeed corrrect. Not that a Raspberry Pi could run Windows, currently.
-Full deployment of the contraption… did not work fully.
So 40% fair, 60%.
Previous video had better title, sorry.
TItle bait.
Seriously pushing the limits here! 🙂
informetive
Trash trash trash and more trash, wonky boards, flapping around, bleh…
Can it do signal processing AI? Not video
I remember when I was first getting the PCIe on the Pi5 going, and everyone was screaming about signal integrity!
Now look at you!
that tri pod that holding up the camera, where can i get it?
Alternative title: "I Built a PC (with MORE SPYWARE)".
a better and cheaper home made OAK – D !!
So does this mean you don't technically need the hat or a pi5? Like say you use cytrons cm4 maker board. It allows access to pcie 2×1 to the cm4 right?
I'm more impressed how you managed to daisy chain PCIE channels rather than the AI stuff
When I worked in the UK we had a suggested system that would take a picture of a machine that was running … Then compare the image to "correct" operation. Fault detection and stopping the machine if a fault was detected.
The Pi could do this in real time video now.. 25 years later.
But back in 1999.. this would cost £2,500 to implement.
Jeff we want to see how you configured home assistant for the power usage monitor! (Saw in an old video, comment it here just to put it in a recent video)
So we don't need ChatGPT anymore?
Free Palestine。Don't buy Hailo product。because it's Israeli company
Israel represents 🫡 AI kit from Israel!
….. makes me want Ui skins for Poi Machine and Poi Samaritan