Linux serverlinux web serverNETWORK ADMINISTRATIONS

AI Networking is CRAZY!! (but is it fast enough?)

Learn more from Juniper Networks on how the network will save the AI data center: https://juniper.net/AIwars

Dive into the heart of the AI networking battleground where the demand for speed and efficiency tests the limits of technology. This video unravels the complexities of training AI models, highlighting the network bottlenecks that slow down progress and how innovations like RDMA, RoCE, ECN, and PFC are pivotal in the quest for seamless AI development. We explore the clash between Ethernet and Infiniband, dissecting their strengths and weaknesses in handling the massive data and low-latency requirements of AI training.

🔥🔥Join the NetworkChuck Academy!: https://ntck.co/NCAcademy

**Sponsored by Juniper

SUPPORT NETWORKCHUCK
—————————————————
➡️NetworkChuck membership: https://ntck.co/Premium
☕☕ COFFEE and MERCH: https://ntck.co/coffee

Check out my new channel: https://ntck.co/ncclips

🆘🆘NEED HELP?? Join the Discord Server: https://discord.gg/networkchuck

STUDY WITH ME on Twitch: https://bit.ly/nc_twitch

READY TO LEARN??
—————————————————
-Learn Python: https://bit.ly/3rzZjzz
-Get your CCNA: https://bit.ly/nc-ccna

FOLLOW ME EVERYWHERE
—————————————————
Instagram: https://www.instagram.com/networkchuck/
Twitter: https://twitter.com/networkchuck
Facebook: https://www.facebook.com/NetworkChuck/
Join the Discord server: http://bit.ly/nc-discord

AFFILIATES & REFERRALS
—————————————————
(GEAR I USE…STUFF I RECOMMEND)
My network gear: https://geni.us/L6wyIUj
Amazon Affiliate Store: https://www.amazon.com/shop/networkchuck
Buy a Raspberry Pi: https://geni.us/aBeqAL
Do you want to know how I draw on the screen?? Go to https://ntck.co/EpicPen and use code NetworkChuck to get 20% off!!
fast and reliable unifi in the cloud: https://hostifi.com/?via=chuck

AI network challenges
High-performance computing for AI
Ethernet vs. Infiniband comparison
Optimizing AI data centers
RDMA technology explained
RoCE for AI networking
AI model training efficiency
Reducing AI network latency
Tail latency in AI development
GPU server networking for AI
High-speed networking for AI
AI data center infrastructure
Infiniband benefits for AI
Ethernet advancements in AI
Network bottlenecks in AI training
AI workload network solutions
High bandwidth requirements for AI
AI network traffic optimization
Low-latency networking for AI
Network protocols for AI
AI network congestion solutions
ECN and PFC in AI networking
Future of AI networking technologies
Building scalable AI networks

#ainetworking #infiniband #rdma

source

by NetworkChuck

linux http server

34 thoughts on “AI Networking is CRAZY!! (but is it fast enough?)

  • Learn more from Juniper Networks on how the network will save the AI data center: https://juniper.net/AIwars

    Dive into the heart of the AI networking battleground where the demand for speed and efficiency tests the limits of technology. This video unravels the complexities of training AI models, highlighting the network bottlenecks that slow down progress and how innovations like RDMA, RoCE, ECN, and PFC are pivotal in the quest for seamless AI development. We explore the clash between Ethernet and Infiniband, dissecting their strengths and weaknesses in handling the massive data and low-latency requirements of AI training.

    🔥🔥Join the NetworkChuck Academy!: https://ntck.co/NCAcademy

    **Sponsored by Juniper

  • Is infiniband pretty much just combining all of the servers pcie lanes? Do they even need firewalls anymore, would it be crazy easy to hack? Do they route or switch at all? 🎉

  • Are the AI’s running on GPU’s? They only run on Graphics cards? Why not CPU’s?

  • Wow this was cool 😀 I like both of them. A new network system will be needed for Quantum Computers soon as well. Quantum teleportation where the state can not change. Interesting time to be alive . Thank you for this video😊

  • I thought we were talking about datacenters. Why would you use TCP in a datacenter?

  • The problems infiniband has are temporarily. No Staff, low demand and small community are all the same thing, and should infiniband win they get resolved by winning. Its a rockier road to that line, but maybe thats worth it…?

  • Hi, can you show how to download torrent/magnet links from tor(in secure way)?🥺

  • CISCO has already 800G just so you know, next 1600

  • Are you suggesting that a career field for infini-band technicians is coming soon?

  • We've just done some testing at work with the guys from Juniper, those switches are beasts

  • I remember working with Infiniband in 2006. Its cool to see that they're still going.

  • interesting how people throw shade at cypto for its power consumption and computing needs BUT with AI the brakes are removed >hmmm.gif<

  • The larger communities will always win unless the new tech is so groundbreaking, it will replace old tech eventually.

  • ECN and PFC sounds like it would introduce quite a bit of latency to the network

  • What's a good cert I can try to get that would incorporate emerging tech like this with networks?

  • Since when is Infiniband new? Nvidia bought Mellanox just because of its infiniband patents.

  • So let me get this straight! We are going to build data centres in Antarctica, which will eventually bring about the melting of glaciers, culminating in the mass extinction of the human race due to catastrophic flooding around the world and bring about devastation that has not been seen on earth since the ice age? Where do I sign up?

Comments are closed.