Pinchflat

thumbnail_filepath:

tasks:

playlist_index:

uploaded_at:


      
        2026-03-11T17:05:09Z

media_redownloaded_at:

uuid:


      
        3b26e66b-b140-401a-a8c3-2e28c4e6d00c

media_size_bytes:

400833138

description:


      
        We check out the new NVIDIA B300 solutions from Supermicro and compare them to the NVIDIA B200 generation. We also get into the Spectrum-X networking, liquid cooling, and much more that go into building an AI factory.

STH Main Site Article: https://www.servethehome.com/checking-out-the-supermicro-nvidia-b300-solutions-and-what-it-takes-to-build-an-ai-factory/

Substack: https://axautikgroupllc.substack.com/
STH Top 5 Weekly Newsletter: https://eepurl.com/dryM09

----------------------------------------------------------------------
Become a STH YT Member and Support Us
----------------------------------------------------------------------
Join STH YouTube membership to support the channel: https://www.youtube.com/channel/UCv6J_jJa8GJqFwQNgNrMuww/join
Professional Users Substack: https://axautikgroupllc.substack.com/
----------------------------------------------------------------------
Where to Find The Unit We Purchased
Note we may earn a small commission if you use these links to purchase a product through them.
----------------------------------------------------------------------
STH Merch on Spring: https://the-sth-merch-shop.myteespring.co/

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: https://forums.servethehome.com
Follow on Twitter: https://twitter.com/ServeTheHome
Follow on LinkedIn: https://www.linkedin.com/company/servethehome-com/
Follow on Facebook: https://www.facebook.com/ServeTheHome/
Follow on Instagram: https://www.instagram.com/servethehome/

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- Touring a 100,000 GPU Cluster at xAI Colossus: https://youtu.be/Jf8EPSBZU7Y
- Touring Lambda AI Cluster at Cologix: https://youtu.be/N5AJJ0tAoxc
- Touring a 25 Year Old and a New Data Center: https://youtu.be/dmUmx3c8eJs
- A fun data center tour: https://youtu.be/qUmLnSEVVDw
- 2025 AI PCIe GPU Guide: https://youtu.be/SEaebgjKbCc
- Inside the NVIDIA H200 AI Server: https://youtu.be/dmOCYFVLi2M
- Modern AI server power: https://youtu.be/iUvCpxad0Vs

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
00:24 Main Server Types in an AI Factory
01:24 Air-cooled Supermicro NVIDIA B300 vs. B200 Platforms
02:27 Liquid-cooled Supermicro NVIDIA B300 vs. B200 Platforms
04:47 Supermicro 2OU 8-GPU NVIDIA B300 Platform with NVIDIA Quantum-X800
06:30 Supermicro NVIDIA RTX Pro 6000 Server Edition with NVIDIA ConnectX-8
08:14 NVIDIA PCIe GPUs in standard Supermicro Servers
08:27 Supermicro NVIDIA GB300 NVL72 liquid-cooled rack
09:09 Supermicro ORV3 Power Shelves and 5.5kW PSUs
10:20 NVIDIA NVLink Spine
11:10 NVIDIA Spectrum-X, Spectrum-4, and ConnectX-8
12:08 Supermicro Liquid-Cooled AI Factory
12:13 Supermicro In-Row CDU
12:58 Supermicro Designs Secondary Liquid-Cooling Loops
13:37 Power Delivery
14:35 Supermicro Rear Door Heat Exchangers
16:20 Supermicro Liquid-to-Air Sidecar
17:09 Supermicro Liquid Cooling Towers 
18:32 Supermicro DCBBS or Data Center Building Block Solutions
18:44 Supermicro's and NVIDIA's Management and Software Stacks
19:44 Key Lessons Learned

title:


      
        Newest Gen AI Servers Are Built Like This

media_id:


      
        CHEbom4opXg

id:

source_id:

prevent_culling:


      
        false

nfo_filepath:

media_downloaded_at:


      
        2026-03-12T01:45:26Z

matching_search_term:

last_error:

duration_seconds:

livestream:


      
        false

media_filepath:

short_form_content:


      
        false

culled_at:


      
        2026-04-12T01:00:00Z

updated_at:


      
        2026-04-12T01:00:00Z

subtitle_filepaths:

predicted_media_filepath:


      
        /downloads/ServeTheHome/2026-03-11 Newest Gen AI Servers Are Built Like This/Newest Gen AI Servers Are Built Like This.mp4

original_url:


      
        
  https://www.youtube.com/watch?v=CHEbom4opXg

metadata_filepath:

inserted_at:


      
        2026-03-12T01:43:58Z

prevent_download:


      
        true

upload_date_index:

We can't find the internet

Something went wrong!

Newest Gen AI Servers Are Built Like This

Raw Attributes