• About Us
  • Announce
  • Privacy Policy
  • Contact us
MasterTrend News
  • Home
    • BLOG
    • TECHNICAL SERVICE
    • STORE
  • Tutorials
  • Hardware
  • Gaming
  • Mobiles
  • Security
  • Windows
  • AI
  • Software
  • Networks
  • News
  • en_USEnglish
    • es_ESSpanish
    • pt_BRPortuguese
    • fr_FRFrench
    • it_ITItalian
    • de_DEGerman
    • ko_KRKorean
    • jaJapanese
    • zh_CNChinese
    • ru_RURussian
    • thThai
    • pl_PLPolish
    • tr_TRTurkish
    • id_IDIndonesian
    • hi_INHindi
    • arArabic
    • sv_SESwedish
    • nl_NLDutch
No result
See all results
  • Home
    • BLOG
    • TECHNICAL SERVICE
    • STORE
  • Tutorials
  • Hardware
  • Gaming
  • Mobiles
  • Security
  • Windows
  • AI
  • Software
  • Networks
  • News
  • en_USEnglish
    • es_ESSpanish
    • pt_BRPortuguese
    • fr_FRFrench
    • it_ITItalian
    • de_DEGerman
    • ko_KRKorean
    • jaJapanese
    • zh_CNChinese
    • ru_RURussian
    • thThai
    • pl_PLPolish
    • tr_TRTurkish
    • id_IDIndonesian
    • hi_INHindi
    • arArabic
    • sv_SESwedish
    • nl_NLDutch
No result
See all results
MasterTrend News
No result
See all results
Start AI

The Secrets of xAI Colossus: 100,000 GPUs

MasterTrend Insights by MasterTrend Insights
February 20, 2025
in AI
Reading time:Lectura de 8 minutos
TO TO
0
🌟 The Secrets of xAI Colossus: Discover Elon Musk's 100,000 GPU AI Cluster 🚀
1
SHARED
2
Views
Share on FacebookShare on Twitter

Contents

  1. 🌟 The Secrets of xAI Colossus: Discover Elon Musk's 100,000 GPU AI Cluster 🚀
  2. What's inside a 100,000 GPU cluster? 🤔
  3. 🌟 Using Colossus and Musk's stable supercomputer 🌟
    1. Related Posts

🌟 The Secrets of xAI Colossus: Discover Elon Musk's 100,000 GPU AI Cluster 🚀

If you're passionate about artificial intelligence and cutting-edge technology, you can't miss out on what Elon Musk is doing with his AI cluster. This tech giant, known as xAI Colossus, is making waves in the tech world. With a staggering 100,000 GPU processing power, this cluster is a true marvel of modern engineering. 🤖💻

In this article, we are going to unravel the secrets behind this amazing innovation. technological. We will explore how xAI Colossus is revolutionizing the field of artificial intelligence and what this means for the future. 🌟 Get ready for a fascinating journey into the heart of one of the greatest feats technological of our time. 🚀 Don't miss it!

Elon Musk's expensive new project, the xAI Colossus AI supercomputer, has been detailed for the first time. YouTuber ServeTheHome was given access to the Supermicro servers inside the 100,000 watt beast. GPU, showcasing various facets of this supercomputer. Musk's xAI Colossus supercluster has been online for nearly two months, following an assembly that took 122 days. 🔧💡

Inside the world's largest AI supercluster, xAI Colossus – YouTube

What's inside a 100,000 GPU cluster? 🤔

Patrick from ServeTheHome takes us on a tour with his camera through different parts of the server, offering a bird's-eye view of its operations. While some details More specific details about the supercomputer, such as its power consumption and the size of the bombs, could not be revealed due to a confidentiality agreement, xAI was responsible for blurring and censoring parts of the video before its release. 🎥

Despite this, the most important thing, like the servers GPU from Supermicro, remained virtually untouched throughout the footage. These GPU servers are Nvidia HGX H100, a powerful server solution featuring eight H100 GPUs each. 🚀 The HGX H100 platform is integrated within the 4U Universal GPU Liquid Crystal Display System Cooled from Supermicro, providing easily hot-swappable liquid cooling for each GPU. ❄️

These servers are organized in racks containing eight servers each, totaling 64 GPU per rack. 1U manifolds are sandwiched between each HGX H100, providing the necessary liquid cooling for the servers. At the bottom of each rack, we find another 4U Supermicro unit, this time equipped with a redundant pump system and a rack monitoring system. 🔍

Four banks of xAI HGX H100 server racks, each with capacity for eight servers. (Image credit: ServeTheHome) The rear access of an xAI Colossus GPU server. Nine Ethernet cables run out of each server, with four power supplies on each. The power and water cooling hoses are also visible.(Image credit: ServeTheHome)

🖥️ These racks are organized in groups of eight, allowing for 512 GPU per array. Each server is equipped with four power supplies redundant. At the back of the racks GPU, there are three-phase power supplies, Ethernet switches, and a rack-sized manifold that provides all the liquid cooling. 💧

There are more than 1,500 racks in the Colossus cluster. GPU, distributed across nearly 200 rack sets. According to Jensen Huang, CEO of Nvidia, the GPUs in these 200 dies were fully installed in just three weeks. 🚀

Since an AI supercluster constantly training models requires huge bandwidth, xAI went further in its interconnectivity of gridEach graphics card has a dedicated 400GbE NIC (network interface controller), with an additional 400Gb NIC per server. 🔗 This means each HGX H100 server has 3.6 terabits per second of Ethernet. Impressive, isn't it? And yes, the entire cluster runs on Ethernet, rather than InfiniBand or other exotic connections that are standard in the supercomputing world. 🌐

A shot looking down at the waves and waves of yellow Ethernet cables connecting the xAI Colossus cluster to itself. Several layers of overly wide cables are embedded in the ceiling.(Image credit: ServeTheHome)xAI's Colossus CPU computing servers, which look exactly like Supermicro's storage servers, are also used extensively on site.(Image credit: ServeTheHome)

Of course, a supercomputer like the Grok 3 chatbot, which trains AI models, needs more than just GPU to run at its best. 🔥 While details on storage and CPU servers in Colossus are somewhat limited, thanks to Patrick's video and the blog post, we know that these servers are usually in Supermicro chassis. 🚀

NVMe-forward 1U servers with x86 platform CPUs inside are used, providing both storage and computing capacity. computing, and are equipped with liquid cooling at the rear. 💧 In addition, outside you can see banks of batteries Tesla Megapack very compact. ⚡️

The start-stop feature of the array, with its millisecond latency between banks, was too much for the conventional power grid or Musk's diesel generators. So several Tesla Megapacks (each with a capacity of 3.9 MWh) are used as an intermediate power source between the grid electrical and the supercomputer. 🖥️🔋 This ensures optimal and efficient operation, avoiding interruptions. 🚦✨

🌟 Using Colossus and Musk's stable supercomputer 🌟

The xAI supercomputer Colossus is currently, according to Nvidia, the largest AI supercomputer in the world. 🤯 While many of the world's leading supercomputers are used in research by contractors or academics to study weather patterns, diseases, or other complex tasks, Colossus has sole responsibility for training X's (formerly Twitter) various AI models. Most notably, Grok 3, Elon's "anti-woke" chatbot that's available only to X Premium subscribers. 🤖

Additionally, ServeTheHome was informed that Colossus is training AI models "of the future"; models whose uses and capabilities are supposedly beyond the current capabilities of AI. 🚀 The first phase of construction of Colossus is complete and the cluster is fully operational, but it's not all over yet. The Memphis supercomputer will soon be will update to double its GPU capacity, with an additional 50,000 H100 GPUs and 50,000 next-generation H200 GPUs. 🔥

This update It will also more than double its energy consumption, which is already too much for the 14 diesel generators Musk added to the site in July to handle. ⚡ While it is short of Musk's promise of 300,000 H200s inside Colossus, that could be part of Phase 3 of updates. 🔋

On the other hand, the 50,000 GPU Cortex supercomputer at Tesla's "Giga Texas" plant also belongs to a Musk company. Cortex is dedicated to training the technology Tesla's autonomous AI projects through camera streaming and image detection, as well as Tesla's autonomous robots and other AI projects. 🤖🚗

Additionally, Tesla will soon see the construction of the Dojo supercomputer in Buffalo, New York, a $500 million project coming soon. 💸 Meanwhile, industry speculators like Baidu CEO Robin Li predict that 99% of AI companies could collapse when the bubble bursts. Whether Musk's record spending on AI will backfire or pay off remains to be seen. ⏳

Share this:
18FacebookLinkedInPinterestXRedditTumblrBlueskyThreadsShare
18
SHARES

Related Posts

  • Guide to Block Websites in Google Chrome
  • Webcam Soul Xw150
  • Boston Dynamics Atlas in action
  • Ghostwire Tokyo technical analysis
  • Checkout
  • About Us
  • AMD RX 6000 Features
  • How to Clean Windows with Bloatware
Tags: Evergreen ContentGPUInnovation
Previous Post

Microsoft Edge crashes on Windows

Next publication

How to use AdGuard DNS on Android in 2025

MasterTrend Insights

MasterTrend Insights

Our editorial team shares in-depth reviews, tutorials, and recommendations to help you get the most out of your digital devices and tools.

Next publication
How to use AdGuard DNS on Android in 2024

How to use AdGuard DNS on Android in 2025

5 3 votes
Article Rating
Subscribe
Access
Notify of
guest
guest
0 Comments
Oldest
Newest Most voted
Online Comments
See all comments

Stay Connected

  • 976 Fans
  • 118 Followers
  • 1.4k Followers
  • 1.8k Subscribers

Don't miss the latest in technology and gaming.
Exclusive tips, how-to guides, and analysis every day.

Subscription Form
  • Tendencies
  • Comments
  • Last
12 Best Alternatives to Lucky Patcher for Android

Lucky Patcher Alternatives: 12 Better and Easy Apps! 🎮⚡

May 12, 2025
How to add a clock to the Windows 11 desktop: 3 surefire tricks!

How to add a clock to your Windows 11 desktop: Get more done in minutes! ⏱️

May 1, 2025
How to use AdGuard DNS on Android in 2024

How to use AdGuard DNS on Android in 2025

February 11, 2025
How to force 4G LTE only mode on Android

How to force 4G LTE only mode on Android in 2025

February 10, 2025
Gmail Features on Android: Save Time with 5 Tips

Gmail Features on Android: 5 Tricks You Didn't Know About! 📱✨

12
Motherboard repair - Repair Motherboards

Notebook Motherboard Repair

10
Install Windows 11 Home without Internet

Install Windows 11 Home without Internet

10
How to Back Up Drivers in Windows 11/10 in 4 Steps!

How to Back Up Drivers in Windows 11/10: Avoid Errors! 🚨💾

10
Old Android Smartphone: 10 Tips to Save Battery

Old Android smartphone: Improve its performance now with these tips 🔋✨

July 11, 2025
Sleep Headphones: The Key to Perfect Sleep

Sleep headphones: 3 options that will transform your nights 🌙✨

July 11, 2025
WOLED vs QD-OLED: Which OLED will dominate in 2025?

WOLED vs. QD-OLED: Which OLED will dominate in 2025?

July 10, 2025
Screen flickering in Windows 11

Screen Flickering in Windows 11: How to Stop It Now ⚡🛠️

July 10, 2025

Recent News

Old Android Smartphone: 10 Tips to Save Battery

Old Android smartphone: Improve its performance now with these tips 🔋✨

July 11, 2025
6
Sleep Headphones: The Key to Perfect Sleep

Sleep headphones: 3 options that will transform your nights 🌙✨

July 11, 2025
5
WOLED vs QD-OLED: Which OLED will dominate in 2025?

WOLED vs. QD-OLED: Which OLED will dominate in 2025?

July 10, 2025
5
Screen flickering in Windows 11

Screen Flickering in Windows 11: How to Stop It Now ⚡🛠️

July 10, 2025
3
MasterTrend News logo

MasterTrend Info is your go-to source for technology: discover news, tutorials, and analysis on hardware, software, gaming, mobile devices, and artificial intelligence. Subscribe to our newsletter and don't miss any trends.

Follow us

Browse by Category

  • Gaming
  • Hardware
  • AI
  • Mobiles
  • News
  • Networks
  • Security
  • Software
  • Tutorials
  • Windows

Recent News

Old Android Smartphone: 10 Tips to Save Battery

Old Android smartphone: Improve its performance now with these tips 🔋✨

July 11, 2025
Sleep Headphones: The Key to Perfect Sleep

Sleep headphones: 3 options that will transform your nights 🌙✨

July 11, 2025
  • About Us
  • Announce
  • Privacy Policy
  • Contact us

Copyright © 2025 https://mastertrend.info/ - All rights reserved. All trademarks are property of their respective owners.

es_ES Spanish
es_ES Spanish
en_US English
pt_BR Portuguese
fr_FR French
it_IT Italian
ru_RU Russian
de_DE German
zh_CN Chinese
ko_KR Korean
ja Japanese
th Thai
hi_IN Hindi
ar Arabic
tr_TR Turkish
pl_PL Polish
id_ID Indonesian
nl_NL Dutch
sv_SE Swedish
No result
See all results
  • en_USEnglish
    • es_ESSpanish
    • pt_BRPortuguese
    • fr_FRFrench
    • it_ITItalian
    • de_DEGerman
    • ko_KRKorean
    • jaJapanese
    • zh_CNChinese
    • ru_RURussian
    • pl_PLPolish
    • id_IDIndonesian
    • tr_TRTurkish
    • hi_INHindi
    • thThai
    • arArabic
    • sv_SESwedish
    • nl_NLDutch
  • Gaming
  • Hardware
  • AI
  • Mobiles
  • News
  • Networks
  • Security
  • Software
  • Tutorials
  • Windows

Copyright © 2025 https://mastertrend.info/ - All rights reserved. All trademarks are property of their respective owners.

Comment Author Info
:wpds_smile::wpds_grin::wpds_wink::wpds_mrgreen::wpds_neutral::wpds_twisted::wpds_arrow::wpds_shock::wpds_unamused::wpds_cool::wpds_evil::wpds_oops::wpds_razz::wpds_roll::wpds_cry::wpds_eek::wpds_lol::wpds_mad::wpds_sad::wpds_exclamation::wpds_question::wpds_idea::wpds_hmm::wpds_beg::wpds_whew::wpds_chuckle::wpds_silly::wpds_envy::wpds_shutmouth:
wpDiscuz
RedditBlueskyXMastodonHacker News
Share this:
MastodonVKWhatsAppTelegramSMSHacker NewsLineMessenger
Your Mastodon Instance