{"id":65498,"date":"2025-02-06T20:23:40","date_gmt":"2025-02-06T20:23:40","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2025\/02\/06\/tesla-dojo-elon-musks-big-plan-to-build-an-ai-supercomputer-explained\/"},"modified":"2025-02-06T20:25:15","modified_gmt":"2025-02-06T20:25:15","slug":"tesla-dojo-elon-musks-big-plan-to-build-an-ai-supercomputer-explained","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2025\/02\/06\/tesla-dojo-elon-musks-big-plan-to-build-an-ai-supercomputer-explained\/","title":{"rendered":"Tesla Dojo: Elon Musk’s big plan to build an AI supercomputer, explained"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

For years, Elon Musk has talked about Dojo \u2014 the AI supercomputer that would be the cornerstone of Tesla\u2019s AI ambitions. It\u2019s necessary sufficient to Musk that in July 2024, he stated the corporate\u2019s AI crew would \u201cdouble down<\/a>\u201d on Dojo within the lead as much as Tesla\u2019s robotaxi reveal,<\/a> which occurred in October.\u00a0\u00a0<\/p>\n

However what precisely is Dojo? And why is it so essential to Tesla\u2019s long-term technique?<\/p>\n

In brief: Dojo is Tesla\u2019s custom-built supercomputer that\u2019s designed to coach its \u201cFull Self-Driving\u201d neural networks. Beefing up Dojo goes hand-in-hand with Tesla\u2019s objective to achieve full self-driving and produce a robotaxi to market. FSD, which is on tons of of hundreds of Tesla automobiles as we speak, can carry out some automated driving duties however nonetheless requires a human to be attentive behind the wheel.\u00a0<\/p>\n

Tesla\u2019s Cybercab reveal has come and gone, and now the corporate is gearing as much as launch an autonomous ride-hail service utilizing its personal fleet of automobiles in Austin this June.<\/a> Tesla additionally stated throughout its 2024 fourth-quarter and full-year earnings call<\/a> on the finish of January that it plans to launch unsupervised FSD for U.S. clients in 2025.\u00a0<\/p>\n

Musk\u2019s earlier rhetoric has been that Dojo can be the important thing to attaining Tesla\u2019s objective of full self-driving. Now that Tesla seems near nearing that objective, Musk has been mum on Dojo.\u00a0<\/p>\n

As an alternative, ever since August 2024, speak has been round Cortex<\/a>, Tesla\u2019s \u201cbig new AI coaching supercluster being constructed at Tesla HQ in Austin to resolve real-world AI.\u201d Musk has also said<\/a> it would have \u201chuge storage for video coaching of FSD & Optimus.\u201d\u00a0<\/p>\n

In Tesla\u2019s Q4 shareholder deck<\/a>, the corporate shared updates on Cortex, however nothing on Dojo.\u00a0<\/p>\n

Tesla has positioned itself to spend huge on AI and Dojo \u2014 and now Cortex \u2014 to achieve its objective of autonomy for each vehicles and humanoid robots. And Tesla\u2019s future success actually hinges on its potential to nail this down, given the elevated competitors within the EV market. So it\u2019s price taking a more in-depth take a look at Dojo, Cortex, and the place all of it stands as we speak.\u00a0<\/p>\n

Tesla\u2019s Dojo backstory<\/h2>\n
\"\"
Picture Credit:<\/strong>SUZANNE CORDEIRO\/AFP by way of Getty Photographs \/ Getty Photographs<\/span><\/figcaption><\/figure>\n

Musk doesn\u2019t need Tesla to be simply an automaker, or perhaps a purveyor of photo voltaic panels and\u00a0vitality storage methods. As an alternative, he desires Tesla to be an AI firm, one which has cracked the code to self-driving vehicles by mimicking human notion.\u00a0<\/p>\n

Most different corporations constructing autonomous automobile know-how depend on a mixture of sensors to understand the world \u2014 like lidar, radar and cameras \u2014 in addition to high-definition maps to localize the automobile. Tesla believes it could possibly obtain totally autonomous driving by counting on cameras alone to seize visible information after which use superior neural networks to course of that information and make fast choices about how the automotive ought to behave.\u00a0<\/p>\n

As Tesla\u2019s former head of AI, Andrej Karpathy, stated on the automaker\u2019s first AI Day in 2021<\/a>, the corporate is principally attempting to construct \u201can artificial animal from the bottom up.\u201d (Musk had been teasing Dojo since 2019, however Tesla formally introduced it at AI Day.)<\/p>\n

Firms like Alphabet\u2019s Waymo have commercialized Level 4 autonomous vehicles<\/a> \u2014 which the SAE defines as a system that may drive itself with out the necessity for human intervention below sure situations\u00a0\u2014 via a extra conventional sensor and machine studying strategy. Tesla has nonetheless but to provide an autonomous system that doesn\u2019t require a human behind the wheel.\u00a0<\/p>\n

About 1.8 million folks have paid the hefty subscription price<\/a> for Tesla\u2019s FSD, which presently prices $8,000 and has been priced as high as $15,000<\/a>. The pitch is that Dojo-trained AI software program will ultimately be pushed out to Tesla clients by way of over-the-air updates. The dimensions of FSD additionally means Tesla has been capable of rake in hundreds of thousands of miles price of video footage that it makes use of to coach FSD. The concept there’s that the extra information Tesla can gather, the nearer the automaker can get to truly attaining full self-driving.\u00a0<\/p>\n

Nonetheless, some trade specialists say there could be a restrict to the brute pressure strategy of throwing extra information at a mannequin and anticipating it to get smarter.\u00a0<\/p>\n

\u201cInitially, there\u2019s an financial constraint, and shortly it would simply get too costly to do this,\u201d Anand Raghunathan, Purdue College\u2019s Silicon Valley professor {of electrical} and pc engineering, informed TechCrunch. Additional, he stated, \u201cSome folks declare that we would truly run out of significant information to coach the fashions on. Extra information doesn\u2019t essentially imply extra data, so it depends upon whether or not that information has data that’s helpful to create a greater mannequin, and if the coaching course of is ready to truly distill that data into a greater mannequin.\u201d\u00a0<\/p>\n

Raghunathan stated regardless of these doubts, the development of extra information seems to be right here for the short-term at the very least. And extra information means extra compute energy wanted to retailer and course of all of it to coach Tesla\u2019s AI fashions. That’s the place Dojo, the supercomputer, is available in.\u00a0<\/p>\n

What’s a supercomputer?<\/h2>\n

Dojo is Tesla\u2019s supercomputer system that\u2019s designed to perform as a coaching floor for AI, particularly FSD. The identify is a nod to the area the place martial arts are practiced.\u00a0<\/p>\n

A supercomputer is made up of hundreds of smaller computer systems referred to as nodes. Every of these nodes has its personal CPU (central processing unit) and GPU (graphics processing unit). The previous handles general administration of the node, and the latter does the advanced stuff, like splitting duties into a number of elements and dealing on them concurrently. GPUs are important for machine studying operations like people who energy FSD coaching in simulation. Additionally they energy giant language fashions, which is why the rise of generative AI has made Nvidia essentially the most worthwhile firm on the planet.\u00a0<\/p>\n

Even Tesla buys Nvidia GPUs to coach its AI (extra on that later).\u00a0<\/p>\n

Why does Tesla want a supercomputer?<\/h2>\n

Tesla\u2019s vision-only strategy is the principle motive Tesla wants a supercomputer. The neural networks behind FSD are educated on huge quantities of driving information to acknowledge and classify objects across the automobile after which make driving choices. That implies that when FSD is engaged, the neural nets have to gather and course of visible information repeatedly at speeds that match the depth and velocity recognition capabilities of a human.\u00a0<\/p>\n

In different phrases, Tesla means to create a digital duplicate of the human visible cortex and mind perform.\u00a0<\/p>\n

To get there, Tesla must retailer and course of all of the video information collected from its vehicles world wide and run hundreds of thousands of simulations to coach its mannequin on the information.\u00a0<\/p>\n

\n

Tesla seems to depend on Nvidia to energy its present Dojo coaching pc, however it doesn\u2019t need to have all its eggs in a single basket \u2014 not least as a result of Nvidia chips are costly. Tesla additionally hopes to make one thing higher that will increase bandwidth and reduces latencies. That\u2019s why the automaker\u2019s AI division determined to give you its personal {custom} {hardware} program that goals to coach AI fashions extra effectively than conventional methods.\u00a0<\/p>\n

At that program\u2019s core is Tesla\u2019s proprietary D1 chips, which the corporate says are optimized for AI workloads.\u00a0<\/p>\n

Inform me extra about these chips<\/h2>\n
\"Ganesh
Ganesh Venkataramanan, former senior director of Autopilot {hardware}, presenting the D1 coaching tile at Tesla\u2019s 2021 AI Day. <\/span>Picture Credit:<\/strong>Tesla\/screenshot of streamed occasion<\/span><\/figcaption><\/figure>\n

Tesla is of an analogous opinion to Apple in that it believes {hardware} and software program must be designed to work collectively. That\u2019s why Tesla is working to maneuver away from the usual GPU {hardware} and design its own chips<\/a> to energy Dojo.\u00a0<\/p>\n

Tesla unveiled its D1 chip, a silicon sq. the scale of a palm, on AI Day in 2021. The D1 chip entered into manufacturing as of at the very least Could this yr. The Taiwan Semiconductor Manufacturing Firm (TSMC) is manufacturing the chips utilizing 7 nanometer semiconductor nodes. The D1 has 50 billion transistors and a big die dimension of 645 millimeters squared, in response to Tesla. That is all to say that the D1 guarantees to be extraordinarily highly effective and environment friendly and to deal with advanced duties shortly.\u00a0<\/p>\n

\u201cWe are able to do compute and information transfers concurrently, and our {custom} ISA, which is the instruction set structure, is totally optimized for machine studying workloads,\u201d stated Ganesh Venkataramanan, former senior director of Autopilot {hardware}, at Tesla\u2019s 2021 AI Day. \u201cIt is a pure machine studying.\u201d<\/p>\n

The D1 remains to be not as highly effective as Nvidia\u2019s A100 chip, although, which can be manufactured by TSMC utilizing a 7 nanometer course of. The A100 comprises 54 billion transistors and has a die dimension of 826 sq. millimeters, so it performs barely higher than Tesla\u2019s D1.\u00a0<\/p>\n

To get the next bandwidth and better compute energy, Tesla\u2019s AI crew fused 25 D1 chips collectively into one tile to perform as a unified pc system. Every tile has a compute energy of 9 petaflops and 36 terabytes per second of bandwidth, and comprises all of the {hardware} crucial for energy, cooling and information switch. You may consider the tile as a self-sufficient pc made up of 25 smaller computer systems. Six of these tiles make up one rack, and two racks make up a cupboard. Ten cupboards make up an ExaPOD. At AI Day 2022, Tesla stated Dojo would scale by deploying a number of ExaPODs. All of this collectively makes up the supercomputer.\u00a0<\/p>\n

Tesla can be engaged on a next-gen D2 chip that goals to resolve data circulate bottlenecks. As an alternative of connecting the person chips, the D2 would put the whole Dojo tile onto a single wafer of silicon.\u00a0<\/p>\n

Tesla hasn\u2019t confirmed what number of D1 chips it has ordered or expects to obtain. The corporate additionally hasn\u2019t supplied a timeline for the way lengthy it would take to get Dojo supercomputers operating on D1 chips.\u00a0<\/p>\n

In response to a June post on X<\/a> that stated: \u201cElon is constructing an enormous GPU cooler in Texas,\u201d Musk replied that Tesla was aiming for \u201chalf Tesla AI {hardware}, half Nvidia\/different\u201d over the following 18 months or so. The \u201cdifferent\u201d might be AMD chips, per Musk\u2019s comment in January<\/a>.\u00a0<\/p>\n

What does Dojo imply for Tesla?<\/h2>\n
\"\"
Tesla\u2019s humanoid robotic Optimus Prime II at WAIC in Shanghai, China, on July 7, 2024. <\/span>Picture Credit:<\/strong>Costfoto\/NurPhoto \/ Getty Photographs<\/span><\/figcaption><\/figure>\n

Taking management of its personal chip manufacturing implies that Tesla would possibly sooner or later be capable to shortly add giant quantities of compute energy to AI coaching packages at a low price, notably as Tesla and TSMC scale up chip manufacturing.\u00a0<\/p>\n

It additionally implies that Tesla could not need to depend on Nvidia\u2019s chips sooner or later, that are more and more costly and arduous to safe.\u00a0<\/p>\n

Throughout Tesla\u2019s second-quarter earnings name, Musk stated that demand for Nvidia {hardware} is \u201cso excessive that it\u2019s typically troublesome to get the GPUs.\u201d He stated he was \u201cfairly involved about truly having the ability to get regular GPUs after we need them, and I believe this subsequently requires that we put much more effort on Dojo with a view to be sure that we\u2019ve acquired the coaching functionality that we’d like.\u201d\u00a0<\/p>\n

That stated, Tesla remains to be shopping for Nvidia chips as we speak to coach its AI. In June, Musk posted on X<\/a>:\u00a0<\/p>\n

\n

Of the roughly $10B in AI-related expenditures I stated Tesla would make this yr, about half is inside, primarily the Tesla-designed AI inference pc and sensors current in all of our vehicles, plus Dojo. For constructing the AI coaching superclusters, Nvidia {hardware} is about 2\/3 of the fee. My present greatest guess for Nvidia purchases by Tesla are $3B to $4B this yr.<\/p>\n<\/blockquote>\n

\u201cInference compute\u201d refers back to the AI computations carried out by Tesla vehicles in actual time and is separate from the coaching compute that Dojo is accountable for.<\/p>\n

Dojo is a dangerous guess, one which Musk has hedged a number of instances by saying that Tesla may not succeed.\u00a0<\/p>\n

In the long term, Tesla might theoretically create a brand new enterprise mannequin primarily based on its AI division. Musk has stated that the primary model of Dojo might be tailor-made for Tesla pc imaginative and prescient labeling and coaching, which is nice for FSD and for coaching Optimus<\/a>, Tesla\u2019s humanoid robotic. However it wouldn\u2019t be helpful for a lot else.\u00a0<\/p>\n

Musk has said<\/a> that future variations of Dojo might be extra tailor-made to general-purpose AI coaching. One potential drawback with that’s virtually all AI software program out there was written to work with GPUs. Utilizing Dojo to coach general-purpose AI fashions would require rewriting the software program.\u00a0<\/p>\n

That’s, except Tesla rents out its compute, much like how AWS and Azure lease out cloud computing capabilities. Musk additionally famous throughout Q2 earnings that he sees \u201ca path to being aggressive with Nvidia with Dojo.\u201d<\/p>\n

A September 2023 report from Morgan Stanley predicted that Dojo might add $500 billion<\/a> to Tesla\u2019s market worth by unlocking new income streams within the type of robotaxis and software program companies.\u00a0<\/p>\n

In brief, Dojo\u2019s chips are an insurance coverage coverage for the automaker, however one that might pay dividends.\u00a0<\/p>\n

How far alongside is Dojo?<\/h2>\n
\"\"
Nvidia CEO Jensen Huang and Tesla CEO Elon Musk on the GPU Know-how Convention in San Jose, California. <\/span>Picture Credit:<\/strong>Kim Kulish\/Corbis by way of Getty Photographs \/ Getty Photographs<\/span><\/figcaption><\/figure>\n

Reuters reported<\/a> final yr that Tesla started manufacturing on Dojo in July 2023, however a June 2023 post<\/a> from Musk instructed that Dojo had been \u201con-line and operating helpful duties for a number of months.\u201d<\/p>\n

Across the similar time, Tesla stated it anticipated Dojo to be one of many prime 5 strongest supercomputers by February 2024 \u2014 a feat that has but to be publicly disclosed, leaving us uncertain that it has occurred. <\/p>\n

The corporate additionally stated it expects Dojo\u2019s whole compute to achieve 100 exaflops in October 2024.\u00a0(One exaflops is the same as 1 quintillion pc operations per second. To succeed in 100 exaflops, and assuming that one D1 can obtain 362 teraflops, Tesla would want greater than 276,000 D1s, or round 320,500 Nvidia A100 GPUs.)<\/p>\n

Tesla additionally pledged in January 2024 to spend $500 million<\/a> to construct a Dojo supercomputer at its gigafactory in Buffalo, New York.<\/p>\n

In Could 2024, Musk noted<\/a> that the rear portion of Tesla\u2019s Austin gigafactory might be reserved for a \u201ctremendous dense, water-cooled supercomputer cluster.\u201d Now we all know that it\u2019s truly Cortex, not Dojo, that’s taking on that area in Austin.\u00a0<\/p>\n

Simply after Tesla\u2019s second-quarter earnings name, Musk posted on X<\/a> that the automaker\u2019s AI crew is utilizing Tesla HW4 AI pc (renamed AI4), which is the {hardware} that lives on Tesla automobiles, within the coaching loop with Nvidia GPUs. He famous that the breakdown is roughly 90,000 Nvidia H100s plus 40,000 AI4 computer systems.\u00a0<\/p>\n

\u201cAnd Dojo 1 may have roughly 8k H100-equivalent of coaching on-line by finish of yr,\u201d he continued. \u201cNot huge, however not trivial both.\u201d<\/p>\n

Tesla hasn\u2019t supplied updates as as to whether it has gotten these chips on-line and operating Dojo. Throughout the firm\u2019s fourth-quarter 2024 earnings name, nobody talked about Dojo. Nonetheless, Tesla stated it accomplished the deployment of Cortex in This autumn, and that it was Cortex that helped allow V13 of supervised FSD.\u00a0<\/p>\n

This story initially revealed August 3, 2024, and we are going to replace it as new data develops.<\/em><\/p>\n<\/div>\n