Tesla's Dojo supercomputer, a groundbreaking innovation in AI computation, has reportedly surpassed Nvidia's capabilities, positioning the company as a key player in shaping the future of neural network hardware. As reported by Bloomberg's Mark Gurman, this technological leap represents a significant investment in AI development, with potential applications extending beyond self-driving cars to revolutionize various industries and accelerate advancements in artificial intelligence.
Dojo has been planned and designed to be unlike any supercomputer ever made. It will be a purpose-built system for Tesla that will train AI models to work more efficiently, compute faster, and help AI accomplish things that it has never accomplished before12. More specifically, it will be used for Tesla's self-driving cars to make them highly efficient and safe by collecting a vast amount of data via cameras and sensors while better analyzing a car's physical surroundings12. It will also be used on the brand's Robotaxi service, which has been delayed3. If successful, Dojo will become more effective than any human or other AI system can be, which will propel Tesla beyond any autonomous driving technology on the market sooner than later24.
AI is only as powerful as the data it's fed. Currently, Tesla's self-driving program requires that petabytes of data (equating to 1 million gigabytes) be stored each day1. This is because of the high-def videos that are captured by a car's cameras to all the sensor data gathered2. All of this data comes together so that Tesla can enable its cars to make instant decisions in the form of braking, accelerating, and swerving. The more data, the better Tesla's current AI infrastructure be to keep everyone safe3.
By designing Dojo to focus on Tesla's unique challenges, Musk believes that it will help the development of the self-driving industry by leaps and bounds. The stronger AI can become for Tesla's purposes, the more efficiently it can send autonomous vehicles out into the world4. What's even more exciting for proponents of Dojo, its framework may not just be limited to Tesla. Musk is considering making it an important part of the entire AI landscape. He's hoping that he can help propel advancements in healthcare, robotics, and several other industries. All of a sudden, Musk just may be as much an AI leader as he is an electric car innovator5.
As we all know, supercomputers aren't a new development. They've been used for years (decades, to be precise), but what makes Dojo different is its focus on AI training models. It will employ neural networks while making AI much faster and more scalable1. The majority of supercomputers have been created to deal with a wide range of tasks, but Dojo will focus solely on AI training2. Dojo will work to accommodate neural work training at a large scale, so Tesla cars will be able to process data more efficiently3. Tesla will also be able to build extremely complex models that will make cars safer and more reliable4. Musk is also suggesting that Dojo will be aggressively developed to outpace all other current and future systems that will handle training AI models5. Put simply, Dojo was conceived to be the most powerful AI training supercomputer the world knows6. The other key difference between Dojo and other supercomputers is that following his focus on Tesla, it will be able to do wonders for numerous use cases, as mentioned above7.
Musk's vision could parallel Amazon Web Services (AWS) and the way it has revolutionized the world of cloud computing. Potentially, Dojo could provide a similar model where other companies can build on it and house their AI models1. Not only will Dojo potentially save organizations time and money, it will also offer a faster and more scalable training for all2. For example, say a health organization wants to use Dojo to streamline its capabilities in one or more ways, they can simply plug into Dojo and build their AI models, which can then quickly evolve and thrive with the support they need3. Just as Musk made all of Tesla's technologies open source, he will democratize the world of AI models24.
It's safe to say that building an AI supercomputer is a massive feat. One challenge is the technical complexity that comes with building this scale of a computer that can train AI models. From the hardware required to the way the software is integrated, everything will have to be extremely carefully designed and pushed to market. This appears to be a perfect task for Musk, as SpaceX is a perfect example of his ability to source parts and technologies that are far more effective and less expensive than his competition. Also, when you consider the energy required, supercomputers take A TON of electricity to run. It will be fascinating to see how Musk gets around this and finds new ways of dealing with energy-related challenges. And finally, there's a super important question to ask: Can Dojo live up to Musk's desire for perfect technologies? Tesla has continually been able to surpass anyone's expectations in its ability to release paradigm-changing technologies, but in this case, there is a lot to prove.
Dojo has already been in development since 2021, so we can expect to see things progress pretty quickly. The first stage is going to be seeing it effectively handling Tesla's fleet of vehicles, then the technology will most likely be available to the world shortly thereafter.12
But we must mention as we report on this, there has been a bit of a strange development, which isn't out of the ordinary for a Musk product release. Elon reported that his company xAI has also been developing a supercomputer. In fact, within 122 days he has built a supercomputer that he's coined Colossus. To accomplish the feat, he bought 100k of Nvidia's GPUs in just four months and installed them. This $3+ billion investment is expected to double within the next few months as he doubles the amount of GPU for this second project. This has left many tech buffs and Tesla shareholders speechless, as they were under the impression that Dojo was the pure focus where AI and Musk were concerned. Could it be that Dojo's conception will not move beyond the realm of cars? Also, could it be that Musk took his learnings from building Dojo to his new project and he's giving the bird to Tesla?34
After being questioned about the status of Dojo in the face of Colossus, Musk has doubled down on his commitment to Dojo, saying that the world will see amazing things from its pending release.1 Critics of Musk and the project are questioning his commitment and even feel like he's diverted what could have been used for Dojo away from the project.2 He is doing everything he can to assuage their criticism and fears by going on the record with an updated timeline for a release, saying that Dojo 2 will be released at the end of next year, and even a third generation will be ready by 2026.13 More to come on this project in the coming days!