{"id":6023,"date":"2022-01-24T17:08:05","date_gmt":"2022-01-24T17:08:05","guid":{"rendered":"https:\/\/mailinvest.blog\/index.php\/2022\/01\/24\/meta-says-its-building-the-worlds-fastest-ai-supercomputer-to-power-metaverse-ambitions\/"},"modified":"2022-01-24T17:08:05","modified_gmt":"2022-01-24T17:08:05","slug":"meta-says-its-building-the-worlds-fastest-ai-supercomputer-to-power-metaverse-ambitions","status":"publish","type":"post","link":"https:\/\/mailinvest.blog\/index.php\/2022\/01\/24\/meta-says-its-building-the-worlds-fastest-ai-supercomputer-to-power-metaverse-ambitions\/","title":{"rendered":"Meta says it’s building the world’s fastest AI supercomputer to power metaverse ambitions"},"content":{"rendered":"

<\/a>\n<\/p>\n

\n

Meta Platforms Inc.<\/a> is well on the way to building what it says will be the world\u2019s fastest artificial intelligence-focused supercomputer to tackle new, advanced workloads involving natural language processing and computer vision.<\/p>\n

The company revealed<\/a> today the AI Research SuperCluster or RSC, though not yet complete, is already up and running and being used to train large AI models with billions of parameters.<\/p>\n

Meta has long been an ambitious player in AI research, and with the launch of its new supercomputer it becomes clear why that is. The company sees AI playing a fundamental role in the advancement of the so-called metaverse, which is a virtual world where Meta believes people will increasingly come together to socialize, work and play.<\/p>\n

\u201cWe hope RSC will help us build entirely new AI systems that can, for example, power real-time voice translations to large groups of people, each speaking a different language, so they can seamlessly collaborate on a research project or play an AR game together,\u201d Meta AI researchers Kevin Lee and Shubho Sengupta wrote in a blog post. \u201cUltimately, the work done with RSC will pave the way toward building technologies for the next major computing platform \u2014 the metaverse, where AI-driven applications and products will play an important role.\u201d<\/p>\n

Meta\u2019s researchers explained that the company has in recent times made big strides in the area of \u201cself-supervised learning,\u201d which is where algorithms learn from vast numbers of unlabeled examples. It has also led advances in \u201ctransformers,\u201d which make it possible for AI to reasons more effectively by focusing on certain areas of their input.<\/p>\n

To realize the full benefits of self-supervised learning and transformer-based models, Meta concluded, it would need to train increasingly more complex and adaptable AI models, meaning it would need to crunch vastly more amounts of data. To develop more advanced computer vision models for instance, requires processing larger and longer videos with higher data sampling rates.<\/p>\n

Meanwhile, speech recognition needs to work in the most challenging scenarios with lots of background noise, and natural language processing must understand different languages, accents and dialects. So Meta decided it needed a much more powerful computer than what\u2019s presently available.<\/p>\n

The RSC is nothing if not powerful, comprising a total of 6,080 of Nvidia Corp.\u2019s latest A100 graphics processing units. Those GPUs are combined into multiple compute nodes that are interconnected with Nvidia\u2019s high-performance Quantum 200 gigabit-per-second InfiniBand networking fabric. RSC also offers 175 petabytes of storage made from Pure Storage Inc.\u2019s FlashArrays, plus 46 petabytes of cache storage from Penguin Computing Inc.\u2019s Altus systems.<\/p>\n

\u201cEarly benchmarks on RSC, compared with Meta\u2019s legacy production and research infrastructure, have shown that it runs computer vision workflows up to 20 times faster, runs the Nvidia Collective Communication Library (NCCL) more than nine times faster, and trains large scale NLP models three times faster,\u201d Meta AI\u2019s researchers said. \u201cThat means a model with tens of billions of parameters can finish training in three weeks, compared with nine weeks before.\u201d<\/p>\n

\"\"<\/p>\n

However, Meta is aiming to make RSC vastly more powerful, with plans to connect a total of 16,000 GPUs by the middle of this year.<\/p>\n

Besides focusing on speed and power, RSC has also been built with security in mind. Meta\u2019s ambitions in AI will necessitate that it uses a lot of \u201creal-world data\u201d from its own production systems, the company explained. So obviously it needs to be very careful to safeguard that information.<\/p>\n

\u201cRSC has been designed from the ground up with privacy and security in mind, so that Meta\u2019s researchers can safely train models using encrypted user-generated data that is not decrypted until right before training,\u201d Lee and Sengupta wrote.<\/p>\n

Those protections include ensuring RSC is isolated from the public internet, with no direct inbound or outbound connections. At the same time, the entire path from Meta\u2019s storage systems to the GPUs is encrypted, with data only being decrypted right before it\u2019s used, at the GPU endpoint, in memory.<\/p>\n

Holger Mueller of Constellation Research Inc. told SiliconANGLE the race to dominate the metaverse is in full swing and that AI will be a key part of it.<\/p>\n

\u201cIt\u2019s no surprise that one of the key players with big ambitions for the metaverse, Meta, is building its first AI supercomputer for research purposes,\u201d Mueller said. \u201cThe metaverse is still at its inception and a lot of research needs to happen for it to really take off, so Meta is taking some key first steps towards doing that.\u201d<\/p>\n

Meta explained that although RSC is up and running now, it will soon become far more powerful. Throughout the rest of the year, its plan is to increase RSC\u2019s GPU count from 6,080 to 16,000, boosting its overall AI training performance by more than 2.5 times its current level<\/p>\n

\u201cWe expect such a step function change in compute capability to enable us not only to create more accurate AI models for our existing services, but also to enable completely new user experiences, especially in the metaverse,\u201d the company explained. \u201cOur long-term investments in self-supervised learning and in building next-generation AI infrastructure with RSC are helping us create the foundational technologies that will power the metaverse and advance the broader AI community as well.\u201d<\/p>\n