Meta builds AI Research SuperCluster for future AI and the metaverse

Meta believes that its new AI Research SuperCluster (RSC) will be among the fastest AI supercomputers running in the world once it’s fully built.

The supercomputer is being constructed in phases. In the current phase 1, the RCS already features 6080 Nvidia A100 GPUs, 175 petabytes of bulk storage, 46 petabytes of cache storage and 10 petabytes of network file system storage. Each GPU communicates over a 200 Gb/s HDR Infiniband network.

 

Once it is completed, the RCS will have 16,000 GPUs and a data system that can serve one exabyte of training data per second, reaching 2.5 times the performance of its current state. Meta hopes to reach the final stage in July.

Meta built the RSC to train large AI models in natural language processing (NLP), and to research and train models using trillions of examples. It will also aid in building AI that works across hundreds of different languages, will assist in analyzing media, and in developing augmented reality tools. Moreover, the company says that creating more advanced AI in speech and vision analysis will better identify harmful content.

Looking ahead, Meta wants to leverage the RSC to build entirely new AI models for workloads such as real-time translation, collaboration, and to ultimately help construct a richer metaverse.

Meta says this new system is already 20 times faster than its current Nvidia V100-based clusters in computer vision workflow, and three times faster than its current research clusters in training large-scale NLP models.

In its announcement, the company also spoke about privacy in broad strokes. It explained that the entire data path, from the storage systems to the GPU, is encrypted. All data must go through a privacy review to confirm that it has been correctly anonymized. And because data is only decrypted in memory, even a physical security breach will not leak any information.

Would you recommend this article?

Share

Thanks for taking the time to let us know what you think of this article!
We'd love to hear your opinion about this or any other story you read in our publication. Click this link to send me a note →

Jim Love, Chief Content Officer, IT World Canada
Tom Li
Tom Li
Telecommunication and consumer hardware are Tom's main beats at IT Business. He loves to talk about Canada's network infrastructure, semiconductor products, and of course, anything hot and new in the consumer technology space. You'll also occasionally see his name appended to articles on cloud, security, and SaaS-related news. If you're ever up for a lengthy discussion about the nuances of each of the above sectors or have an upcoming product that people will love, feel free to drop him a line at tli@itwc.ca.

Related Tech News

Get ITBusiness Delivered

Our experienced team of journalists brings you engaging content targeted to IT professionals and line-of-business executives delivered directly to your inbox.