Mark Zuckerberg plans on obtaining 350,000 Nvidia H100 GPUs to assist Meta construct a next-generation AI that possesses human-like intelligence. Zuckerberg discussed the determine nowadays as he introduced his corporate’s long-term effort to expand a man-made basic intelligence (AGI), or an AI that may be informed and be used to accomplish a lot of duties. Meta’s CEO envisions the AGI powering a wave of state-of-the-art products and services and units, equivalent to extra tough virtual assistants and augmented truth glasses. “Construction the most productive AI assistants, AIs for creators, AIs for companies and extra, that wishes advances in each space of AI,” he stated in a video on Instagram.However to get there, Meta goes to want Nvidia’s H100, an endeavor GPU that’s adept at coaching massive language fashions. “We’re development a completely huge quantity of infrastructure to enhance this,” Zuckerberg stated. “Through the tip of this 12 months, we’re going to have round 350,000 Nvidia H100s. Or round 600,000 H100 equivalents of compute in the event you come with different GPUs.”
The 350,000 quantity is staggering, and it’ll additionally price Meta a small fortune to procure. Every H100 can price round $30,000, that means Zuckerberg’s corporate must pay an estimated $10.5 billion simply to shop for the computing energy, to not point out paying all of the electrical energy prices. The remark additionally supplies a glimpse into how a ways the main tech firms will move to expand new AI fashions. Different tech giants, together with Microsoft, Google, and Amazon, additionally most likely purchased between 50,000 to 150,000 Nvidia H100s final 12 months, consistent with analysis company Omdia.
Really helpful via Our Editors
In his Instagram put up, Zuckerberg indicated Meta is already the use of the GPUs to coach Llama 3, the corporate’s resolution to OpenAI’s ChatGPT tech. However Meta’s personal AI fashions received’t stay siloed away within the corporate’s servers. As an alternative, the corporate plans on open-sourcing them, find it irresistible did with Llama 2. “This generation is so necessary and the alternatives are so nice that we must open supply and make it as extensively to be had as we responsibly can,” he added.
Get Our Highest Tales!
Join What is New Now to get our most sensible tales delivered for your inbox each morning.
This text might comprise promoting, offers, or associate hyperlinks. Subscribing to a e-newsletter signifies your consent to our Phrases of Use and Privateness Coverage. Chances are you’ll unsubscribe from the newsletters at any time.
