> "This effort pushed our infrastructure to operate across more than 16,000 NVIDIA H100 GPUs, making Llama 3.1 405B the first model in the Llama series to be trained at such a massive scale."<p>So at 20k a pop (assuming meta has a decent wholesale price from Nividia) they spent $320 MILLION on the 405B model (not including probably 5-10 million in electricity for the training process, water, staff, infra).<p>Do we think that brings more than 400+ million in value to Meta? I think so. I don't want to do the math, so I'll ask Perplexity to look it up:<p>> "How much has Meta's valuation increased since they released their first open source model"<p>Answer (edited):<p>> Closing price on February 23, 2023: $509.50
> Closing price on October 11, 2024: $573.68
> The increase in stock price is $64.18 per share.
> Total increase = Price increase per share × Number of outstanding shares
> Total increase = $64.18 × 2,534,000,000 = $162,632,100,000
> Meta's stock valuation has increased by approximately $162.63 billion since the release of their first open source model on February 24, 2023.<p>They seem to be making the right choices!