I haven’t tried Llama 3.1 405B much yet, but I was impressed by the detail and openness of Meta’s paper about it [1]. This interview with Meta’s head of product management for generative AI adds some interesting perspective.<p>[1] <a href="https://arxiv.org/abs/2407.21783" rel="nofollow">https://arxiv.org/abs/2407.21783</a>