Bloomz.cpp: Run multilingual BLOOM model with C++

This is a big deal, up until now the only reasonable way of using BLOOM was with PETALS or lots of GPUs… great work!

bloomz.cpp allows running inference of BLOOM-like models in pure C&#x2F;C++ (inspired by llama.cpp). It supports all models that can be loaded in transformers for BLOOM.<p>As an example, you can run GPT-4 on your Mac or Pixel! On M1 Pro, you can achieve 16 tokens&#x2F;sec.