The actual code is in this repo: <a href="https://github.com/microsoft/AzureML-BERT" rel="nofollow">https://github.com/microsoft/AzureML-BERT</a>
Disclosure: I work at Microsoft/Azure on ML<p>Really excited to announce the release of the code we use to train/fine-tune BERT at Azure & Bing. Please let me know if you have any questions!
seems like the scripts have a dependency on pytorch_pretrained_bert library. Is there a way to run the dataprep/create_pretraining.py or train.py scripts on-premise?