There have been other approaches to make instruction tuning easier. This one proceeds largely on self generated synthetic data:<p><a href="https://arxiv.org/abs/2212.10560" rel="nofollow">https://arxiv.org/abs/2212.10560</a>