"We are releasing AlpacaFarm, a simulator enabling everyone to run and study the full RLHF pipeline at a fraction of the time (<24h) and cost (<$200) w/ LLM-simulated annotators. Starting w/ Alpaca, we show RLHF gives big 10+% winrate gains vs davinci003 (<a href="http://crfm.stanford.edu/2023/05/22/alpaca-farm.html" rel="nofollow">http://crfm.stanford.edu/2023/05/22/alpaca-farm.html</a>)"