Thank you for making this available!<p>Check out <a href="https://github.com/OpenAdaptAI/OpenAdapt">https://github.com/OpenAdaptAI/OpenAdapt</a> for a cross platform (Mac and Windows) open source library that learns to perform tasks in desktop apps by observing human demonstrations.<p>We believe a major shortcoming with conventional approaches to AI agents is expecting them to be able to figure tasks of arbitrary complexity from first principles. While understandable from an academic perspective, this is unnecessary for practical utility, since humans perform these tasks constantly.<p>With OpenAdapt you can demonstrate to a model how to perform a task, then have it take over the task, with additional user-supplied natural language instructions.<p>I have created an issue to evaluate OpenAdapt on OSWorld: <a href="https://github.com/OpenAdaptAI/OpenAdapt/issues/642">https://github.com/OpenAdaptAI/OpenAdapt/issues/642</a>. Contributions welcome!<p>Edit: from <a href="https://github.com/xlang-ai/OSWorld/tree/main/evaluation_examples">https://github.com/xlang-ai/OSWorld/tree/main/evaluation_exa...</a>:<p>> The ./trajectories file contains the annotated trajectories for each data item in ./examples for finishing the task.<p>Unfortunately this file does not appear to be included in the repo. I have submitted an issue here: <a href="https://github.com/xlang-ai/OSWorld/issues/30">https://github.com/xlang-ai/OSWorld/issues/30</a>