There was a wild article that inaccurately overestimated the context of the for the code interpreter fine tune a while back, it’s still 8k like the base model and not the wild 100k like it presented.<p>I implemented a version of it while I was waiting for openai to roll it out to me with pyodide and it worked well. Got it to re-encode videos right in the browser with a bit of tweaking of the langchain plugins prompt. When I did get it, it was a very nice breath of productivity though their interface could be better for many things beyond that. But their fine tune was better for sure than the API + system prompting.<p>With Meta supposedly releasing their new model soon, I think anyone who cares about control over their language calculator and not having to be predictably and incessantly lectured by some moralizing RLHF should try to contribute to the community and build out the infrastructure, fine tunes and tools instead of just relying on an org who wanted their moat so badly that they decided to fear monger and confuse the public.