ChatGPT and gpt-4o are different things. ChatGPT is an application built around a LLM like gpt-4o. It does some retrieval and has custom prompts, etc. They’re not going charging you by token because some of those tokens are search results and their own prompts, which are out of your control, so it makes sense for them to charge a flat fee.