A site to share LLMs APIs via Tor

In light of upcoming regulations on artificial intelligence (AI), I created neuroengine.ai, a website that shares large language models (LLMs) in the form of chatbots and APIs. The site is accessible through Tor hidden services, allowing users to access state-of-the-art uncensored AIs anonymously. Currently, there are two 65 billion parameter class LLMs and a couple smaller fine-tuned AI models available for free with no API limits, and no registration required.

Unrelated to the actual site — we’ve been testing a tuned version of airoboros-64b on a H100 cluster as a drop in replacement for Claude-100k and GPT4-32k. It’s performing rather well in the generation of text but the 2k context definitely shows, also the reasoning capabilities just as in LLaMA are suboptimal.<p>For instance, obtaining JSON structured data from freetext is a rather impossible task.<p>That said, for summarization of leq 2k token texts the model performs extremely well.<p>This is mostly due to its unfiltered nature, where there would be clear biases visible in models like falcon-40b-instruct or other LLaMA derivatives.

Interesting. Since I&#x27;m behind Tor I will probably pick my own https client for sending json requests, instead of trusting this python client.<p>How will you ban bad actors if there&#x27;s no keys and no registration?

Could you put a license on <a href="https:&#x2F;&#x2F;github.com&#x2F;ortegaalfredo&#x2F;neuroengine&#x2F;blob&#x2F;main&#x2F;neuroengine.py">https:&#x2F;&#x2F;github.com&#x2F;ortegaalfredo&#x2F;neuroengine&#x2F;blob&#x2F;main&#x2F;neuro...</a> ? I&#x27;d love to include it in some code I&#x27;m writing but I can&#x27;t if it doesn&#x27;t have a clear license.

Is API documentation planned? i.e. I should be able to write a client library in Rust without ever looking at Python code.

No only are there ethical and privacy concerns about how we use your data, we&#x27;re also now completely untraceable!