TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

A site to share LLMs APIs via Tor

43 pointsby aortegaalmost 2 years ago

6 comments

aortegaalmost 2 years ago
In light of upcoming regulations on artificial intelligence (AI), I created neuroengine.ai, a website that shares large language models (LLMs) in the form of chatbots and APIs. The site is accessible through Tor hidden services, allowing users to access state-of-the-art uncensored AIs anonymously. Currently, there are two 65 billion parameter class LLMs and a couple smaller fine-tuned AI models available for free with no API limits, and no registration required.
评论 #36423855 未加载
19halmost 2 years ago
Unrelated to the actual site — we’ve been testing a tuned version of airoboros-64b on a H100 cluster as a drop in replacement for Claude-100k and GPT4-32k. It’s performing rather well in the generation of text but the 2k context definitely shows, also the reasoning capabilities just as in LLaMA are suboptimal.<p>For instance, obtaining JSON structured data from freetext is a rather impossible task.<p>That said, for summarization of leq 2k token texts the model performs extremely well.<p>This is mostly due to its unfiltered nature, where there would be clear biases visible in models like falcon-40b-instruct or other LLaMA derivatives.
ReactiveJellyalmost 2 years ago
Interesting. Since I&#x27;m behind Tor I will probably pick my own https client for sending json requests, instead of trusting this python client.<p>How will you ban bad actors if there&#x27;s no keys and no registration?
评论 #36424507 未加载
simonwalmost 2 years ago
Could you put a license on <a href="https:&#x2F;&#x2F;github.com&#x2F;ortegaalfredo&#x2F;neuroengine&#x2F;blob&#x2F;main&#x2F;neuroengine.py">https:&#x2F;&#x2F;github.com&#x2F;ortegaalfredo&#x2F;neuroengine&#x2F;blob&#x2F;main&#x2F;neuro...</a> ? I&#x27;d love to include it in some code I&#x27;m writing but I can&#x27;t if it doesn&#x27;t have a clear license.
评论 #36425057 未加载
LoganDarkalmost 2 years ago
Is API documentation planned? i.e. I should be able to write a client library in Rust without ever looking at Python code.
评论 #36427013 未加载
th0ma5almost 2 years ago
No only are there ethical and privacy concerns about how we use your data, we&#x27;re also now completely untraceable!
评论 #36424612 未加载