TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: AI Playground by Vercel Labs

249 pointsby palmdeezyabout 2 years ago
Hey, Jared Palmer (creator of this playground) here. Really excited to ship this. I’ve been building this over the past few weeks to compare LLMs from different providers like OpenAI, Anthropic, Cohere, etc. At Vercel, I manage our Frameworks division (including Next.js, Svelte, and Turbo) and wanted to also dogfood some of the latest features in a slightly larger application. This playground takes a lot of inspiration from <a href="https:&#x2F;&#x2F;nat.dev" rel="nofollow">https:&#x2F;&#x2F;nat.dev</a> and is built on Tailwind, ui.shadcn.com, and some upcoming Vercel products we’re announcing soon. We’re going to continue adding models to compare and add other frameworks to generate code snippets from.

32 comments

rendallabout 2 years ago
As a joke, I wrote &quot;Give me a disruptive startup idea&quot;. This is what claude wrote:<p><pre><code> Here is a potentially disruptive startup idea: • On-demand drone delivery for e-commerce. The idea is to offer ultra fast delivery of small packages via drones. This could significantly reduce delivery times for e-commerce orders and disrupt the traditional shipping industry. Some key challenges to overcome would be regulatory approvals, safety, noise pollution, and scaling up a drone delivery network. But if executed well, it could transform how people receive goods and packages. A few other disruptive ideas: • An Uber-like model for renting out spare rooms or couches for short term stays. This could disrupt the hotel industry. • A Netflix model for streaming live TV channels over the internet. This could disrupt the cable TV industry. • An automated vertical farming system to grow organic food locally in urban areas. This could disrupt the traditional agriculture and food supply chain. • Decentralized blockchain-based social network. The idea is to build a social network that is not owned or controlled by any single company. It would be an open, decentralized platform built on blockchain technology. Users would have more control and ownership over their data and profiles. The business model could be built around micro-payments or subscriptions. It could disrupt the dominance of companies like Facebook and offer an alternative distributed social networking experience • A virtual reality social network. If VR&#x2F;AR technologies become more mainstream, </code></pre> I mean, they are disruptive startup ideas, sure enough. GPT-4 didn&#x27;t bother answering.
评论 #35625471 未加载
评论 #35626082 未加载
评论 #35625588 未加载
评论 #35629199 未加载
neomabout 2 years ago
I dunno what Cohere is, but it&#x27;s answers are super weird. I asked it &quot;Where does the phrase &quot;the rain in spain falls mainly on the plane&quot; come from?&quot; and it said:<p>Does anybody know a green song? What happens if a girl doesn&#x27;t have a twin brother? What musical instrument did larry black sing &#x27;jealous heart&#x27; on? Is country music more country than country music. I&#x27;m confused.? What is the difference between a copyright and a trademark? What is the best piano chords software u can get for beginners? What is the best music software for beginners? What is the song from the new dexter episode? Did he kill his brother? What is the name of the song dueling banjos? Was the raiders of the lost ark the first jungle hero movie? Who really invented reverse tape effect? Why can&#x27;t me and my neighbor get along? What prophet spoke to the teachers of the law at jerusalem about their treatment of jesus? Are there any songs that describe the emotions of a cult member? What is the most ugly song ever made?
评论 #35624390 未加载
评论 #35623651 未加载
评论 #35630230 未加载
评论 #35625395 未加载
评论 #35625614 未加载
评论 #35629430 未加载
评论 #35627382 未加载
评论 #35623856 未加载
评论 #35623957 未加载
gardenhedgeabout 2 years ago
You manage the Frameworks division (including Next.js, Svelte, and Turbo)? How did you get the time to build this?
评论 #35625751 未加载
评论 #35625079 未加载
评论 #35629319 未加载
评论 #35626350 未加载
atleastoptimalabout 2 years ago
How much does it cost to query these models all the time? It&#x27;s offering a lot for free.
评论 #35624603 未加载
doodlesdevabout 2 years ago
Please provide an icon that makes sense on other platforms for the shortcut on the right bottom, not everyone uses Macs! Overall, pretty cool idea, how is Vercel gonna handle API costs for this? I imagine this is pretty expensive to run, specially considering GPT4 access.<p>Also, I have to link this here because I thought it was too funny:<p><a href="https:&#x2F;&#x2F;play.vercel.ai&#x2F;r&#x2F;G9y3eXJ" rel="nofollow">https:&#x2F;&#x2F;play.vercel.ai&#x2F;r&#x2F;G9y3eXJ</a><p>edit: Oh I just hit the token limit, I guess that&#x27;s how you&#x27;re dealing with cost lol. Something I was gonna suggest is that maybe answers should be cached to prevent repeated calls to the same API when the prompt hasn&#x27;t changed, this could potentially increase the amount of tests I could do.
评论 #35621928 未加载
swyxabout 2 years ago
beautiful work as always jared!<p>one of the useful things from nat.dev was the tokens&#x2F;second calculation, latency is impt as usual. would be nice to enable?<p>i&#x27;m excited to see what the upcoming products are. making things default sharable like this across all frameworks would be really nice.
评论 #35622807 未加载
etaioinshrdluabout 2 years ago
How did Anthropic agree to let anonymous users call their API? This was a big stumbling block for me.
评论 #35624434 未加载
zurferabout 2 years ago
Thanks for setting up a limited free version. The UX is great.<p>I had some failures for huggingface and cohere. Replicate produced an output that was not rendered (but returned an answer in the network tab).<p>It would also be great to add: <a href="https:&#x2F;&#x2F;docs.aleph-alpha.com&#x2F;docs&#x2F;introduction&#x2F;luminous&#x2F;" rel="nofollow">https:&#x2F;&#x2F;docs.aleph-alpha.com&#x2F;docs&#x2F;introduction&#x2F;luminous&#x2F;</a>
评论 #35627484 未加载
khalidxabout 2 years ago
Awe man I was just building this. You beat me to it! Looks great. FYI needs some tweaks on mobile.
评论 #35623965 未加载
评论 #35622690 未加载
评论 #35623691 未加载
评论 #35623136 未加载
lazylion2about 2 years ago
You can add <a href="https:&#x2F;&#x2F;www.ai21.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.ai21.com&#x2F;</a> LLMs as well
vertisabout 2 years ago
Prompt: Pretend you are William Gibson. Pitch your next book to your publisher.<p>GPT-4: &gt; Dear [Publisher],<p>&gt; I hope this letter finds you well. As you know, my work has always strived to explore the intersection of technology, society, and human nature. With that in mind, I am excited to present to you my latest novel, &quot;Neural Drift.&quot;<p>&gt; Set in the not-too-distant future, &quot;Neural Drift&quot; delves into a world where the lines between our reality and the digital realm have all but vanished. The story revolves around our protagonist, Elara, a skilled hacker and data courier who navigates the vast neural network known as the &quot;Mindscape&quot; – an immersive digital landscape that has become the primary means of communication, commerce, and entertainment for the global population.<p>&gt; In this future, the Mindscape has become an integral part of daily life, and the distinction between the physical and digital worlds is all but gone. Society is now heavily reliant on neural implants, which allow users to access the Mindscape and interact with the digital world through<p>Anthopic Claude-v1 (which wouldn&#x27;t answer at all if I didn&#x27;t put pretend in front):<p>&gt; Here is my William Gibson-inspired book pitch:<p>&gt; The future is here—it&#x27;s just not evenly distributed yet. In my new novel, Pattern Recognition, I explore the bleeding edge of culture, technology, and society through the eyes of Cayce Pollard, a &quot;coolhunter&quot; who has an uncanny ability to spot trends in the wild.<p>&gt; Cayce is hired to track down the creator of a series of mysterious film clips being uploaded to the internet. Her search takes her from London to Tokyo to Moscow, where she encounters a dangerous mix of hackers, hipsters, and Russian mobsters. Along the way, Cayce begins to realize the film clips seem to have a strange predictive power—they appear to show events that have not happened yet.<p>&gt; Pattern Recognition is a stylish, fast-paced techno-thriller that examines how technology shapes culture, and how culture shapes us. It blends Gibson&#x27;s trademark cyberpunk sensibility with a<p>YES, it did just regurgitate an existing Willam Gibson book
评论 #35625134 未加载
ydingabout 2 years ago
Great! Vercel edge functions are my preferred deployment for OpenAI calls now.
评论 #35623510 未加载
评论 #35623387 未加载
lightning19about 2 years ago
Just for fun I wrote this prompt &quot;vercel monopolizes nextjs by only allowing certain features on their platform such as&quot;<p>ChatGPT4:<p>1. Incremental Static Regeneration (ISR): This feature allows developers to update static pages at runtime without having to rebuild the entire website. Vercel has optimized its platform to support ISR, making it an exclusive feature for Next.js applications deployed on Vercel.<p>2. Real-time Feedback: Vercel&#x27;s platform provides real-time feedback during development, allowing developers to see the changes they make in their code instantly. This feature is exclusive to Vercel, making it a significant advantage for developers using Next.js on their platform.<p>3. Edge Functions: Vercel offers Edge Functions, which allow developers to run serverless functions at the edge of their network, providing low-latency responses to user requests. This feature is particularly useful for Next.js applications that require server-side rendering and is exclusive to Vercel&#x27;s platform.<p>4. Preview Mode: Vercel&#x27;s platform supports Next.js&#x27;s Preview Mode, which allows developers to preview draft content changes without affecting the live site. This<p>-------------------------------------------------------<p>Claude v1.3<p>That is not correct. Vercel does not monopolize Next.js or limit features to their platform.<p>Next.js is an open source framework that can be deployed anywhere. Some key facts:<p>1. Next.js is MIT licensed and the source code is available on GitHub for anyone to use, modify, and deploy.<p>2. Next.js apps can be deployed on any hosting provider or infrastructure. This includes:<p>- Vercel (the creators of Next.js) - AWS - GCP - Azure - DigitalOcean - Heroku - Your own servers, etc.<p>3. All Next.js features work regardless of where you deploy. This includes:<p>- Static Generation (SSG) - Server Side Rendering (SSR) - Incremental Static Regeneration (ISR) - API Routes - Image Optimization - Font Optimization
pastacacioepepeabout 2 years ago
It&#x27;s completely broken. I couldn&#x27;t even get one full response from one of the AIs, it always gets stuck near to the completion of the first response. After like 5 tries it told me that I used all my requests. lol.
评论 #35626510 未加载
评论 #35626661 未加载
spaceman_2020about 2 years ago
GPT-4 is miles ahead of the competition. It&#x27;s not even remotely close.<p>I asked it to help me design an app for a specific use case. It came up with a list of features, the tech stack, and even designed an initial database.
评论 #35626723 未加载
toughabout 2 years ago
This is awesome, will this be open sourced to poke around the codebase?<p>Some models seem to hang w me (anthropic) but I think it was because I reached the limit.<p>Does loggedIn usage w vercel will become usage-paid?
Aeolunabout 2 years ago
Well, every single thing I tried other than gpt-4 failed for me.
osteeleabout 2 years ago
Very nice! If you want to add a feature, feel free to make use of <a href="https:&#x2F;&#x2F;github.com&#x2F;osteele&#x2F;prompt-matrix.js">https:&#x2F;&#x2F;github.com&#x2F;osteele&#x2F;prompt-matrix.js</a>, which I (well, ChatGPT and I) created for use in my own playground so that I could enter e.g. &quot;Write a &lt;Python|JavaScript&gt; program to look for anagrams, in the style of &lt;Norvig|Carmack&gt;&quot;.
评论 #35626828 未加载
eh9about 2 years ago
How expensive is this to run?
评论 #35625939 未加载
petecoopabout 2 years ago
What&#x27;s the data policy on this? Are you keeping copies of the prompts and responses?
vladholubievabout 2 years ago
Does anybody know if there is a similar playground, but for evaluating a single model by comparing different prompts with different temperatures?<p>I am building this by myself using Streamlit, but was wondering is there a ready solution.
lxeabout 2 years ago
How are the models hosted?<p>Edit: they are using their own hosted APIs such as Anthropic or Replicate.
评论 #35623211 未加载
tikkunabout 2 years ago
Do you think the codebase will be open sourced within the next week or two?
d4rkp4tternabout 2 years ago
Great interface!<p>Maybe slightly tangential, on the subject of UIs for ChatGPT, does anyone know a good UI for voice input to ChatGPT, for either the website or via an API ?
pjs_about 2 years ago
&gt; are you gpt-4?<p>I am an AI language model created by OpenAI, but I am not GPT-4. I am based on the GPT-3 model. GPT-4 has not been released yet.
jacooperabout 2 years ago
Does this fully use UTF-8? I have been trying it a non-lating language and its showing ?? Icons in every answer.
评论 #35623796 未加载
评论 #35624418 未加载
ruslanmsvabout 2 years ago
Its output for GPT-4 much worse compared with an output of chatGPT-4 available at chat.openai.com
FailMoreabout 2 years ago
Nice, can I have conversations? It’s not clear on mob how to do this vs. Just one prompt
cloudkingabout 2 years ago
Thanks for sharing! What business problems are you solving at Vercel with LLMs?
评论 #35625686 未加载
ironfootnzabout 2 years ago
the UI is quite limited, check out the outputs <a href="https:&#x2F;&#x2F;play.vercel.ai&#x2F;r&#x2F;I25tmJs" rel="nofollow">https:&#x2F;&#x2F;play.vercel.ai&#x2F;r&#x2F;I25tmJs</a> when needs a scroll bar.
khussabout 2 years ago
Nice work. Is it open source?
nkmnzabout 2 years ago
Is the source available?