I'm Varun, CEO of Exafunction, and we just released Codeium to open up access of generative AI to all developers for free. In the spirit of Show HN, we created a playground version for anyone to try this tech in the browser (click Try in Browser)!<p>We have built scalable, low-latency ML infra for many top AI companies in the past, and we are excited to leverage that tech into a product that we, as developers, would love. We hope that you do too, and we would appreciate any feedback that this community has for us!
I'll go ahead and ask the obvious question.. What's the difference with Copilot?<p>In my exactly 3 minutes test, it did worse, even if only slightly.<p>Right now it is free, but that won't last, right? Do i have to expect any shady data collection practices?<p>More interestingly, how is this trained? Have you guys done your own finetuning of gpt3 or it's something completely different?
I am dubious to use this at work since I can’t be sure it won’t send code from the codebase I am working on to the cloud. When something is free you’re usually the product.
> scalable, low-latency ML infra<p>I'm really really curious as to the technical details of getting the inferences cheap and fast enough to enable a copilot like experience when you're not GitHub with inifinity resources.<p>Sam Altman has said that each chat in chatgpt is single digit cents per chat. GPT3 davinci is 0.02 per 1k tokens, not to mention the high latency. it'd be impossible to build "copilot for law" based on gpt3 because the UX wouldnt work with that latency or cost (you'd be running 100s of inferences if you count every debounced keystroke).<p>What cost per user/per inference/per day (however you think about it) do you need to get this down to? and what order of magnitude speedups did you need to accomplish to get this done?<p>(congrats btw, happy user here thanks to Prem)
Been using this for the past couple of weeks and can attest it's been game changer for my productivity. Was skeptical at first, but I find myself less on Google search and more in flow. Thanks for giving it away for free
Cool. Well I guess until there's some community-driven open-source alternative I'll be rooting for y'all against Copilot and CodeWhisperer. Maybe you can pick up some of the Kite talent to join the effort
Has been a huge boost over using Copilot. I accidentally was using Copilot instead of Codeium and was confused why the generations took so long until I realized! Great product
I can't get it to work. Here's what I am getting:<p><pre><code> 2022/12/06 18:55:36 api_server_client.go:120: Completion error: rpc error: code = Unavailable desc = HTTP Logical service in fail-fast
2022-12-06 18:55:36.849 [INFO]: Completion request errored (236.63ms)
2022-12-06 18:55:36.849 [ERROR]: 14 UNAVAILABLE: HTTP Logical service in fail-fast</code></pre>
I briefly tried it and it was indeed very fast, but I couldn't get simple things for python. It would just keep adding import statements or try to continue writing my comment (even though I wanted the code that matches the comment).<p>Also I couldn't find any way to toggle alternative suggestions.