TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

LLama.cpp now has a web interface

328 pointsby xalalmost 2 years ago

13 comments

mk_stjamesalmost 2 years ago
I&#x27;m always wondering about the, I don&#x27;t even know what to call this, etiquette? of proposing PR&#x27;s to projects like these that add a feature or a demo or whatnot to the main branch of a very focused project by adding something that is very different in interface, language, set and setting etc.<p>So in this case, Tobi made this awesome little web interface that uses minimal HTML and JS as to stay in line with llama.cpp&#x27;s stripped-down-ness. But it is still a completely different mode of operation, it&#x27;s a &#x27;new venue&#x27; essentially.<p>What if GG didn&#x27;t want such a thing? When is something like this better for a separately maintained repo and not a main merge? How do you know when it is OK to submit a PR to add something like this without overstepping (or is it always?)<p>I see this with a few projects on github that really &#x27;blow up&#x27; and everyone starts working on. They get a million PR&#x27;s from people hacking things on it in their domain of knowledge, expanding the complexity (and potentially difficulty to maintain quality). Sometimes it gets weird feeling watching from the outside at least (I&#x27;m not a maintainer on any public FOSS).<p>Just curious what others think because those are my thoughts that came to mind when I saw this.
评论 #36605596 未加载
评论 #36605283 未加载
评论 #36605870 未加载
评论 #36605409 未加载
评论 #36606122 未加载
评论 #36605384 未加载
评论 #36609400 未加载
评论 #36612047 未加载
评论 #36605308 未加载
vdfsalmost 2 years ago
Good to see a CEO is still hacking around!<p>Shopify did change my life in a way i could never imaging, it will always hold a special place in my heart
评论 #36604326 未加载
评论 #36604449 未加载
sterenalmost 2 years ago
And the PR is from Shopify&#x27;s CEO!
评论 #36604073 未加载
mteam88almost 2 years ago
Are these comments about the CEO bots?
评论 #36604924 未加载
评论 #36604516 未加载
评论 #36604297 未加载
评论 #36604371 未加载
评论 #36604476 未加载
isoprophlexalmost 2 years ago
&gt; I tried to match the spirit of llama.cpp and used minimalistic js dependencies and went with the ozempic css style of ggml.ai.<p>Ozempic? The anti-diabetes drug? That&#x27;s either a glorious typo or an interesting new adjective...
评论 #36605543 未加载
评论 #36606147 未加载
ynnivalmost 2 years ago
<p><pre><code> i&#x27;m importing from js cdns instead of adding them here </code></pre> FWIW this seems counter to llama.cpp&#x27;s philosophy.
评论 #36606161 未加载
评论 #36605445 未加载
eclectic29almost 2 years ago
Can someone shed light on how does a CEO with 3 kids get time to hack on something like this? Some might even argue that all the time spent doing this would’ve been better spent on CEO activities, but thankfully this is HN and people have hobbies, so that’s that, but this can be a very time consuming hobby.
评论 #36607229 未加载
sebastiennightalmost 2 years ago
I&#x27;m wondering whether the rendering of markdown through a regex that only deals with H3, strong, em and code is enough, since this implementation specifically seems to ask the bot to reply with markdown?[0]<p>Other than that, it&#x27;s cool to see this web interface happen. It&#x27;s little things like this that make new tools easier to grasp for less technical users.<p>I believe that people are more likely to go through the hurdles of learning difficult setup procedures (knowing the UX&#x2F;UI will be easy to use) versus making the setup easier but having the daily use be too hard.<p>[0]: <a href="https:&#x2F;&#x2F;github.com&#x2F;ggerganov&#x2F;llama.cpp&#x2F;pull&#x2F;1998&#x2F;commits&#x2F;c19daa4eb58cca85c0263d77958370e201bf9551">https:&#x2F;&#x2F;github.com&#x2F;ggerganov&#x2F;llama.cpp&#x2F;pull&#x2F;1998&#x2F;commits&#x2F;c19...</a>
评论 #36610422 未加载
zoklet-enjoyeralmost 2 years ago
Wow. Every comment pointing out the author but not the content
creekcreekalmost 2 years ago
If only all tech CEOs were as code-savvy as the magnificient CEO of Shopify! What a amazing accomplishment from a CEO who cares about development.
wiihackalmost 2 years ago
Nice simple interface! And great to see a CEO keeping up with recent technological developments :)
mlikeralmost 2 years ago
very cool to see the CEO of Shopify putting together this interface.
seydoralmost 2 years ago
didnt people run llamacpp with oobabooga et al?