TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Announcing GenStage

224 点作者 jbernardo95将近 9 年前

10 条评论

hosh将近 9 年前
Yep, I wished I had had access to this back when I was working on something in the Rails side. Ingesting large amounts of data from Shopify across multiple oauth access points while being limited to the PostgreSQL backend and Shopify rate limit restrictions was a pain to setup with Redis and Sidekiq. I ended up forking Sidekiq to accomplish that -- essentially using Sidekiq as a concurrency framework to build in a different set of behavior. Reading through the GenStage document, I could have implemented something better.<p>The way I implemented it (with Ruby) left gaps of idle time, and huge amounts of data gets staged through the queues. I couldn&#x27;t figure out how to make it better. Since I only had a week to come up with something while the infrastructure was melting down, at the time, it was acceptable. Looking at this though, the demand-based backpressure would work very well.<p>There are a couple problems I think I can use this in my current work -- this is great work!
评论 #12096141 未加载
lucidstack将近 9 年前
This looks incredible, congratulations to the Elixir team!<p>Perhaps more exciting than the first part of the post is the second bit about the future. It&#x27;s fantastic to see such a clear path forward for concurrency in Elixir. Definitely looking forward to GenStage.Flow
lpgauth将近 9 年前
Curious, how is the back pressure actually implemented? ACK message or ETS public table?
评论 #12093223 未加载
thibaut_barrere将近 9 年前
I was already diving into Elixir for ETL-based work before discovering GenStage, but now even more. Thanks José et al. for the hard work on this!
rpazyaquian将近 9 年前
I&#x27;m not quite at the point where I can appreciate how useful this is, because I don&#x27;t really understand concurrency itself. What is a good resource from which to learn about concurrency, and especially Elixir&#x2F;Erlang&#x27;s approach to it?
评论 #12095680 未加载
评论 #12095518 未加载
评论 #12095338 未加载
评论 #12096601 未加载
评论 #12096254 未加载
losvedir将近 9 年前
Congrats to the Elixir team.<p>As I understand it GenServer is kind of a wrapper over erlang&#x27;s underlying OTP genserver abstraction. (Is that correct?)<p>What&#x27;s GenStage&#x27;s relationship to erlang? Does erlang have an equivalent?
评论 #12095403 未加载
评论 #12093553 未加载
poorman将近 9 年前
Super excited about GenStage.Flow. Might have to start another Elixir project just to try it out.
Dangeranger将近 9 年前
Could this be used to allow Elixir to load balance a third party server?<p>For example: You have an Elixir load balancer that manages requests for three other servers and distributes load based on the &#x27;demand&#x27; that the consumer communicates back to the balancer?
评论 #12094662 未加载
robbles将近 9 年前
If the back-pressure is abstracted away by this interface, how do you monitor it?
评论 #12094690 未加载
windor将近 9 年前
It&#x27;s definitely worth trying! I have used akka-stream once, and always expect something like that in erlang world. Finally, here it is. Thanks for the Elixir team.