TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: How do you achieve high concurrency with your Python services?

4 pointsby arrayjumperabout 5 years ago
We have a bunch of python services in flask and falcon which we run using gunicorn with sync workers. Most of our services are I&#x2F;O bound. We want to be able to handle bursty loads of upto 50-60 requests per second in each service.<p>We have been using the 2x + 1 thumb rule to decide the number of workers for gunicorn but to achieve the throughput we want with sync workers we&#x27;d need to scale the amount of cpu which leads to inefficient cpu utilization.<p>One option we are trying is gevent but that has its own issues with grpc which we are looking into. What other things do people do for this? AsyncIO? I know there&#x27;s a bunch of new ASGI frameworks that have come up. What has been your experience with these in production?

no comments

no comments