TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Best tools for real-time API proxying/transformation?

2 pointsby C-Loftus5 months ago
I am a data engineer and do a lot of open source work writing API proxies over scientific APIs to present them as standardized formats [0] with better discoverability. I don&#x27;t have access to the underlying db so I can&#x27;t just create a new API directly.<p>When writing data pipelines for generating data assets, I have really benefited from using a scheduler framework like Dagster. It gives my projects a quick way to get a nice UI and common helpers (cron schedules, asset graphs, partitioned data, concurrency) with relatively little code.<p>However, it doesn&#x27;t seem like an analogous framework exists for real time proxying. (i.e. something with config as code, a nice UI for tracing requests, concurrency&#x2F;caching helpers for dealing with messy transformations). Am I missing anything?<p>[0] https:&#x2F;&#x2F;ogcapi.ogc.org&#x2F;

no comments

no comments