TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: I'm working on an easy way to add data to files. Thoughts?

8 pointsby padhoabout 7 years ago

2 comments

mtmailabout 7 years ago
You have extractor and loader classes, I think the industry term at least in data warehousing is a <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Extract,_transform,_load" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Extract,_transform,_load</a> system. Enrichment sounds cool, too.<p>I like it, at least more than Zapier and similar pipelines. We have a couple of clients that use our API (geocoding[1]) to enrich their records inside an ETL. Be prepared that some APIs are rate-limited or quota-based, need API keys or other authentication and might return &#x27;over-quota&#x27; error messages, never mind latency.<p>[1] <a href="https:&#x2F;&#x2F;geocoder.opencagedata.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;geocoder.opencagedata.com&#x2F;</a>
评论 #16536367 未加载
lozzoabout 7 years ago
my thoughts: I was looking for the way you handle exceptions. And found none. For me any enrichment API needs to be designed to handle exceptional case and make it easy to deal with them.<p>Say that during enrichment I might want to do some lookups what if one of them is not working...
评论 #16538579 未加载