TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Shrinking the Insurance Data Dump

3 pointsby sl-doltover 2 years ago

1 comment

brendanyoungerover 2 years ago
I've been participating in the data bounties from Dolt and I suggested some of the schema changes on the Discord chat. I do think this is a turning point for dealing with these files. Many 100's of TB gets in to real money, really quick. Just the S3 data charges alone are six figures a year. Not to mention the memory and compute to chew through all of it. If the final data set is more in the 1TB range, this data will get a lot more use. We might even get closer to a real marketplace for healthcare services.