TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Data Grid as a Service?

2 pointsby thelarryabout 8 years ago
I&#x27;ve been working on a Backend as a Service with a friend of mine but I&#x27;ve noticed that people would rather build their base application and then leverage other services for pieces they don&#x27;t want to build. Search as a Service, Queue as a Service, Log-aggregation as a Service, etc... are very popular. I was wondering if a Data Grid as a service would be an interesting product to anyone. A data grid is an in memory data store that scales fairly well horizontally (there are a few open source solutions) and lets you join multiple &quot;tables&quot; to query seamlessly. The idea is that as you build out your application and system, you have more and more services and data sources. Exposing all of these to the clients quickly is complicated, you can build services that aggregate other services but that can be slow &#x2F; hard to manage. You can shove everything into Redshift, Athena, or bigtable, but those are mostly for data warehouse uses and the querying isn&#x27;t that fast. With a data grid as a service, you pipe your various datas into it via some queue (SQS, Kafka, etc..) or REST calls and then make queries to the data grid directly to retrieve data. It&#x27;s kind of a cacheing layer on top of whatever infrastructure you currently have but allows multiple sources to be merged.<p>Is this a useful product?

2 comments

moondevabout 8 years ago
So kafka with a cassandra consumer? Stream everything to kafka brokers and query cassandra?
评论 #14222441 未加载
eipabout 8 years ago
So like a hosted Hazelcast&#x2F;Ignite&#x2F;Coherence&#x2F;Gemfire?