TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Timeseries data storage in MongoDB

39 点作者 seigenblues将近 14 年前

8 条评论

moe将近 14 年前
Aw, this was physically painful to skim.<p>What you really want for time-series data is a column db such as cassandra (or vertica etc.), perhaps HBase, <i>perhaps</i> a RDBMS, or <i>perhaps</i> a plain old log-file.<p>What you most definitely don't want is Microsoft Access or MongoDB. Thinking about it, MS Access might still work to a degree.
评论 #2803462 未加载
评论 #2803410 未加载
评论 #2804182 未加载
ericHosick将近 14 年前
For a temporal or time based key value store (I think this is kinda what the presentation shows) I used a collection that was something like:<p>Temporal Collection { _id: "X1", data_temporal : [ { time_start: SomeDate, time_stop: SomeDate, _id: "ID2" }, { time_start: SomeDate2, time_stop: SomeDate2, _id: "ID2" }]<p>Data Collection { _id: "ID1", parent: X1, data: { field1: "some info", field2: 34 }, _id: "ID2", parent: X1, data: { field1: "Some info new", field2: 34 } }<p>What is cool about this is that if you have access to the data like ID1, you can easily find out when it was added and how it changed.<p>If you have access to the temporal ID, X1, then at any time you can see what the data looked like.<p>If you need to relate data, the "foreign key" used is the data_temporal ID. In this way, it is possible to ask what your key value store data looked like at any time.<p>But, this could be off from the article.<p>This also works quite well in a relational database.
cstuder将近 14 年前
Being in a similar industry, I share the sentiments of the last couple of slides: Dataloggers are expensive and horrible pieces of hardware. Proprietary solutions with no regard for real-life scenarios (Limited connectivity, power failures, connection failures, weird and inflexible data formats...)<p>I would love to have a look at their Arduino based solution.
iskander将近 14 年前
Are there advantages over storing data in HDF? I've been working with a few hundred gigabytes of financial data this summer and I'm finding that python's data-oriented libraries (h5py, numpy, scipy, matplotlib, scikits.learn) cover my needs.
评论 #2803359 未加载
luigi将近 14 年前
I saw this presentation live at MongoDC and it was awesome.
amalag将近 14 年前
What about Hadoop? You can also use Hadoop as a backend for hadoop style filesystems. What about using Hive? Does it also require a fixed schema?
snowwindwaves将近 14 年前
he needed to find this board for his datalogger <a href="http://www.amazon.com/Webcontrol-Universal-Temperature-Humidity-Controller/dp/B001H4JXLU/ref=wl_it_dp_o?ie=UTF8&#38;coliid=I2CE1S2ZFOUCP6&#38;colid=2RTLJLUX5CSOZ" rel="nofollow">http://www.amazon.com/Webcontrol-Universal-Temperature-Humid...</a>
yannis将近 14 年前
Interesting presentation, would do better with some more details in a blog or pdf.
评论 #2803086 未加载