TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Some notes on Grafana Loki's new "structured metadata"

117 pointsby valyalaabout 2 months ago

7 comments

ohgrabout 2 months ago
Not much I agree with in this article. Seems to be based on little operational experience with the product, particular indicated by a couple of major mistakes and assumptions in the article (compacting does happen, didn&#x27;t read the manual about deployment configurations clearly).<p>Loki has its idiosyncrasies but they are there for a good reason. Anyone who has sat there waiting hours for a Kibana or Splunk query to run to get some information out will know what I&#x27;d referring to. You don&#x27;t dragnet your entire log stream unless your logs are terrible, which needs to be fixed, or you don&#x27;t know when something happened, which needs fixing. I watch many people run queries that scan terabytes of data with gay abandon on a regular basis on older platforms and still never get what they need out.<p>The structured metadata distinction is important because when you do a query against that you are not using an index, just parsed out data. That means explicitly you&#x27;re not filtering, you&#x27;re scanning and that is expensive.<p>If you have a problem with finding things, then it&#x27;s not the logging engine, it&#x27;s the logs!
DeathArrowabout 2 months ago
Did someone use both Grafana Loki and Kibana? Does it have any advantages over Kibana? I am mostly interested in resource usage and versatility of filtering.<p>In Kibana, if something is there I will find it with ease and it doesn&#x27;t take a lot of time to investigate issues in a microservice based application. It is also quite fast.
评论 #43408962 未加载
评论 #43409087 未加载
评论 #43410097 未加载
评论 #43409473 未加载
评论 #43410693 未加载
评论 #43415630 未加载
评论 #43409048 未加载
评论 #43408886 未加载
ptmanabout 2 months ago
@valyala , as others have noted, you are CEO of VictoriaMetrics and have written (most of?) VictoriaLogs. How is VictoriaLogs coming along? This is an older blog post.
评论 #43411311 未加载
评论 #43411811 未加载
jiveturkeyabout 2 months ago
(2024)<p>important because the title includes _new_
kbouckabout 2 months ago
It&#x27;s also not ideal to have a different query language for different Grafana datastores (LogQL, PromQL, TraceQL). Are there any plans on making a unified Grafana query language?
评论 #43410127 未加载
评论 #43411500 未加载
评论 #43409138 未加载
slekkerabout 2 months ago
A disclaimer is that OP is CEO of another company in the same sector
评论 #43409009 未加载
xyz-xabout 2 months ago
Does anyone have experience using Apache Iceberg, Hudi or DeltaLake for storing logs instead of Loki?
评论 #43411801 未加载