TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Log File Anomaly Detector

14 点作者 stochastimus超过 5 年前

2 条评论

stochastimus超过 5 年前
Hi! I&#x27;m Larry, founder and CTO at Zebrium. I used to build bespoke machine data analytics platforms for software and appliance vendors. These systems were really useful, but it took a lot of work to make and maintain them. So, I took a couple years to myself to learn, apply, and develop the ML chops I needed to build such a system automatically. That&#x27;s what Zebrium is all about: applying a range of techniques at different scales to achieve near-100% structured log data coverage, with no supervision or pre-structuring, from as little as 100K of real-world log data.<p>Our software builds a catalog of event types and parameters for each of a set of log types (for us, a &quot;stack&quot; corresponds to a set of log types). With this context, it finds &quot;anomalies&quot; through the logs, using a model built on a set of features. These features include simple things like severity and first&#x2F;rare occurrence, and complex things like change in rate&#x2F;periodicity, cross-event-type and cross-stream correlation, NLP topic, and timeseries features. We&#x27;ve trained our model on data from a few dozen stacks, including dozens of real and interesting &quot;anomalies&quot; the operators would have liked to see uncovered.<p>Our software seems to spit out &quot;good stuff&quot; most of the time, and tends not to want to &quot;ring the pager&quot; when nothing breaks. I think it&#x27;s become quite useful - but I&#x27;m biased. :) We want to continue to make it better, so we want to get feedback on what happens when people submit log files with interesting problems that could have been spotted within the logs. Let us know what we get right and wrong.<p>Our SaaS service is in private beta, but anyone can try our log anomaly detection. You can upload up to 5 logs at once (more data and related files improve accuracy) and get a report listing your anomalies, the reasons for the anomalies, and a visualization of the event patterns within your logs. The report is sent to you by email (this is why we ask for your email address). The service is free and you can use it as many times as you want (limit 500MB of logs each use). Please try it (www.zebrium.com&#x2F;anom-detector) and let us know what you think.
bradknowles超过 5 年前
Interesting concept, but I’m not going to trust a tool from an unknown provider with my potentially sensitive data.<p>Give me a tool that I can run locally, and I might be interested.
评论 #20850481 未加载