TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Has anyone used AI to diagnose system logs?

13 pointsby sans_souse11 months ago
I did this with the panther file generated by running a trace on android and Gemini advanced seemed impressively capable and able to analyze the large file, and ouput a pretty technical breakdown of everything; pointing out culprit apps (often gApps) that are misfiring and causing latency issues etc. Was curious if anyone else has any experience and or opinions on this

9 comments

ricopags11 months ago
Yes<p><a href="https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;2307.05950" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;2307.05950</a> [pdf]<p><a href="https:&#x2F;&#x2F;www.cncf.io&#x2F;blog&#x2F;2024&#x2F;04&#x2F;12&#x2F;streamlining-logs-with-open-source-local-llms&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.cncf.io&#x2F;blog&#x2F;2024&#x2F;04&#x2F;12&#x2F;streamlining-logs-with-o...</a><p><a href="https:&#x2F;&#x2F;dl.acm.org&#x2F;doi&#x2F;10.1145&#x2F;3597503.3639150" rel="nofollow">https:&#x2F;&#x2F;dl.acm.org&#x2F;doi&#x2F;10.1145&#x2F;3597503.3639150</a>
leros11 months ago
I haven&#x27;t given it massive logs but I&#x27;ve given error logs to ChatGPT and it&#x27;s helped me figure out subtle issues very nicely. Gives me a few ideas of what could be wrong, ways to diagnose them, and even commands to run to test or fix things. I&#x27;ve been shocked how well it works.
rapjr911 months ago
I worked on this project:<p><a href="https:&#x2F;&#x2F;www.cs.dartmouth.edu&#x2F;~dfk&#x2F;research&#x2F;aslam-kerf-news&#x2F;aslam-kerf-news.pdf" rel="nofollow">https:&#x2F;&#x2F;www.cs.dartmouth.edu&#x2F;~dfk&#x2F;research&#x2F;aslam-kerf-news&#x2F;a...</a><p>which had a machine learning component that automatically helped refine syslog SQL queries to find anomolies. More info here:<p><a href="https:&#x2F;&#x2F;www.cs.dartmouth.edu&#x2F;~dfk&#x2F;research&#x2F;project&#x2F;kerf&#x2F;index.html" rel="nofollow">https:&#x2F;&#x2F;www.cs.dartmouth.edu&#x2F;~dfk&#x2F;research&#x2F;project&#x2F;kerf&#x2F;inde...</a><p>Before LLM&#x27;s.
noop_joe11 months ago
The company [0] I work for gave a talk on this [1]. We&#x27;re going a bit beyond analyzing logs because we have more contextual information about running software so we can compare different application state over time and infer whether it appears the application is experiencing an &quot;incident&quot;.<p>0. <a href="https:&#x2F;&#x2F;noop.dev" rel="nofollow">https:&#x2F;&#x2F;noop.dev</a><p>1. <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=PxZx71xfIl8" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=PxZx71xfIl8</a>
throwaway42593311 months ago
My friend (former MSFT principal engineer) is actually developing this idea as a startup. He has a MVP. If interested, I can connect you two. Email in profile.
glitch434711 months ago
I tried a bit, but with not AGI. You can start to think how much would coast each request to your LLM. I stopped on that step.
评论 #40656377 未加载
评论 #40660424 未加载
h2odragon11 months ago
Had a system where logs were watched to trigger various sound samples (bird chirps for firewall probes, etc). There was a pattern recognition component, when the entropy on that came up there was a &quot;hmmmm?&quot; sound.
评论 #40660165 未加载
bradknowles11 months ago
I would never do this with a public AI system. If it’s running entirely on my own resources, that might be an interesting question to ask.
barfbagginus11 months ago
I struggle with dyslexia which makes it very hard to read through logs, so I often troubleshoot error logs, to summarize the logs and break them down by meaning.<p>I wouldn&#x27;t ever do this in an automated way. However in person, it not only makes me solve problems maybe five times faster, but there are also many errors that I would give up on, which I can now solve easily.<p>Just the ability to turn a log into a human readable narrative does something remarkable. After I&#x27;ve done it once or twice, then my brain provides the narrative itself, and I can read the raw log without the need for assistance.<p>This suggests that not only does the AI assist me, but it assists my learning as well.<p>I also struggle with Man pages, in particular finding an option to do something that I need to do. I end up having to read through dozens of options getting more and more confused, sometimes skipping the option that I needed and not finding it. Now I can just dump the entire man page into an llm, describe what I need to do, and ask it to highlight the sections that I need to read. Or I can just ask it questions.