TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: How to evaluate PRs against a dynamic rubric?

1 pointsby sujayk_333 months ago
I&#x27;m working on a use case where every PR created in a repository needs to be evaluated against the topic that will be tagged to it. Based on which the AI feedback is to be given, based on the feedback, changes will need to be made, until done, the merging should be blocked. when the updation of code happens, it should be able to check it against the previously given feedback. Now it can ask for further improvements or give it a green light and unblock the merging.<p>To implement this, I&#x27;m looking for ideas to implement as the LLM shouldn&#x27;t chase perfection and be generalized to make a call &quot;this is enough&quot;.<p>If you have worked on something like this or have any ideas on how to get started, would really appreciate the help.<p>Thanks

no comments

no comments