Hey! My name is Dima, I am from Ukraine and I am the co-founder of Lost Pixel! We built this tool to solve our problems at work and decided to open-source it so more people can build their custom visual regression testing pipelines! If you want to chat about the tool or visual regression testing in general I am super excited to meet like-minded people! Thanks a lot for checking out the product and I hope it will serve you well if you decide to try it out :D
How do you handle "meaningless" visual changes? E.g. chrome version change introduces super-subtle blending changes to drop-shadows, and suddenly there are huge diffs because the least significant bit of a drop-shadow's grey colour changed. What is your approach to that?<p>So far all tools I have used like this suffer from "false positives" like this (it's a true positive technically of course, but likely false from an engineering perspective).
Hi Dima, this looks really good! I see examples for Storybook and Next.js. Would this work with other technologies and configurations? For instance is there a way to point it at an external dev sandbox to capture full page screenshots of an existing site... say a WordPress site or other CMS? I have a use case where I want to test full page screenshots but need the environment that is hosting a copy of the content/database to test against, not just the components used in the pages.
This is very cool! I've found visual regression testing in CI to be one of the highest-value things I can throw into new, long-lived frontend codebase. I've been relying on Chromatic so far, but I'd definitely try out Lost Pixel next time I'm setting up such a project!
I've set up visreg tests in the past and they were always slow and brittle. This looks really modern and well documented system, congrats to the team! Always running them on GitHub actions will keep the sub pixel issues at a minimum, but do you also have configurable thresholds?
The open-source angle aside: How does Lost Pixel compare to Chromatic?<p>It might be nice to add a comparison to your otherwise excellent documentation.