Nice work! You should look into SimCLR.<p><a href="https://github.com/google-research/simclr" rel="nofollow">https://github.com/google-research/simclr</a><p>I have been recently wondering about the application of self-supervised learning in real-world. I think, your problem fits nicely into this category.