related: I had an idea to make a CLIP paint.NET image editing plugin. You would make a new layer, add some green ('towards') and red ('away from') splotches to the layer, and give a prompt to CLIP. Wherever there was green, CLIP would 'nudge' the image along the direction of the gradients towards the semantic goal, keep it constant where there was nothing, and nudge it in the opposite direction where there was red. And you could do this over and over again, w/ different CLIP prompts all the while editing the semantic masks as you like. The end result would be a feedback process to use CLIP + feedback as an extremely creative and controllable image manipulation tool. But then I realized that I didn't know how to make a paint.NET plugin :) so here is a free idea for anybody who does