I will say psychometrics has been dealing with this problem for decades (in a testing context) and many of the issues that arise in AI/DL/ML with fairness are isomorphic or identical to problems that have been dealt with in that area for some time. There's a lot of resources and/or lessons that could be drawn on that don't seem to be.