Explainable Artificial Intelligence (XAI)

<i>(...) if future warfighters are to understand, appropriately trust, and effectively manage an emerging generation of artificially intelligent machine partners.</i><p>There&#x27;s something eerie about the sound of that.

Seems relevant: <a href="https:&#x2F;&#x2F;www.oreilly.com&#x2F;learning&#x2F;introduction-to-local-interpretable-model-agnostic-explanations-lime?twitter=@bigdata" rel="nofollow">https:&#x2F;&#x2F;www.oreilly.com&#x2F;learning&#x2F;introduction-to-local-inter...</a>

This seems to be closely related to the current development in mathematics &#x2F; computer science regarding automatic proof systems:<p>It is no longer sufficient that the resulting formula or statement is correct. It is also important that the derivation of the result is returned as well, so that correctness can be checked through other means, e.g. humans or different&#x2F;simpler programs.