Read Larry Dignan explain how Google is using a method known as Testing with Concept Activation Vectors to help understand what signals neural networks use for prediction and identify AI bias on ZDNet :
Google CEO Sundar Pichai said the company is working to make its artificial intelligence and machine learning models more transparent as a way to defend against bias. Pichai outlined a bevy of artificial intelligence enhancements and moves to put more machine learning models on devices, but the bigger takeaway for developers and data scientists may be something called TCAV. TCAV is short for Testing with Concept Activation Vectors. In a nutshell, TCAV is an interpretability method to understand what signals your neural network models use for prediction.
Read his full article here.