Dilemma
Suppose you have cancer and you have to choose between a black box AI surgeon that cannot explain how it works but has a 90% cure rate and a human surgeon with an 80% cure rate. Do you want the AI surgeon to be illegal?
— Geoffrey Hinton (@geoffreyhinton) February 20, 2020
More about the thought in this splendid piece: All boxes are black.