This is a great discussion. My teams work on ML and AI led me to be very concerned about the need for bedside computational transparency to allow continued calibration by physicians in the presence of AI. Existing protocols are calibrated routinely by physicians, black box decisions would remover physician calibration in exchage for the AIs processing. The alternative is computationally transparent AI.
This is the present state with physician//nurse calibration:
This is the black box state:
