Insurance is moving toward a world in which carriers will not be allowed to make decisions that affect customers based on black-box AI… But beyond the legal requirements for AI transparency, there are also strong market forces pushing insurers in that direction. Insurers need explainable AI to build trust with their customers, who are very wary of its use.