AI is learning when it should and shouldnt defer to a human – MIT Technology Review

The context: Studies show that when people and AI systems work together, they can outperform either one acting alone. Medical diagnostic systems are often checked over by human doctors, and content moderation systems filter what they can before requiring human assistance. But algorithms are rarely designed to optimize for this AI-to-human handover. If they were, the AI system would only defer to its human counterpart if the person could actually make a better decision.

The research: Researchers at MITs Computer Science and AI Laboratory (CSAIL) have now developed an AI system to do this kind of optimization based on strengths and weaknesses of the human collaborator. It uses two separate machine-learning models; one makes the actual decision, whether thats diagnosing a patient or removing a social media post, and one predicts whether the AI or human is the better decision maker.

The latter model, which the researchers call the rejector, iteratively improves its predictions based on each decision makers track record over time. It can also take into account factors beyond performance, including a persons time constraints or a doctors access to sensitive patient information not available to the AI system.

Read the original here:
AI is learning when it should and shouldnt defer to a human - MIT Technology Review

Related Post

Comments are closed.