IEEE VIS 2024 Content: Visualizing and Comparing Machine Learning Predictions to Improve Human-AI Teaming on the Example of Cell Lineage

Visualizing and Comparing Machine Learning Predictions to Improve Human-AI Teaming on the Example of Cell Lineage

Jiayi Hong -

Ross Maciejewski -

Alain Trubuil -

Tobias Isenberg -

Screen-reader Accessible PDF

Room: Bayshore V

2024-10-17T13:06:00ZGMT-0600Change your timezone on the schedule page
2024-10-17T13:06:00Z
Exemplar figure, described by caption below
In this paper, we examine the human-AI interaction within the context of plant embryo lineage analysis. To facilitate this investigation, we developed a system called LineageD+, which visualizes predictions from multiple machine learning models. This system aims to assist biologists in reconstructing the development history of plant embryos.
Fast forward
Full Video
Keywords

Visualization, visual analytics, machine learning, comparing ML predictions, human-AI teaming, plant biology, cell lineage

Abstract

We visualize the predictions of multiple machine learning models to help biologists as they interactively make decisions about cell lineage---the development of a (plant) embryo from a single ovum cell. Based on a confocal microscopy dataset, traditionally biologists manually constructed the cell lineage, starting from this observation and reasoning backward in time to establish their inheritance. To speed up this tedious process, we make use of machine learning (ML) models trained on a database of manually established cell lineages to assist the biologist in cell assignment. Most biologists, however, are not familiar with ML, nor is it clear to them which model best predicts the embryo's development. We thus have developed a visualization system that is designed to support biologists in exploring and comparing ML models, checking the model predictions, detecting possible ML model mistakes, and deciding on the most likely embryo development. To evaluate our proposed system, we deployed our interface with six biologists in an observational study. Our results show that the visual representations of machine learning are easily understandable, and our tool, LineageD+, could potentially increase biologists' working efficiency and enhance the understanding of embryos.