FineBio: A Fine-Grained Video Dataset of Biological Experiments with Hierarchical Annotation

Abstract

We introduce FineBio, a fine-grained video dataset of people performing biological experiments. The dataset contains multi-view videos from 32 participants (14.5 hours total) and provides hierarchical annotations over protocols, steps, atomic operations, object locations, and manipulation states. We report baselines on step segmentation, atomic operation detection, object detection, and manipulated/affected object detection, aiming to advance structured activity understanding and hand–object interaction recognition in laboratory scenarios.