A three-dimensional virtual mouse generates synthetic training data for behavioral analysis
2021; Nature Portfolio; Volume: 18; Issue: 4 Linguagem: Inglês
10.1038/s41592-021-01103-9
ISSN1548-7105
AutoresLuis Bolaños, Dongsheng Xiao, Nancy L. Ford, Jeff M. LeDue, Pankaj Gupta, Carlos Doebeli, Hao Hu, Helge Rhodin, Timothy H. Murphy,
Tópico(s)Cell Image Analysis Techniques
ResumoWe developed a three-dimensional (3D) synthetic animated mouse based on computed tomography scans that is actuated using animation and semirandom, joint-constrained movements to generate synthetic behavioral data with ground-truth label locations. Image-domain translation produced realistic synthetic videos used to train two-dimensional (2D) and 3D pose estimation models with accuracy similar to typical manual training datasets. The outputs from the 3D model-based pose estimation yielded better definition of behavioral clusters than 2D videos and may facilitate automated ethological classification. Bolaños et al. present a realistic three-dimensional virtual mouse model that can be animated and that facilitates the training of pose estimation algorithms.
Referência(s)