Artigo Acesso aberto Revisado por pares

A three-dimensional virtual mouse generates synthetic training data for behavioral analysis

2021; Nature Portfolio; Volume: 18; Issue: 4 Linguagem: Inglês

10.1038/s41592-021-01103-9

ISSN

1548-7105

Autores

Luis Bolaños, Dongsheng Xiao, Nancy L. Ford, Jeff M. LeDue, Pankaj Gupta, Carlos Doebeli, Hao Hu, Helge Rhodin, Timothy H. Murphy,

Tópico(s)

Cell Image Analysis Techniques

Resumo

We developed a three-dimensional (3D) synthetic animated mouse based on computed tomography scans that is actuated using animation and semirandom, joint-constrained movements to generate synthetic behavioral data with ground-truth label locations. Image-domain translation produced realistic synthetic videos used to train two-dimensional (2D) and 3D pose estimation models with accuracy similar to typical manual training datasets. The outputs from the 3D model-based pose estimation yielded better definition of behavioral clusters than 2D videos and may facilitate automated ethological classification. Bolaños et al. present a realistic three-dimensional virtual mouse model that can be animated and that facilitates the training of pose estimation algorithms.

Referência(s)