Sampaio et al., Multidimensional social influence drives leadership and composition-dependent success in octopus–fish hunting groups

I was curious about the the 3D reconstruction of the scenes.

> We manually tracked individuals in the videos using the software Computer Vision Annotation Tool. We annotated three frames per second, which yielded a time resolution of 0.33 s for animal movement.

> We then used another software developed to incorporate the previously tracked animals in each camera in the ‘colmap’ habitat models and camera paths, ‘multiviewtracks’ or ‘mvt’ [29]

> [29] Francisco, F. A., Nührenberg, P. & Jordan, A. High-resolution, non-invasive animal tracking and reconstruction of local environment in aquatic ecosystems

Seems it was specifically developed to track fish. Cool project.

Links to https://github.com/matterport/Mask_RCNN and https://github.com/pnuehrenberg/multiviewtracks.