Annotation-free multi-animal direction estimation using self-supervised learning
https://amadeus.jpmyrmecol.com/ ↗// readme
Annotation-free Multi-Animal Direction Estimation Using Self-supervised learning
AMADEUS is a markerless multi-animal tracking system for laboratory videos. It estimates an oriented bounding box (OBB) and head direction for each animal while maintaining individual identities over time. No manual training annotation or physical marking is required.
After you configure foreground segmentation, AMADEUS extracts single-animal blobs, assigns direction classes using movement direction, and synthesizes interaction images by copy-paste augmentation. A detector trained on these images estimates OBBs and direction classes during crossings and crowding. Staged association and refinement produce individual tracks. When almost complete occlusion is expected, contrastive learning is additionally used for identity verification and correction.
Install and launch
Recommended environment
AMADEUS supports NVIDIA GPUs on Windows and Linux, Apple Silicon on macOS, and AMD GPUs via ROCm on Linux and Windows 11.
For NVIDIA GPUs, 8 GB or more of VRAM is recommended, although the required memory depends on factors such as video resolution and the number of animals. AMADEUS…