Area 3: Animal Communication and Behavior
In this area we collaborate with veterinarians at the Swedish University of Agricultural Sciences (SLU) in developing computer methods to analyze the behavior and motion of four-legged animals in video. The research so far has focused on the detection of pain, lameness and other signs of illness in horses. Recognition of pain in horses and other animals is important, because pain is a manifestation of disease and decreases animal welfare. Horses cannot verbalize their pain as humans can, and being prey animals, they also hide signs of illness in order lower the interest from predators. We investigate different AI approaches to this problem; a data-driven self-supervision approach where horse behavior is analysed from RGB video, and a model-based approach where we collaborate with researchers at the Max Planck Institute for Intelligent Systems in Germany in developing highly detailed 3D models of horse pose, shape and motion.
- Ernest Pokropek (2021-2022)
- Michaela Söderström (MSc 2021)
- Zhenghong Li (MSc 2020)
- Ci Li (MSc 2020)
- Ci Li
- Sofia Broomé (PhD 2022, now at TheraPanacea, France)
Affiliated PhD Students
- Jeanne Parmentier (Utrecht University and University of Twente, Netherlands)
- Maheen Rashid (University of California at Davis, USA, PhD 2021, now at Univrses, Sweden)
- Pia Haubro Andersen (Swedish University of Agricultural Sciences, Sweden)
- Michael Black (Max Planck Institute for Intelligent Systems, Germany)
- Elin Hernlund (Swedish University of Agricultural Sciences, Sweden)
- Silvia Zuffi (IMATI-CNR, Italy)
MARTHA: MARkerless 3D capTure for Horse motion Analysis (KTH, FORMAS 2020-present)
Lameness in horses is a sign of disease or injury, and associated with experiences of pain for the animal. Changed behavior, body pose and motion pattern accompany lameness and many other diseases. Caretakers have difficulties in recognizing early signs of disease, since these signs are subtle and since efficient observation of animals takes resources and time. At the same time, it is crucial to detect these early signs, as the injury that cause them is easy to treat at this early stage, but will potentially be lethal if untreated.
A system for automatic detection of lameness would therefore have a huge positive impact on horse welfare.
The developed method will require data. Firstly, we will record 3D motion capture data and time-correlated video in controlled indoor settings. This data will be used to train and evaluate the developed 3D shape, pose and motion model. Secondly, we will record, as well as leverage previous recordings of, horses with induced lameness or with clinically obtained ground truth lameness diagnoses. This data will be used to train methods for recognition and localization of orthopaedic injuries, and for detection of pain-related behavior.
EquineML: Machine Learning methods for recognition of the pain expressions of horses (VR, FORMAS 2017-2022)
Recognition of pain in horses and other animals is important, because pain is a manifestation of disease and decreases animal welfare. Pain diagnostics for humans typically includes self-evaluation and location of the pain with the help of standardized forms, and labeling of the pain by an clinical expert using pain scales. However, animals cannot verbalize their pain as humans can, and the use of standardized pain scales is challenged by the fact that animals as horses and cattle, being prey animals, display subtle and less obvious pain behavior - it is simply beneficial for a prey animal to appear healthy, in order lower the interest from predators. The aim of this project is to develop methods for automatic recognition of pain in horses, with the help of Computer Vision.