PLOS ONE Medicine&Health

Artificial intelligence-based dairy cattle behavior recognition for estrus detection via ensemble fusion of two camera views

by Panawit Hanpinitsak, Tatpong Katanyukul, Norrawit Tonmitr, Chanon Suntra, Sora-at Tanusilp, Arthit Phuphaphud

Monitoring cattle behavior plays an important role in improving farm productivity, maintaining animal welfare, and supporting efficient management practices. This study presents a multi-view behavior recognition system that uses synchronized top-view and front-view CCTV footage, combined with deep learning techniques. The system includes four main components: cow identification, behavior classification, identity-behavior association using Intersection-over-Union (IoU), and a decision-level ensemble to combine information from both views. YOLOv8 models are applied separately to each camera angle to detect individual cows and classify six key behaviors: drinking, eating, standing, lying, riding, and chin resting, with the latter two being relevant for estrus detection. The system matches cow identities to their behaviors within each view and then integrates the results to produce a final activity label for each cow.