Automated detection of feeding strikes by larval fish using continuous high-speed digital video: A novel method to extract quantitative data from fast, sparse kinematic events

Eyal Shamur, Miri Zilka, Tal Hassner, Victor China, Alex Liberzon, Roi Holzman*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Using videography to extract quantitative data on animal movement and kinematics constitutes a major tool in biomechanics and behavioral ecology. Advanced recording technologies now enable acquisition of long video sequences encompassing sparse and unpredictable events. Although such events may be ecologically important, analysis of sparse data can be extremely time-consuming and potentially biased; data quality is often strongly dependent on the training level of the observer and subject to contamination by observer-dependent biases. These constraints often limit our ability to study animal performance and fitness. Using long videos of foraging fish larvae, we provide a framework for the automated detection of prey acquisition strikes, a behavior that is infrequent yet critical for larval survival.We compared the performance of four video descriptors and their combinations against manually identified feeding events. For our data, the best single descriptor provided a classification accuracy of 77-95% and detection accuracy of 88- 98%, depending on fish species and size. Using a combination of descriptors improved the accuracy of classification by ∼2%, but did not improve detection accuracy. Our results indicate that the effort required by an expert to manually label videos can be greatly reduced to examining only the potential feeding detections in order to filter false detections. Thus, using automated descriptors reduces the amount of manual work needed to identify events of interest from weeks to hours, enabling the assembly of an unbiased large dataset of ecologically relevant behaviors.

Original languageEnglish
Pages (from-to)1608-1617
Number of pages10
JournalJournal of Experimental Biology
Volume219
Issue number11
DOIs
StatePublished - 1 Jun 2016

Funding

FundersFunder number
Seventh Framework Programme
Israel Science Foundation695/15, 158/11
Seventh Framework Programme

    Keywords

    • Automated classification
    • Feeding kinematics
    • High-speed video
    • Machine learning

    Fingerprint

    Dive into the research topics of 'Automated detection of feeding strikes by larval fish using continuous high-speed digital video: A novel method to extract quantitative data from fast, sparse kinematic events'. Together they form a unique fingerprint.

    Cite this