Metadata

Field Value

Title

Detection and tracking of belugas, kayaks and motorized boats in drone video using deep learning

Abstract

Publication general type

journal article

Project Name

[]

Keyword Vocabulary

Polar Data Catalogue

Keyword Vocabulary URL

https://www.polardata.ca/pdcinput/public/keywordlibrary

Theme

Version

1.0

Publisher

Drone Systems and Applications

Date Published

2022

DOI

10.1139/juvs-2021-0024

Authors

Authors 1

Author Name

Harasyn, Madison L.

Type of Name

Personal

Email

madison.harasyn@usask.ca

Affiliation

Centre for Earth Observation Science - University of Manitoba

ORCID ID

https://orcid.org/0000-0002-5741-6766

ORCID

http://orcid.org/

Authors 2

Author Name

Chan, Wayne

Type of Name

Personal

Email

wayne.chan@umanitoba.ca

Affiliation

Centre for Earth Observation Science - University of Manitoba

ORCID ID

Authors 3

Author Name

Ausen, Emma

Type of Name

Personal

Email

ausene@myumanitoba.ca

Affiliation

Centre for Earth Observation Science - University of Manitoba

ORCID ID

Authors 4

Author Name

Barber, David

Type of Name

Personal

Email

david.barber@umanitoba.ca

Affiliation

Centre for Earth Observation Science - University of Manitoba

ORCID ID

0000-0001-9466-3291

ORCID

http://orcid.org/

License Name

Other (Open)

Licence Type

Open

other-open

Licence Schema Name

SPDX

Licence URL

https://spdx.org/licenses

Awards

Related Resources

Language

English

Data and Resources

Field Value

URL

https://cdnsciencepub-com.uml.idm.oclc.org/doi/full/10.1139/juvs-2021-0024

Name

Detection and tracking of belugas, kayaks and motorized boats in drone video using deep learning

Description

Aerial imagery surveys are commonly used in marine mammal research to determine population size, distribution and habitat use. Analysis of aerial photos involves hours of manually identifying individuals present in each image and converting raw counts into useable biological statistics. Our research proposes the use of deep learning algorithms to increase the efficiency of the marine mammal research workflow. To test the feasibility of this proposal, the existing YOLOv4 convolutional neural network model was trained to detect belugas, kayaks and motorized boats in oblique drone imagery, collected from a stationary tethered system. Automated computer-based object detection achieved the following precision and recall, respectively, for each class: beluga = 74%/72%; boat = 97%/99%; and kayak = 96%/96%. We then tested the performance of computer vision tracking of belugas and occupied watercraft in drone videos using the DeepSORT tracking algorithm, which achieved a multiple-object tracking accuracy (MOTA) ranging from 37% to 88% and multiple object tracking precision (MOTP) between 63% and 86%. Results from this research indicate that deep learning technology can detect and track features more consistently than human annotators, allowing for larger datasets to be processed within a fraction of the time while avoiding discrepancies introduced by labeling fatigue or multiple human annotators.

Format

PDF

Resource Category

documents