New interactive machine learning tool for marine image analysis

Research output: Contribution to journalJournal articleResearchpeer-review

Documents

  • Fulltext

    Final published version, 3.43 MB, PDF document

  • H. Poppy Clark
  • Smith, Abraham George
  • Daniel McKay Fletcher
  • Ann I. Larsson
  • Marcel Jaspars
  • Laurence H. De Clippele

Advancing imaging technologies are drastically increasing the rate of marine video and image data collection. Often these datasets are not analysed to their full potential as extracting information for multiple species is incredibly time-consuming. This study demonstrates the capability of the open-source interactive machine learning tool, RootPainter, to analyse large marine image datasets quickly and accurately. The ability of RootPainter to extract the presence and surface area of the cold-water coral reef associate sponge species, Mycale lingua, was tested in two datasets: 18 346 time-lapse images and 1420 remotely operated vehicle video frames. New corrective annotation metrics integrated with RootPainter allow objective assessment of when to stop model training and reduce the need for manual model validation. Three highly accurate M. lingua models were created using RootPainter, with an average dice score of 0.94 ± 0.06. Transfer learning aided the production of two of the models, increasing analysis efficiency from 6 to 16 times faster than manual annotation for time-lapse images. Surface area measurements were extracted from both datasets allowing future investigation of sponge behaviours and distributions. Moving forward, interactive machine learning tools and model sharing could dramatically increase image analysis speeds, collaborative research and our understanding of spatiotemporal patterns in biodiversity.

Original languageEnglish
Article number231678
JournalRoyal Society Open Science
Volume11
Issue number5
Number of pages23
ISSN2054-5703
DOIs
Publication statusPublished - 2024

Bibliographical note

Publisher Copyright:
© 2024 The Authors.

    Research areas

  • automated area measurement, benthic ecology, computer vision, interactive machine learning, marine image analysis, RootPainter

ID: 395154045