New interactive machine learning tool for marine image analysis

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Dokumenter

  • Fulltext

    Forlagets udgivne version, 3,43 MB, PDF-dokument

  • H. Poppy Clark
  • Smith, Abraham George
  • Daniel McKay Fletcher
  • Ann I. Larsson
  • Marcel Jaspars
  • Laurence H. De Clippele

Advancing imaging technologies are drastically increasing the rate of marine video and image data collection. Often these datasets are not analysed to their full potential as extracting information for multiple species is incredibly time-consuming. This study demonstrates the capability of the open-source interactive machine learning tool, RootPainter, to analyse large marine image datasets quickly and accurately. The ability of RootPainter to extract the presence and surface area of the cold-water coral reef associate sponge species, Mycale lingua, was tested in two datasets: 18 346 time-lapse images and 1420 remotely operated vehicle video frames. New corrective annotation metrics integrated with RootPainter allow objective assessment of when to stop model training and reduce the need for manual model validation. Three highly accurate M. lingua models were created using RootPainter, with an average dice score of 0.94 ± 0.06. Transfer learning aided the production of two of the models, increasing analysis efficiency from 6 to 16 times faster than manual annotation for time-lapse images. Surface area measurements were extracted from both datasets allowing future investigation of sponge behaviours and distributions. Moving forward, interactive machine learning tools and model sharing could dramatically increase image analysis speeds, collaborative research and our understanding of spatiotemporal patterns in biodiversity.

OriginalsprogEngelsk
Artikelnummer231678
TidsskriftRoyal Society Open Science
Vol/bind11
Udgave nummer5
Antal sider23
ISSN2054-5703
DOI
StatusUdgivet - 2024

Bibliografisk note

Funding Information:
H.P.C. is supported by the Biotechnology and Biological Sciences Research Council EASTBIO Doctoral Training Programme (BB/M010996/1). A.G.S. is supported by Novo Nordisk Foundation grant NNF22OC0080177. D.M.F.is supported by the Rural and Environment Science and Analytical Services Division (SRUC-C5-1). L.D.C. received funding from the European Union's Horizon 2020 iAtlantic project (grant agreement no. 818123) and from the ASSEMBLE Plus AmpLOPHELIA project (grant agreement no. 730984). This manuscript reflects the authors' views alone and the European Union cannot be held responsible for any use that may be made of the information contained herein.

Funding Information:
H.P.C. is supported by the Biotechnology and Biological Sciences Research Council EASTBIO Doctoral Training Programme (BB/M010996/1). A.G.S. is supported by Novo Nordisk Foundation grant NNF22OC0080177. D.M.F.is supported by the Rural and Environment Science and Analytical Services Division (SRUC-C5-1). L.D.C. received funding from the European Union\u2019s Horizon 2020 iAtlantic project (grant agreement no. 818123) and from the ASSEMBLE Plus AmpLOPHELIA project (grant agreement no. 730984). This manuscript reflects the authors\u2019 views alone and the European Union cannot be held responsible for any use that may be made of the information contained herein. Acknowledgements

Publisher Copyright:
© 2024 The Authors.

ID: 395154045