Unsupervised Segmentation of High-Throughput Zebrafish Images Using Deep Neural Networks and Transformers

  • Conference paper
  • First Online:
Data Science and Artificial Intelligence (DSAI 2023)

Abstract

Zebrafish is a popular model system for biomedical analysis, especially for compound screening in drug research. In this paper, we present a comprehensive investigation aimed at enhancing the processing pipeline for segmenting zebrafish larvae images. The emphasis is on the application of an unsupervised segmentation method for segmenting zebrafish in Optical Projection Tomography (OPT) images. We propose a novel pipeline that integrates the Transformer and U-Net, a convolutional neural network for biomedical image segmentation, to achieve accurate segmentation of zebrafish larvae images. This accuracy is critical for precise 3D reconstruction. Leveraging transfer learning, we broaden the capabilities of our trained model to segment OPT images.

This approach is intended to enhance the robustness and versatility of our pipeline, allowing it to cater to a broad range of imaging modalities beyond traditional microscopic images. The developed processing pipeline is then used for 3D reconstruction of the segmented areas, demonstrating its potential for advanced biomedical analysis. Our findings confirm the efficiency and accuracy of the proposed pipeline providing robust tools for future Zebrafish-based research, particularly in the domains of drug screening and cancer treatment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (Brazil)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (Brazil)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (Brazil)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Mishra, Y.K., et al.: Zebrafish (danio rerio) as an ecotoxicological model for nanomaterial induced toxicity profiling. Precision Nanomed. 4(1), 750–782 (2021)

    Google Scholar 

  2. Wei, S., et al.: Perturbing tumor cell metabolism with a Ru (II) photo-redox catalyst to reverse the multidrug resistance of lung cancer. Sci. China Chem. 66(5), 1482–1488 (2023)

    Article  Google Scholar 

  3. Nord, H., Dennhag, N., Muck, J., Hofsten, J.: Pax7 is required for establishment of the xanthophore lineage in zebrafish embryos. Mol. Biol. Cell 27(11), 1853–1862 (2016)

    Article  Google Scholar 

  4. McCluskey, B.M., Postlethwait, J.H.: Phylogeny of zebrafish, a ‘model species’, within danio, a ‘model genus.’ Mol. Biol. Evol. 32(3), 635–652 (2015)

    Article  Google Scholar 

  5. Barbazuk, W.B., et al.: The syntenic relationship of the zebrafish and human genomes. Genome Res. 10(9), 1351–1358 (2000)

    Article  Google Scholar 

  6. Guo, Y., Veneman, W.J., Spaink, H.P., Verbeek, F.J.: Three-dimensional reconstruction and measurements of zebrafish larvae from high-throughput axial-view in vivo imaging. Biomed. Opt. Express 8(5), 2611–2634 (2017)

    Article  Google Scholar 

  7. Phillips, J.B., Westerfield, M.: Zebrafish models in translational research: tip** the scales toward advancements in human health. Dis. Model. Mech. 7(7), 739–743 (2014)

    Article  Google Scholar 

  8. Bradford, Y.M., et al.: Zebrafish models of human disease: gaining insight into human disease at ZFIN. ILAR J. 58(1), 4–16 (2017)

    Article  MathSciNet  Google Scholar 

  9. Liu, K., Petree, C., Requena, T., Varshney, P., Varshney, G.K.: Expanding the CRISPR toolbox in zebrafish for studying development and disease. Frontiers Cell Dev Biol. 7, 13 (2019)

    Article  Google Scholar 

  10. Prykhozhij, S.V., Berman, J.N.: Zebrafish knock-ins swim into the mainstream, Disease Models and Mechanisms, vol. 11, no. 10, p. dmm037515 (2018)

    Google Scholar 

  11. Cagan, R.L., Zon, L.I., White, R.M.: Modeling cancer with flies and fish. Dev. Cell 49(3), 317–324 (2019)

    Article  Google Scholar 

  12. Goessling, W., Sadler, K.C.: Zebrafish: an important tool for liver disease research. Gastroenterology 149(6), 1361–1377 (2015)

    Article  Google Scholar 

  13. Rissone, A., Burgess, S.M.: Rare genetic blood disease modeling in zebrafish. Front. Genet. 9, 348 (2018)

    Article  Google Scholar 

  14. Zhao, Y., Zhang, K., Sips, P., MacRae, C.A.: Screening drugs for myocardial disease in vivo with zebrafish: an expert update. Expert Opin. Drug Discov. 14(4), 343–353 (2019)

    Article  Google Scholar 

  15. Griffin, A., Hamling, K.R., Hong, S., Anvar, M., Lee, L.P., Baraban, S.C.: Preclinical animal models for dravet syndrome: seizure phenotypes, comorbidities and drug screening. Front. Pharmacol. 9, 573 (2018)

    Article  Google Scholar 

  16. Kalueff, A.V., et al.: Towards a comprehensive catalog of zebrafish behavior 1.0 and beyond. Zebrafish 10(1), 70–86 (2013)

    Article  Google Scholar 

  17. Buda, M., Saha, A., Mazurowski, M.A.: Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm. Comput. Biol. Med. 109, 218–225 (2019)

    Article  Google Scholar 

  18. Chen, J., et al.: Transunet: transformers make strong encoders for medical image segmentation. ar**v preprint ar**v:2102.04306 (2021)

  19. Guo, Y., **ong, Z., Verbeek, F.J.: An efficient and robust hybrid method for segmentation of zebrafish objects from bright-field microscope images. Mach. Vis. Appl. 29, 1211–1225 (2018)

    Article  Google Scholar 

  20. Fukushima, H.C.S., et al.: Zebrafish toxicological screening could aid leishmaniosis drug discovery. Lab. Anim. Res. 37(1), 1–11 (2021)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shima Javanmardi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Javanmardi, S., Tang, X., Jahanbanifard, M., Verbeek, F.J. (2023). Unsupervised Segmentation of High-Throughput Zebrafish Images Using Deep Neural Networks and Transformers. In: Anutariya, C., Bonsangue, M.M. (eds) Data Science and Artificial Intelligence. DSAI 2023. Communications in Computer and Information Science, vol 1942. Springer, Singapore. https://doi.org/10.1007/978-981-99-7969-1_16

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-7969-1_16

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-7968-4

  • Online ISBN: 978-981-99-7969-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation