Abstract
Wheat is an important grain in the food chain. It is important in terms of efficiency and economy to use wheat in the appropriate area according to its varieties. Breeding studies make varieties of wheat physically similar to each other and make it difficult to classify according to variety. An image-based deep learning approach is proposed to classify wheat accurately and reduce classification difficulties. Twenty-four varieties of wheat were used in the study and these varieties were harvested in five provinces of Turkey. The reflectance values of the wheat varieties were measured with a near-infrared spectrometer device and the measured reflectance values were used to create wheat images with a suggested method. With this method, low-dimensional images were created with reflection data that take up less space instead of a high-resolution image and a high-storage space requirement. With the classification processes, a 96.55% accuracy was obtained for the hard-white wheat class, 98.70% for the hard-red wheat class and 99.52% for all wheat varieties. The results show that the proposed image generation method with reflection data and the deep learning model is sufficient in classification. This method offers a new approach to the classification of wheat-like cereals. The proposed method can be considered an alternative classification method in the wheat production and trading sectors. It can also be used in the industry by integrating it into hardware with low memory/low processing power. This scenario can also be considered as a method for classifying grain groups other than wheat.
Similar content being viewed by others
Data availability
Raw data were generated at The Center for Intelligent Systems Applications Research's facility (CISAR).
The datasets generated during and/or analysed during the current study are not publicly available due to ongoing works and project support applications but are available from the corresponding author on reasonable request.
To access the data of this article, you can create an access request on GitHub (https://github.com/merveceyhan/wheat-classification) or contact the responsible author via e-mail.
References
Affonso C, Rossi ALD, Vieira FHA et al (2017) Deep learning for biological image classification. Expert Syst Appl 85:114–122. https://doi.org/10.1016/j.eswa.2017.05.039
Ahmad S, Ahmed M (2014) A review on biscuit, a largest consumed processed product in India, its fortification and nutritional improvement. International Journal of Science Inventions Today 3:169–186
Ali A, Zhu Y, Zakarya M (2022) Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction. Neural Netw 145:233–247
Amatya S, Karkee M, Gongal A, Zhang Q, Whiting MD (2016) Detection of cherry tree branches with full foliage in planar architecture for automated sweet-cherry harvesting. Biosys Eng 146:3–15. https://doi.org/10.1016/j.biosystemseng.2015.10.003
Ambati LS, El-Gayar O (2021) Human activity recognition: a comparison of machine learning approaches. Journal of the Midwest Association for Information Systems 2021(1) 49. https://doi.org/10.17705/3jmwa.000065
Blanco M, Villarroya I (2002) NIR spectroscopy: a rapid-response analytical tool. TrAC, Trends Anal Chem 21(4):240–250. https://doi.org/10.1016/s0165-9936(02)00404-1
Bushuk W (1997) Wheat breeding for end-product use. In Wheat: Prospects for Global Improvement (pp. 203–211) Springer
Cassells JA, Reuss R, Osborne BG, Wesley IJ (2007) Near infrared spectroscopic studies of changes in stored grain. J Near Infrared Spectrosc 15(3):161–167. https://doi.org/10.1255/jnirs.727
Curtis BC, Rajaram S, Gomez Macpherson H (2002) Bread wheat/wheat in the world. Food and agriculture organization of the united nations
David E, Madec S, Sadeghi-Tehran P, Aasen H et al (2020) Global wheat head detection (GWHD) Dataset: A large and diverse dataset of high-resolution RGB-labelled images to develop and benchmark wheat head detection methods. Plant Phenomics. https://doi.org/10.34133/2020/3521852
Deleglise H, Interdonato R, Begue A, d’Hotel EM et al (2022) Food security prediction from heterogeneous data combining machine and deep learning methods. Expert Systems with Applications 190:116189. https://doi.org/10.1016/j.eswa.2021.116189
DLP NIRscan Nano [Online] (2017) DLP NIRscan Nano EVM user's guide Available: https://www.ti.com/lit/pdf/dlpu030 Accessed 15 May 2023
Druzhkov PN, Kustikova VD (2016) A survey of deep learning methods and software tools for image classification and object detection. Pattern Recognit Image Anal 26(1):9–15. https://doi.org/10.1134/s1054661816010065
Dziki D, Laskowski J (2005) Wheat kernel physical properties and milling process. Acta Agrophys 6(1):59–71
Ebrahimi MA, Khoshtaghaza MH, Minaei S, Jamshidi B (2017) Vision-based pest detection based on SVM classification method. Comput Electron Agric 137:52–58. https://doi.org/10.1016/j.compag.2017.03.016
Elmasry G, Kamruzzaman M, Sun DW, Allen P (2012) Principles and applications of hyperspectral imaging in quality evaluation of agro-food products: a review. Crit Rev Food Sci Nutr 52(11):999–1023. https://doi.org/10.1080/10408398.2010.543495
Feng Z, Tang T, Wu T, Yu X, Zhang Y, Wang M et al (2021) Perfecting and extending the near-infrared imaging window. Light: Science Applications 10(1) 1–18
Ferentinos K (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009
Helguera M, Abugalieva A, Battenfield S, Bekes F et al (2020) Grain quality in breeding. Wheat quality for improving processing and human health, 308
Ichwana I, Nasution Z, Munawar AA (2020) Near-infrared spectroscopy as a rapid and simultaneous assessment of agricultural groundwater quality parameters. Inmateh-Agricultural Engineering 60(1). https://doi.org/10.35633/inmateh-60-26
Isik S, Ozkan K, Demirez DZ, Seke E (2020) Consensus rule for wheat cultivar classification on VL, VNIR and SWIR imaging. IET Image Processing. https://doi.org/10.1049/ipr2.12206
Islam N, Rashid MM, Wibowo S, Xu CY et al (2021) Early weed detection using image processing and machine learning techniques in an australian chilli farm. Agriculture 11(5):387. https://doi.org/10.3390/agriculture11050387
** X, Sun Y, Che J, Bagavathiannan M et al (2022) A novel deep learning based method for detection of weeds in vegetables. Pest Manag Sci. https://doi.org/10.1002/ps.6804
Karaduman Y, Belen S, Olgun M, Ceyhan M et al (2020) Ulkesel ekmeklı̇k bugday alim baremı̇nde ekmeklı̇k bugday cesitlerı̇nı̇n ayrimi: yapay zeka desteklı̇ oruntu tanima uygulamalarinin kullanılabı̇lı̇rlı̇ğı̇. Research Journal of Biology Sciences 13(2)
Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90
Kujawa S, Niedbala G (2021) Artificial neural networks in agriculture. Multidisciplinary Digital Publishing Institute 11:497
Lingwal S, Bhatia KK, Tomer MS (2021) Image-based wheat grain classification using convolutional neural network. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-020-10174-3
Liu J, Li J (2022) Risk analysis of textile industry foreign investment based on deep learning. Comput Intell Neurosci. https://doi.org/10.1155/2022/3769670
Madhavan J, Salim M, Durairaj U, Kotteeswaran R et al (2021) Wheat seed classification using neural network pattern recognizer. Materials Today: Proceedings. https://doi.org/10.1016/j.matpr.2021.03.226
Mang Xu X, Wei Y, Huang Z, Schwing A et al (2020) Agriculture-vision: a large aerial image database for agricultural pattern analysis. Computer Vision and Pattern Recognition. https://doi.org/10.48550/ar**v.2001.01306
Nematzadeh S, Kiani F, Torkamanian-Afshar M, Aydin N (2022) Tuning hyperparameters of machine learning algorithms and deep neural networks using metaheuristics: A bioinformatics study on biomedical and biological cases. Computational Biology and Chemistry 97:107619. https://doi.org/10.1016/j.compbiolchem.2021.107619
Optics E [Online] (2022) What is SWIR? Available: https://www.edmundoptics.com/knowledge-center/application-notes/imaging/what-is-swir/ Accessed 15 May 2023
Ozkan K, Isik S, Topsakal YB (2019) Identification of wheat kernels by fusion of RGB, SWIR, and VNIR samples. Science of Food and Agriculture. https://doi.org/10.1002/jsfa.9732
Pantazi XE, Moshou D, Oberti R, West J et al (2017) Detection of biotic and abiotic stresses in crops by using hierarchical self organizing classifiers. Precision Agric 18(3):383–393. https://doi.org/10.1007/s11119-017-9507-8
Rahman A, Bayram I, Khanum S, Ullah S (2015) Use and calibration of near infrared reflectance spectroscopy in feed analysis: a mini review. Pakistan Journal of Life and Social Sciences 13(1):1–7
Ramlakhan S, Saatchi R, Sabir L, Singh Y, Hughes R, Shobayo O, Ventour D (2022) Understanding and interpreting artificial intelligence. Machine Learning and Deep Learning in Emergency Medicine 39(5):380–385. https://doi.org/10.1136/emermed-2021-212068
Ramos PJ, Prieto FA, Montoya EC, Oliveros CE (2017) Automatic fruit count on coffee branches using computer vision. Comput Electron Agric 137:9–22. https://doi.org/10.1016/j.compag.2017.03.010
Ridgway C, Chambers J, Cowe IA (1999) Detection of grain weevils inside single wheat kernels by a very near infrared two-wavelength model. J Near Infrared Spectrosc 7(4):213–221. https://doi.org/10.1255/jnirs.251
Rubinger L, Gazendam A, Ekhtiari S, Bhandari M (2022) Machine learning and artificial intelligence in research and healthcare. Injury. https://doi.org/10.1016/j.injury.2022.01.046
Sabanci K, Kayabasi A, Toktas A (2017) Computer vision-based method for classification of wheat grains using artificial neural network. J Sci Food Agric 97(8):2588–2593. https://doi.org/10.1002/jsfa.8080
Sabanci K, Toktas A, Kayabasi A (2017) Grain classifier with computer vision using adaptive neuro-fuzzy inference system. J Sci Food Agric 97(12):3994–4000. https://doi.org/10.1002/jsfa.8264
Saleem MH, Potgieter J, Arif KM (2021) Automation in agriculture by machine and deep learning techniques: a review of recent developments. Precision Agric. https://doi.org/10.1007/s11119-021-09806-x
Selvi MS, Deepa K, Saranya N, Rani SJ (2022) Deep learning in agriculture as a computer vision system. Cyber-Physical Systems and Industry 4.0: Practical Applications Security Management pp. 225–236
Sengupta S, Lee WSJBE (2014) Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions. Biosys Eng 117:51–61
Senthilnath J, Dokania A, Kandukuri M, Ramesh KN, Anand G, Omkar SN (2016) Detection of tomatoes using spectral-spatial methods in remotely sensed RGB images captured by UAV. Biosys Eng 146:16–32. https://doi.org/10.1016/j.biosystemseng.2015.12.003
Sethy PK (2022) Identification of wheat tiller based on AlexNet-feature fusion. Multimedia Tools and Applications 81(6):8309–8316. https://doi.org/10.1007/s11042-022-12286-4
Shamtsyan M, Pasetti M, Beskopylny A (2022) Robotics, machinery and engineering technology for precision agriculture
Shewry PR (2009) Wheat. J Exp Bot 60(6):1537–1553. https://doi.org/10.1093/jxb/erp058
Singh M, Kumar B, Chattopadhyay R, Amarjyothi K et al (2022) Artificial intelligence and machine learning in earth system sciences with special reference to climate science and meteorology in South Asia. Current Science 122(9) 1019. https://doi.org/10.18520/cs/v122/i9/1019-1030
Skovmand B, Rajaram S, Ribaut JM, Hede AR (2002) Bread wheat: improvement and production (9251048096) Rome, Italy
Suprapto PK, Ardiansyah R, Chaidir DM, Baiq B, Meylani V (2022) Deep learning in biology: 3D representation of online and reality. International Journal of Multidisciplinary: Applied Business Education Research 3(4) 571–578–571–578. https://doi.org/10.11594/ijmaber
UCI Machine Learning Repository [Online] (2023) Available: https://archive.ics.uci.edu/ml/datasets.php Accessed 15 May 2023
Urva P (2021) Detection and classification of grain crops and legumes disease: a survey. Sparklinglight Transactions on Artificial Intelligence and Quantum Computing 1(1):41–55. https://doi.org/10.55011/staiqc.2021.11
Texas Instruments DLP® NIRscan™ Nano Evaluation Module (EVM) Optical Design Considerations [Online] (2016) Available: https://www.ti.com/lit/DLPA062 Accessed 15 May 2023
Vincent B, Dardenne P (2021) Application of NIR in agriculture. In Near-Infrared Spectroscopy pp. 331–345
Vinogradov AN, Egorov VV, Kalinin AP, Rodionov AI, Rodionov ID (2017) Hyperspectrometer for the 900–1700 nm near-infrared region. J Opt Technol 84(10):683–687. https://doi.org/10.1364/JOT.84.000683
Visual Geometry Group, University of Oxford [Online] (2023) Available: https://www.robots.ox.ac.uk/~vgg/ Accessed 15 May 2023
Wang C, Liu B, Liu L, Zhu Y, Hou J, Liu P, Li X (2021) A review of deep learning used in the hyperspectral image analysis for agriculture. Artif Intell Rev 54(7):5205–5253. https://doi.org/10.1007/s10462-021-10018-y
**a Y, Tian X, Li J, Fan S, Huang W (2019) Prediction and comparison of models for soluble solids content determination in ‘Ya’ pears using optical properties and diffuse reflectance in 900–1700 nm spectral region. IEEE Access 7:179199–179211. https://doi.org/10.1109/access.2019.2959028
Yang X, Guo M, Lyu Q, Ma M (2021) Detection and classification of damaged wheat kernels based on progressive neural architecture search. Biosys Eng 208:176–185. https://doi.org/10.1016/j.biosystemseng.2021.05.016
Zhang D, Chen G, Zhang H, ** N, Gu C, Weng S et al (2020) Integration of spectroscopy and image for identifying fusarium damage in wheat kernels. Spectrochimica Acta Part A: Molecular Biomolecular Spectroscopy 236:118344. https://doi.org/10.1016/j.saa.2020.118344
Zhang J, Rao Y, Man C, Jiang Z, Li S (2021) Identification of cucumber leaf diseases using deep learning and small sample size for agricultural internet of things. Int J Distrib Sens Netw 17(4):155014772110074. https://doi.org/10.1177/15501477211007407
Acknowledgements
This project was financially supported by TUBITAK: Number 1200226.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have influenced the work reported in this paper.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Ceyhan, M., Kartal, Y., Özkan, K. et al. Classification of wheat varieties with image-based deep learning. Multimed Tools Appl 83, 9597–9619 (2024). https://doi.org/10.1007/s11042-023-16075-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16075-5