Abstract
This research aimed to classify melon fruit of the cultivar TM-A94 (Cucumis melo var cantalupensis) into marketable, suitable to produce fresh-cut fruit, or storage loss by employing convolutional neural network models. For this purpose, melon fruit were harvested and stored at three different temperatures (1, 4, and 12 °C). Fruit were evaluated for marketability, inner qualities, and taste at harvest and throughout cold storage. Images of all evaluated fruit were acquired, labeled according to the proposed classification, and preprocessed. The proposed models consisted of consecutive basic convolutional modules and different input sizes (224 × 224 × 3, 112 × 112 × 3, and 56 × 56 × 3). Furthermore, SqueezeNet classifier was evaluated using the transfer learning approach. Different learning rates, optimizers, and weight decay levels were tested with the studied models to choose the optimum training settings. Augmentation techniques were used to expand the acquired dataset. fivefold cross-validation was used to validate the models through optimization and training. The final validation accuracies were 90, 90, 86, and 86.33% for the trained SqueezeNet, 224p, 112p, and 56p models, respectively. Confusion matrices showed that SqueezeNet and 224p could detect the marketable class sufficiently, with an F1-score reaching 94.67 and 92.98%, respectively. However, the highest mispredictions among all models were observed between the marketable class and the class suitable to produce fresh-cut. Additionally, the results suggest using high-resolution images (224 × 224 or more) for similar classification tasks in melon fruit.
Similar content being viewed by others
Data availability statement
The datasets used during the current study are not currently publicly available due to ethical and confidentiality reasons related to the registration of the cultivar TM-A94 and other related melon hybrids. However, these datasets can be available in later registration stages by contacting the corresponding author. All the codes and trained models can be downloaded using the following link: https://drive.google.com/file/d/1A7RcCAeAkJDrDDcASLpvr1kTRsZWN-IW/view.
References
Alabboud M, Kalantari S, Soltani F (2020) Analysis of general and specific combining ability of postharvest attributes in Melon. J Agric Sci Technol 22:1523–1535
Beaulieu JC, Lea JM (2007) Quality changes in cantaloupe during growth, maturation, and in stored fresh-cut cubes prepared from fruit harvested at various maturities. J Am Soc Horticult Sci 32. https://doi.org/10.21273/jashs.132.5.720
Boulent J, Foucher S, Théau J, St-Charles PL (2019) Convolutional neural networks for the automatic identification of plant diseases. Front Plant Sci 10:941
Briones A, Ubeda-Iranzo J, Hernndez-Gmez L (2012) Spirits and liqueurs from melon fruits (Cucumis melo L.). In: Distillation—advances from modeling to applications
Chang X, Nie F, Wang S et al (2016) Compound rank-k projections for bilinear analysis. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2015.2441735
FAOSTAT (2019) FAOSTAT: statistical database
Fernández-Trujillo JP, Obando J, Martínez JA et al (2007) Mapping fruit susceptibility to postharvest physiological disorders and decay using a collection of near-isogenic lines of melon. J Am Soc Horticult Sci 132:10. https://doi.org/10.21273/jashs.132.5.739
Fukuta S, Mizukami Y, Ishida A, Kanbe M (2006) Development of loop-mediated isothermal amplification (LAMP)-based SNP markers for shelf-life in melon (Cucumis melo L.). J Appl Genet 47:303–308. https://doi.org/10.1007/BF03194639
Garcia-Mas J, Benjak A, Sanseverino W et al (2012) The genome of melon (Cucumis melo L.). Proc Natl Acad Sci USA 109:11872–11877. https://doi.org/10.1073/pnas.1205415109
Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge
Hassanpour M, Malek H (2019) Document image classification using SqueezeNet convolutional neural network. In: 5th Iranian conference on signal processing and intelligent systems, ICSPIS 2019
Hatami M, Kalantari S, Soltani F, Beaulieu J (2019) Storability, quality changes, and general postharvest behavior of dudaim melon harvested at two maturity stages. Hort Technol 29:10. https://doi.org/10.21273/HORTTECH04057-18
Jahanbakhshi A, Momeny M, Mahmoudi M, Zhang YD (2020) Classification of sour lemons based on apparent defects using stochastic pooling mechanism in deep convolutional neural networks. Sci Hortic. https://doi.org/10.1016/j.scienta.2019.109133
Kamilaris A, Prenafeta-Boldú FX (2018) A review of the use of convolutional neural networks in agriculture. J Agric Sci 156:1–11
Li Z, Nie F, Chang X et al (2018a) Rank-constrained spectral clustering with flexible embedding. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2018.2817538
Li Z, Nie F, Chang X et al (2018b) Dynamic affinity graph construction for spectral clustering using multiple features. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2018.2829867
Li Z, Yao L, Chang X et al (2019) Zero-shot event detection via event-adaptive concept relevance mining. Pattern Recogn. https://doi.org/10.1016/j.patcog.2018.12.010
Li Y, Nie J, Chao X (2020) Do we really need deep CNN for plant diseases identification? Comput Electron Agric. https://doi.org/10.1016/j.compag.2020.105803
Luo M, Chang X, Gong C (2021) Reliable shot identification for complex event detection via visual-semantic embedding. Comput Vis Image Underst. https://doi.org/10.1016/j.cviu.2021.103300
MohiAlden K, Alabboud M, Soltani F, Kalantari S (2021) Developing a postharvest color changes identification system of melon rind using image processing. DYSONA Appl Sci 2:13–20. https://doi.org/10.30493/das.2021.263257
Momeny M, Jahanbakhshi A, Jafarnezhad K, Zhang YD (2020) Accurate classification of cherry fruit using deep CNN based on hybrid pooling approach. Postharvest Biol Technol. https://doi.org/10.1016/j.postharvbio.2020.111204
Moradinezhad F (2020) Quality improvement and shelf life extension of minimally fresh-cut mango fruit using chemical preservatives. J Horticult Postharvest Res 10:13–24. https://doi.org/10.22077/jhpr.2020.3456.1151
Nasiri A, Taheri-Garavand A, Zhang YD (2019) Image-based deep learning automated sorting of date fruit. Postharvest Biol Technol. https://doi.org/10.1016/j.postharvbio.2019.04.003
Nasiri A, Omid M, Taheri-Garavand A (2020) An automatic sorting system for unwashed eggs using deep learning. J Food Eng. https://doi.org/10.1016/j.jfoodeng.2020.110036
Pérez-Pérez BD, García Vázquez JP, Salomón-Torres R (2021) Evaluation of convolutional neural networks’ hyperparameters with transfer learning to determine sorting of ripe medjool dates. Agriculture (Switzerland). https://doi.org/10.3390/agriculture11020115
Ren P, Xiao Y, Chang X et al (2021) A comprehensive survey of neural architecture search: challenges and solutions. ACM Comput Surv 54:1–34
Ren P, Xiao Y, Chang X et al (2022) A survey of deep active learning. ACM Comput Surv. https://doi.org/10.1145/3472291
Santoni MM, Sensuse DI, Arymurthy AM, Fanany MI (2015) Cattle race classification using gray level co-occurrence matrix convolutional neural networks. Proc Comput Sci 59:493–502
Saranya N, Srinivasan K, Kumar SKP (2021) Banana ripeness stage identification: a deep learning approach. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-021-03267-w
Selvam L, Kavitha P (2020) Classification of ladies finger plant leaf using deep learning. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02671-y
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015—conference track proceedings
Srivastava P, Shukla A, Bansal A (2021) A comprehensive review on soil classification using deep learning and computer vision techniques. Multimedia Tools Appl. https://doi.org/10.1007/s11042-021-10544-5
Sustika R, Subekti A, Pardede HF et al (2018) Evaluation of deep convolutional neural network architectures for strawberry quality inspection. Int J Eng Technol. https://doi.org/10.14419/ijet.v7i4.40.24080
Taheri-Garavand A, Nasiri A, Fanourakis D et al (2021) Automated in situ seed variety identification via deep learning: a case study in chickpea. Plants. https://doi.org/10.3390/plants10071406
Tran TT, Choi JW, Le TTH, Kim JW (2019) A comparative study of deep CNN in forecasting and classifying the macronutrient deficiencies on development of tomato plant. Appl Sci (Switzerland). https://doi.org/10.3390/app9081601
Wang Z, Hu M, Zhai G (2018) Application of deep learning architectures for accurate and rapid detection of internal mechanical damage of blueberry using hyperspectral transmittance data. Sensors (Switzerland). https://doi.org/10.3390/s18041126
Wu A, Zhu J, Ren T (2020) Detection of apple defect using laser-induced light backscattering imaging and convolutional neural network. Comput Electr Eng. https://doi.org/10.1016/j.compeleceng.2019.106454
Ye DH, Zikic D, Glocker B, et al (2013) [SqueezeNet] Squeezenet: Alexnet-level accuracy with 50x fewer parameters and <0.5 MB model size. ICLR17 16
Yousuf B, Deshi V, Ozturk B, Siddiqui MW (2019) Fresh-cut fruits and vegetables: quality issues and safety concerns. In: Siddiqui M (ed) Technologies and mechanisms for safety control. Academic Press, Cambridge
Yu E, Sun J, Li J et al (2019) Adaptive semi-supervised feature selection for cross-modal retrieval. IEEE Trans Multimedia. https://doi.org/10.1109/TMM.2018.2877127
Zhang Y, Lian J, Fan M, Zheng Y (2018) Deep indicator for fine-grained classification of banana’s ripening stages. Eurasip J Image Video Process. https://doi.org/10.1186/s13640-018-0284-8
Zhou R, Chang X, Shi L et al (2020) Person reidentification via multi-feature fusion with adaptive graph learning. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2019.2920905
Funding
No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have no competing interests to declare that are relevant to the content of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Alabboud, M., Kalantari, S. & Soltani, F. Novel models to predict stored melon fruit marketability using convolutional neural networks. J Ambient Intell Human Comput 14, 11863–11871 (2023). https://doi.org/10.1007/s12652-022-03741-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-022-03741-z