ENSEMBLE METHOD BASED ON AVERAGING SHAPES OF OBJECTS USING THE PYRAMID METHOD
DOI:
https://doi.org/10.15588/1607-3274-2024-4-11Keywords:
machine learning; image recognition; neural network; image segmentation, computer visionAbstract
Context. Image segmentation plays a key role in computer vision. The quality of segmentation is affected by many factors: noise, artifacts, complex shapes of objects. Classical methods cannot always guarantee good success, depending on the quality of the image and the existing noise, they cannot always achieve the desired result. The proposed method uses an ensemble of neural networks, which makes it possible to increase the accuracy and stability of segmentation.
Objective. The goal of the work is to develop a new method of combining predictions of neural network ensembles, which can improve segmentation accuracy by combining images of different image sizes.
Method. A method is proposed that averages the shapes of objects depicted on prediction masks. A pyramid of images is used to improve segmentation quality, each level of the pyramid corresponds to an increased size of the original image. This approach allows obtaining image characteristics at different levels. For a test image, a prediction is obtained from each neural network in the ensemble, after which a pyramid is built for the image. All pyramid levels are combined into the final image using SAAMC. All obtained final images for each neural network are also combined at the end using SAAMC. The use of an ensemble of neural networks combined with the pyramid method allows for reducing the impact of noise and artifacts on the segmentation results.
Results. The use of this method was compared with the usual use of individual neural networks and the ensemble averaging method. The obtained results show that the proposed method outperforms its competitors. Application of the proposed method improved the accuracy and quality of segmentation.
Conclusions. The conducted research confirmed the sense of using an ensemble of neural networks and creating a new method of combining predictions. The use of an ensemble of neural networks makes it possible to compensate for the errors and shortcomings of individual neural networks. Using the proposed method can significantly reduce the impact of noise and artifacts on segmentation. Further study and modification of this method will make it possible to further improve the quality of segmentation.
References
Voulodimos A., Doulamis N., Doulamis A., Protopapadakis E. Deep Learning for Computer Vision: A Brief Review, Computational intelligence and neuroscience, 2018, P. 2018:7068349. DOI: 10.1155/2018/7068349
Ronneberger O., Fischer P., Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation, ArXiv, 2015. DOI: 10.1007/978-3-319-24574-4_28
Breiman L. Bagging predictors, Machine Learning, 1996, Vol. 24, No. 2, pp. 123–140. DOI: 10.1007/BF00058655
Freund Y., Schapire R. E. A decision-theoretic generalization of on-line learning and an application to boosting, Journal of Computer and System Sciences, 1997, Vol. 55, No. 1, pp. 119– 139. DOI: 10.1006/jcss.1997.1504
Wolpert D. H. Stacked generalization, Neural Networks. – 1992, Vol. 5, No. 2, pp. 241–259. DOI: 10.1016/S08936080(05)80023-1
Yang Y., Lv H., Chen N. A survey on ensemble learning under the era of deep learning, Artificial Intelligence Review, 2023, Vol. 56, pp. 5545–5589. DOI: 10.1007/s10462-022-10283-5
Du L., Liu H., Zhang L., Lu Y., Li M., Hu Y., Zhang Y. Deep ensemble learning for accurate retinal vessel segmentation, Computers in Biology and Medicine, 2023, Vol. 158, P. 106829. DOI: 10.1016/j.compbiomed.2023.106829
Zheng Y., Li C., Zhou X., Chen H., Xu H., Li Y., Zhang H., Li X., Sun H., Huang X., Grzegorzek M. Application of transfer learning and ensemble learning in image-level classification for breast histopathology, Intelligent Medicine, 2023, Vol. 3, No. 2, pp. 115–128. DOI: 10.1016/j.imed.2022.05.004
Vaiyapuri J., Mahalingam S., Ahmad H. A. M., Abdeljaber E., Yang E., Jeong S. Y. Ensemble learning driven computer-aided diagnosis model for brain tumor classification on magnetic resonance imaging, IEEE Access, 2023, Vol. 11, pp. 91398– 91406. DOI: 10.1109/ACCESS.2023.3306961
Tembhurne J. V., Hebbar N., Patil H. Y. et al. Skin cancer detection using ensemble of machine learning and deep learning techniques, Multimedia Tools and Applications, 2023, Vol. 82, pp. 27501–27524. DOI: 10.1007/s11042-023-14697-3
Al-Zebari A., Ensemble convolutional neural networks and transformer-based segmentation methods for achieving accurate sclera segmentation in eye images, Signal, Image and Video Processing, 2024, Vol. 18, pp. 1879–1891. DOI: 10.1007/s11760-023-02891-7
Iqball T., Wani M. A. Weighted ensemble model for image classification, International Journal of Information Technology, 2023, Vol. 15, pp. 557–564. DOI: 10.1007/s41870-022-01149-8
Mei Y., Fan Y., Zhang Y., Yu J., Zhou Y., Liu D., Fu Y., Huang T., Shi H. Pyramid attention network for image restoration, International Journal of Computer Vision, 2023, Vol. 131, pp. 3207–3225. DOI: 10.1007/s11263-023-01843-5
Zhang B., Wang Y., Ding C., Deng Z., Li L., Qin Z., Ding Z., Bian L., Yang C. Multi-scale feature pyramid fusion network for medical image segmentation, International Journal of Computer Assisted Radiology and Surgery, 2023, Vol. 18, pp. 353– 365. DOI: 10.1007/s11548-022-02738-5
Fang L., Jiang Y., Yan Y., Yue J., Deng Y. Hyperspectral image instance segmentation using spectral-spatial feature pyramid network, IEEE Transactions on Geoscience and Remote Sensing, 2023, Vol. 61, pp. 1–13. DOI: 10.1109/TGRS.2023.3240481
Xie X., Zhang W., Pan X., Xie L., Shao F., Zhao W., An J. CANet: Context aware network with dual-stream pyramid for medical image segmentation, Biomedical Signal Processing and Control, 2023, Vol. 81, P. 104437. DOI: 10.1016/j.bspc.2022.104437
Qin P., Chen J., Zeng J., Chai R., Wang L. Large-scale tissue histopathology image segmentation based on feature pyramid, EURASIP Journal on Image and Video Processing, 2018. DOI: 10.1186/s13640-018-0320-8
Jaeger S., Karargyris A., Candemir S., Folio L., Siegelman J., Callaghan F., Xue Z., Palaniappan K., Singh R. K., Antani S., Thoma G., Wang Y. X., Lu P. X., McDonald C. J. Automatic tuberculosis screening using chest radiographs, IEEE Transactions on Medical Imaging, 2014, Vol. 33, No. 2, pp. 233–245. DOI: 10.1109/TMI.2013.2284099
Candemir S., Jaeger S., Palaniappan K., Musco J. P., Singh R. K., Xue Z., Karargyris A., Antani S., Thoma G., McDonald C. J. Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration, IEEE Transactions on Medical Imaging, 2014, Vol. 33, No. 2, pp. 577–590. DOI: 10.1109/TMI.2013.2290491
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 V. D. Koniukhov
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Licensing Notifications in the Copyright Notices
The journal allows the authors to hold the copyright without restrictions and to retain publishing rights without restrictions.
The journal allows readers to read, download, copy, distribute, print, search, or link to the full texts of its articles.
The journal allows to reuse and remixing of its content, in accordance with a Creative Commons license СС BY -SA.
Authors who publish with this journal agree to the following terms:
-
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License CC BY-SA that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
-
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
-
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
