ANALYSIS OF DATA ACCESS APPROACHES IN A MULTI-CLOUD ENVIRONMENT
DOI:
https://doi.org/10.15588/1607-3274-2025-1-16Keywords:
cloud computing, multi-cloud access, cloud-agnostic librariesAbstract
Context. A multi-cloud system is characterized by the sequential or simultaneous use of services from different cloud providers to run applications. Such a system is a preferred infrastructure for the vast majority of IT businesses today. Currently, there are various approaches to combining cloud platforms from multiple vendors. This article explores practical approaches to achieve multi-cloud interoperability, focusing on abstract data access between different cloud storage providers
and multi-cloud computing resource allocation. Key technologies and methodologies for uninterrupted data management are presented, such as the use of multi-cloud storage gateways (using S3Proxy as an example), the implementation of data management platforms (Apache NiFi), and the use of cloud-agnostic libraries (Apache Libcloud). The paper highlights the advantages and disadvantages of the selected approaches and conducts experiments to determine the cost and performance of these strategies. The result of the research is to determine the cost and performance of different approaches to data access in multicloud environments.
Objective. To investigate different approaches to multi-cloud data access and determine the most optimal in terms of cost and performance.
Method. We propose the optimization of multi-cloud infrastructures based on experimental data. Experimental modeling includes empirical measurements of performance and comparison of storage costs. The determination of performance is based
on the measurement of data reading time and latency. The AWS S3 pricing model is used to estimate the cost. Optimization approaches are described, considering file sizes and data storage, combining the strengths of different multi-cloud approaches
and dynamic switching between solutions. An algorithm for selecting multi-cloud approaches is proposed, which takes into account the criteria of cost and performance, as well as their priority.
Results. The experiment yielded values for the cost of storing and downloading data of different sizes (100 GB, 1 TB, 10
TB), and the performance of transferring files of different sizes (100 KB, 1 MB, 10 MB) for multi-cloud gateway technologies, data management platforms, and cloud-agnostic libraries. S3Proxy was found to have the fastest file access for large data volumes, while Apache Libcloud showed better value for smaller volumes. Both approaches significantly outperformed Apache NiFi. This study can contribute to the development of methods for efficient resource management in multi-cloud environments.
Conclusions. The obtained results can assist in prioritizing the selection of these paradigms, aiding organizations in developing and deploying effective multi-cloud strategies. This approach enables them to leverage the distinctive features of each cloud provider while maintaining a unified, flexible, and efficient storage and computing environment.
References
Petcu D. Multi-Cloud: Expectations and Current Approaches, MultiCloud 2013 – Proceedings of the International Workshop on Multi-Cloud Applicationsand Federated Clouds, 2013, pp. 1–6. DOI: 10.1145/2462326.2462328.
Caceres A., Globa L. S. State-of-the-Art Architectures for Interoperability of Heterogeneous Clouds, Telecommunications and Computer Engineering (TCSET): 2022 IEEE 16th International Conference on Advanced Trends in Radioelectronics, Lviv-Slavske, Ukraine, 22–26 February 2022, : proceedings. Los Alamitos, IEEE, 2022, pp. 704–709.
DOI: 10.1109/TCSET55632.2022.9766965.
Ferrera A. J., Pereza D. G., Gonzalez R. S. Multi-Cloud Platform-as-a-Service Model, Functionalities and Approaches, Procedia Computer Science, 2016,
Vol. 97, pp. 63–72.
Goasduff L. Why Organizations Choose a Multicloud Strategy [Electronic resource]. Access mode: https://www.gartner.com/smarterwithgartner/whyorganizations-choose-a-multicloud-strategy.
Flexera 2024 State of the Cloud Report [Electronic resource]. Access mode: https://info.flexera.com/CMREPORT-State-of-the-Cloud.
Kozіna O. A., Panchenko V. І., Risovanij O. M. Arkhitektura promizhnoho prohramnoho zabezpechennya dlya uzhodzhennya danykh v mul’tykhmarinykh systemakh, Vіsnik Nacіonalnogo tehnіchnogo unіversitetu “HPІ”, 2021, No. 2 (6), pp. 101–112.
DOI: 10.20998/2411-0558.2021.02.07.
Imran H. A., Latif U., Ikram A. A. et al. Multi-Cloud: A Comprehensive Review, 2020 IEEE 23rd International Multitopic Conference (INMIC), Bahawalpur, Pakistan, 05–07 November 2020: proceedings. Los Alamitos, IEEE, 2021, pp. 1–5. DOI: 10.1109/INMIC50486.2020.9318176.
Mansour I., Sahandi R. et al. Interoperability in the Heterogeneous Cloud Environment: A Survey of Recent User-Centric Approaches, ICC ‘16: Proceedings of the International Conference on Internet of things and Cloud Computing, Cambridge, United Kingdom, 22–23
March 2016: proceedings. New York, NY, USA: Association for Computing Machinery, pp. 1–7. DOI: 10.1145/2896387.2896447.
Adhoni Z. A., Dayanand Lal N. et al. Framework Semantic and Standard Approaches in Multi-clouds to Achieve Interoperability: A Survey, Journal of Integrated Science and Technology, 2022, Vol. 10, No. 2, pp. 67–72.
Sheldon R. Cloud Data Management Interface (CDMI) [Electronic resource]. Access mode:
https://www.techtarget.com/searchstorage/definition/Clo ud-Data-Management-Interface.
What is Open Cloud Computing Interface (OCCI) [Electronic resource]. Access mode:
https://www.analyticssteps.com/blogs/what-open-cloudcomputing-interface-occi.
Bennett S. Cloud Storage Gateway Vendors: 7 Top Solutions [Electronic resource]. Access mode: https://www.resilio.com/blog/cloud-storage-gatewayvendors.
Hüllmann J. A., Sivakumar A., Krebber S. et al. Data Management Platforms: An Empirical Taxonomy, 34th Bled eConference, Bled, Slovenia, 27–30 June 2021: proceedings. Available at:
https://aisel.aisnet.org/bled2021/9.
Meireles F., Malheiro B. et al. Integrated Management of IaaS Resources, European Conference on Parallel Processing. Euro-Par 2014: Parallel Processing Workshops, 2014. Cham, Springer, 2014, pp. 73–84. DOI: 10.1007/978-3-319-14313-2_7.
Malinina J. Cloud Agnostic – an Approach You Might Want to Avoid [Electronic resource]. Access mode: https://medium.com/coderbyte/cloud-agnosticism-andits-hidden-cost-4d3ed6d963f.
Parker E. S3 File Gateway for Efficient, Multi-Cloud File Access [Electronic resource]. Access mode: https://www.resilio.com/blog/s3-file-gateway.
Yousry A. Data Management: A Guide to Apache NiFi [Electronic resource]. Access mode:
https://medium.com/@ansam.yousry/data-managementa-guide-to-apache-nifi-21a29ecc4591.
Apache Libcloud [Electronic resource]. Access mode: https://libcloud.apache.org/.
Interoperability and Portability for Cloud Computing: A guide [Electronic resource]. Access mode: https://www.omg.org/cloud/deliverables/CSCCInteroperability-and-Portability-for-Cloud-ComputingA-Guide.pdf.
AWS Pricing [Electronic resource]. Access mode: https://aws.amazon.com/ru/pricing/?aws-productspricing.sortby=item.additionalFields.productNameLowercase&aws
-products-pricing.sortorder=asc&awsf.Free%20Tier%20Type=*all&awsf.techcategory=*all.
Docker Image for S3-Proxy. Reverse proxy for AWS S3 with basic authentication [Electronic resource]. Access mode: https://hub.docker.com/r/pottava/s3-proxy.
Caceres A. Link to GitHub repository with experiment s3Proxy [Electronic resource]. Access mode:https://github.com/MA3STR0/multicloud_experiments/tree/master/multicloud_storage/s3proxy.
Docker Image for Apache NiFi. Apache NiFi unofficial binary build [Electronic resource]. Access mode: https://hub.docker.com/r/apache/nifi.
Caceres A. Link to GitHub repository with experiment Apache NiFi [Electronic resource]. Access mode: https://github.com/MA3STR0/multicloud_experiments/tree/master/multicloud_storage/apache_nifi.
Repository Apache Libcloud [Electronic resource]. Access mode: https://github.com/apache/libcloud.
Caceres A. Link to GitHub repository with experiment Libcloude [Electronic resource]. Access mode: https://github.com/MA3STR0/multicloud_experiments/tree/master/multicloud_storage/libcloud.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 А. Caceres , L. Globa
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Licensing Notifications in the Copyright Notices
The journal allows the authors to hold the copyright without restrictions and to retain publishing rights without restrictions.
The journal allows readers to read, download, copy, distribute, print, search, or link to the full texts of its articles.
The journal allows to reuse and remixing of its content, in accordance with a Creative Commons license СС BY -SA.
Authors who publish with this journal agree to the following terms:
-
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License CC BY-SA that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
-
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
-
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
