Portal de Periódicos da CAPES

Building an Open Source Big Data Platform Based on Milis Linux

2021; Springer International Publishing; Linguagem: Inglês

10.1007/978-3-030-79357-9_5

2367-4512

Melih Günay, M. Numan Ince,

IoT and Edge/Fog Computing

With technology, all internet connected devices have become data producers and that lead to exponential growth in data. Data and processing are now increasingly taking place on Cloud while the cost of cloud services are decreasing and the capacity is increasing. This is because the high availability of the servers, their ease of creation, configuration and management. Open source Apache Hadoop and its add-on components are frequently used in cloud systems for the handling Big Data. The installation of the Hadoop infrastructure and its compatibility with other components is only possible through a proper deployment process. The package manager of the operating system in which it is hosted, ensures that the compatible versions of the Big Data frameworks and applications are installed and updated together. At present, global companies that used to produce open source integrated solutions are also purchased, privatized and hence now closed sourced. However, the need of a Linux compatible big data platform based on open source Hadoop framework is still demanded. Therefore, in this paper, the components, the methodology and a case study based on novel big data platform that is high-performing, light-weight, scalable based on Milis Linux is presented.