Navraj Chohan, Chris Bunch, Chandra Krintz, Navyasri Canumalla,
... this layer into the AppScale cloud platform—an open-source cloud platform that executes cloud applications written in Python, Java, and Go, over virtualized cluster resources and infrastructures-as-a-service (Eucalyptus, OpenStack, and ...
Tópico(s): Advanced Data Storage Technologies
2012 - Springer Science+Business Media | Journal of Grid Computing
Anupama Mampage, Shanika Karunasekera, Rajkumar Buyya,
... model in a practical setting incorporating Kubeless, an open-source serverless framework, deployed on a 23-node Kubernetes cluster setup. Extensive experiments done on this testbed environment show promising results with improvements of up to 24% and 34% in terms of application response time and resource usage cost respectively, compared to baseline techniques.
Tópico(s): Data Stream Mining Techniques
2023 - Elsevier BV | Future Generation Computer Systems
Mahmood Mortazavi-Dehkordi, Kamran Zamanifar,
... a profound impact on how data are analyzed. Open source distributed stream processing platforms have gained popularity for analyzing streaming Big Data as they provide low latency required for streaming Big Data applications using cluster resources. However, existi ng resource schedulers are still lacking ...
Tópico(s): Distributed and Parallel Computing Systems
2019 - IOS Press | Intelligent Data Analysis
Khadija Aziz, Dounia Zaidouni, Mostafa Bellafkih,
Apache Spark is one of the most widely used open source processing framework for big data, it allows to process large datasets in parallel using a large number of nodes. Often, applications of this framework use resource management systems like YARN, which provide jobs a specific amount of resources for their execution. In addition, a distributed file system such as HDFS stores the data that is to be analyzed by the framework. This design allows sharing cluster resources effectively by running jobs ...
Tópico(s): IoT and Edge/Fog Computing
2019 - Springer Science+Business Media | Journal Of Big Data
... computing here uses LINUX operating System and OSCAR (Open Source Cluster Application Resources) & MPICH (Implementation of MPI, the Standard for the ...
Tópico(s): Cloud Computing and
2012 - International Organization Of Scientific Research (IOSR) | IOSR Journal of Computer Engineering
J. Kim, B Kim, IN SUNG YIM, Chang Hyun Baek, HYUN WOONG NAM, Dongsu Ryu, Young Woon Kang,
... was installed and has been managed with the Open Source Cluster Application Resource (OSCAR) framework. Its performance for parallel computations was ...
Tópico(s): Astronomy and Astrophysical Research
2004 - | Publications of The Korean Astronomical Society
... on different computers, which is very fussy. OSCAR (open source cluster application resource), which is one of the most favorite packages ...
Tópico(s): Advanced Computational Techniques and
2004 - China Aerospace Science and Industry Group | Jisuanji gongcheng yu sheji
Murali Padmanabha, Stefan Streif,
... of modular units performing specific functions. A sensor cluster for measuring gas concentrations, air properties (temperature, humidity, pressure), and growing medium properties was implemented and tested. Actuators for resource exchange, air conditioning, and light spectrum adjustment are proposed. A three-tier hierarchical software framework consisting of open-source cloud platform for data aggregation and user interaction; microcontroller firmware; and an application development framework for test automation and experiment regime ...
Tópico(s): Smart Agriculture and AI
2019 - Multidisciplinary Digital Publishing Institute | Applied Sciences
Rajashekhar M. Arasanal, Daanish U. Rumani,
MapReduce has emerged as an important programming model with clusters having tens of thousands of nodes. Hadoop, an open source implementation of MapReduce may contain various nodes which are heterogeneous in their computing capacity for various reasons. It is important for the data placement algorithms to partition the input and intermediate data based on the computing capacities of the nodes in the cluster. We propose several enhancements to data placing algorithms in Hadoop such that the load ...
Tópico(s): Advanced Database Systems and Queries
2013 - Springer Science+Business Media | Lecture notes in computer science
N. Melab, S. Cahon, E.-G. Talbi,
... The latter is an extension of ParadisEO, an open source framework originally intended to the design and deployment of parallel hybrid meta-heuristics on dedicated clusters and networks of workstations. Relying on the Condor–MW framework, it enables the execution of these applications on volatile heterogeneous computational pools of resources. The motivations, architecture and main features will be ...
Tópico(s): Metaheuristic Optimization Algorithms Research
2006 - Elsevier BV | Journal of Parallel and Distributed Computing
Andrea Detti, Ludovico Funari, Luca Petrucci,
$\mu$ Bench is an open-source tool for benchmarking cloud/edge computing platforms that run microservice applications. The tool creates dummy microservice applications that can be customized and executed on a Kubernetes cluster. $\mu$ Bench allows users to control fundamental properties of the microservice applications it creates, such as service mesh topology, microservices’ behaviors using a portfolio of stress functions (e.g., for CPU, memory, I/O, network) or implementing new ones, microservice-to-microservice ...
Tópico(s): IoT and Edge/Fog Computing
2023 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Parallel and Distributed Systems
Ioannis K. Moutsatsos, Imtiaz Hossain, Claudia Agarinis, Fred Harbinski, Yann Abraham, Luc Dobler, Xian Zhang, Christopher J. Wilson, Jeremy L. Jenkins, Nicholas Holway, John A. Tallarico, Christian N. Parker,
... design allows the quick integration of external scientific applications. Using Jenkins-CI, we integrated CellProfiler, an open-source image-processing platform, with various HCS utilities and a high-performance Linux cluster. The platform is web-accessible, facilitates access and sharing of high-performance compute resources, and automates previously cumbersome data and image-processing ...
Tópico(s): Scientific Computing and Data Management
2016 - Elsevier BV | SLAS DISCOVERY
Lena Mashayekhy, Mark Nejad, Daniel Grosu, Quan Zhang, Weisong Shi,
The majority of large-scale data intensive applications executed by data centers are based on MapReduce or its open-source implementation, Hadoop. Such applications are executed on large clusters requiring large amounts of energy, making the energy costs a considerable fraction of the data center's overall costs. Therefore minimizing the energy consumption when executing each MapReduce job is a critical concern for data centers. In this paper, we propose a framework for improving the energy efficiency ...
Tópico(s): Caching and Content Delivery
2014 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Parallel and Distributed Systems
Michael Gardner, John Kolb, Nicholas Sitar,
... is very computationally expensive and requires significant computing resources. By taking advantage of the advances made in big data analytics and Cloud Computing, we have a developed an open-source program—SparkRocks—that generates block systems in parallel. The application runs on Apache Spark which enables it to run locally, on a compute cluster or the Cloud. The block generation is based ...
Tópico(s): Drilling and Well Engineering
2017 - Elsevier BV | Computers and Geotechnics
Ewing Lusk, Nirmit Desai, Rick Bradshaw, Andrew Lusk, Ralph Butler,
... with a particular distribution, site-specific purchased or open-source software, and assorted home-grown tools and procedures that attempt to glue everything together to meet the needs of the users and administrators of a particular cluster. Whether a cluster is a general-purpose resource serving multiple users or dedicated to a single application, getting everything to work together is a challenge. ...
Tópico(s): Cloud Computing and
2006 - SAGE Publishing | The International Journal of High Performance Computing Applications
Marco Iorio, Fulvio Risso, Alex Palesandro, Leonardo Camiciotti, Antonio Manzalini,
... driven, it enables an overarching abstraction for improved applications execution, while at the same time opening up for new scenarios, including resource sharing and brokering. Following the above vision, we present liqo , an open-source project that materializes this approach through the creation of dynamic and seamless Kubernetes multi-cluster topologies. Extensive experimental evaluations have shown its effectiveness ...
Tópico(s): Distributed systems and fault tolerance
2022 - Institute of Electrical and Electronics Engineers | IEEE Transactions on Cloud Computing
Chia‐Wei Lee, Kuang-Yu Hsieh, Sun‐Yuan Hsieh, Hung-Chang Hsiao,
Cloud computing is a type of parallel distributed computing system that has become a frequently used computer application. MapReduce is an effective programming model used in cloud computing and large-scale data-parallel applications. Hadoop is an open-source implementation of the MapReduce model, and is usually used for data-intensive applications such as data mining and web indexing. The current Hadoop implementation assumes that every node in a cluster has the same computing capacity and that ...
Tópico(s): Advanced Data Storage Technologies
2014 - Elsevier BV | Big Data Research
Mohamed Eddoujaji, Hassan Samadi, Mohamed Bohorma,
Hadoop is an open-source software framework for storing data and launching applications on standard machine clusters. This solution provides massive storage space for all types of data, tremendous processing power, and the ability to support virtually any amount of work. Based on Java, this framework is part of the Apache project, sponsored by Apache Software Foundation [Hadoop official site. http://hadoop.apache.org/]. Thanks to the MapReduce framework, it can handle huge amounts of data. Rather ...
Tópico(s): Parallel Computing and Optimization Techniques
2021 - Springer Nature | Smart innovation, systems and technologies
This issue's "Cloud Tidbit" focuses on container technology and how it's emerging as an important part of the cloud computing infrastructure. It looks at Docker, an open source project that automates the faster deployment of Linux applications, and Kubernetes, an open source cluster manager for Docker containers.
Tópico(s): Cloud Computing and
2014 - Institute of Electrical and Electronics Engineers | IEEE Cloud Computing
Ji Wang, Wenhua Hu, Wenlu Zhao, Jianke Du, D. Huang,
... the other hand, the strong demand on computing resource and software has discouraged applications and further development efforts in industry. In order to advance the design technology through the utilization of advanced computer clusters based on the open source Linux operating system and software components, we need ...
Tópico(s): Acoustic Wave Phenomena Research
2007 - Institute of Electrical and Electronics Engineers | Proceedings/Proceedings - IEEE Ultrasonics Symposium
Judy Qiu, Jaliya Ekanayake, Thilina Gunarathne, Jong Youl Choi, Seunghee Bae, Hui Li, Bingjing Zhang, Tak‐Lon Wu, Yang Ruan, Saliya Ekanayake, Adam L. Hughes, Geoffrey Fox,
... the data analysis. Further we have released the open source Twister Iterative MapReduce and benchmarked it against basic MapReduce (Hadoop) and MPI in information retrieval and life sciences applications. The hybrid cloud (MapReduce) and cluster (MPI) approach offers an attractive production environment while Twister promises a uniform programming environment for many Life Sciences applications. We used commercial clouds Amazon and Azure and the NSF resource FutureGrid to perform detailed comparisons and evaluations of ...
Tópico(s): Metabolomics and Mass Spectrometry Studies
2010 - BioMed Central | BMC Bioinformatics
Bharti Gupta, Rajender Nath, Girdhar Gopal, K Kartik,
Hadoop is an open source Apache project and a software framework for distributed processing of large datasets across large clusters of computers with commodity hardware.Large datasets include terabytes or petabytes of data where as large clusters means hundreds or thousands of nodes.It supports master slave architecture, which involves one master node and thousands of slave nodes.NameNode acts as the master node which stores all the metadata of files and various data nodes are slave nodes which ...
Tópico(s): Advanced Data Storage Technologies
2016 - | International Journal of Computer Applications
Produção Nacional
Revisado por pares
Marcello W. M. Ribeiro, Alexandre A. B. Lima, Daniel de Oliveira,
... C‐ParGRES is an extension of ParGRES, an open‐source database cluster middleware for high‐performance OLAP query processing in clusters. C‐ParGRES exploits cloud capabilities such as on‐demand resource provisioning and elasticity. In addition, C‐ParGRES can create multiple and independent virtual clusters for different database and users. We evaluate C‐ParGRES with two real‐world OLAP applications, both from the Brazilian Institute of Geography and ...
Tópico(s): Caching and Content Delivery
2019 - Wiley | Concurrency and Computation Practice and Experience
Jack B. A. Davis, Armin Shayeghi, Sarah L. Horswell, Roy L. Johnston,
A new open-source parallel genetic algorithm, the Birmingham parallel genetic algorithm, is introduced for the direct density functional theory global optimisation of metallic nanoparticles. The program utilises a pool genetic algorithm methodology for the efficient use of massively parallel computational resources. The scaling capability of the Birmingham parallel genetic algorithm is demonstrated through its application to the global optimisation of iridium clusters with 10 to 20 atoms, a catalytically important system with interesting size-specific effects. This is the first ...
Tópico(s): Machine Learning in Materials Science
2015 - Royal Society of Chemistry | Nanoscale
Hrachya Astsatryan, Arthur Lalayan, Grégory Giuliani,
... effectiveness, support of new EO data formats and open-source packages, or linkage with data cube platforms. The article proposes a scalable EO data processing platform interoperable from cloud-HPC and EO data repositories. The platform enables linking any data repository supporting web coverage service or SpatioTemporal Asset Catalog Application Programming Interfaces (STAC-API), and any cloud or HPC resource supporting scheduling system API for providing access to the cluster backends.
Tópico(s): Scientific Computing and Data Management
2023 - | Scalable Computing Practice and Experience
Z.-C. Duan, Jin-Peng Li, Jian Qin, Ying Yu, Yong-Heng Huo, Sven Höfling, Chao‐Yang Lu, Nai-Le Liu, Kai Chen, Jian-Wei Pan,
... an on-demand semiconductor quantum dot single-photon source for the first time. A fully compiled version of Shor's algorithm for factoring 15 has been accomplished with a significantly reduced resource requirement that employs the four-photon cluster state. Genuine multiparticle entanglement properties are confirmed to reveal the quantum character of the algorithm and circuit. The implementation realizes the Shor's algorithm with deterministic photonic qubits, which opens new applications for cluster state beyond one-way quantum computing.
Tópico(s): Semiconductor Quantum Structures and Devices
2020 - Optica Publishing Group | Optics Express
Emily Shemon, Yinbin Miao, Shikhar Kumar, Kun Mo, Yeon Sang Jung, Aaron Oaks, Scott Richards, Guillaume Giudicelli, Logan Harbour, Roy Stogner,
... reactor lattices using MOOSE-based applications: immediate accessibility (open-source) to the end user, low barrier to entry for new users, speed of mesh generation, volume preservation of meshed fuel pins, and simplification of analysis workflow when used in conjunction with MOOSE-based applications.Keywords: MOOSEfinite elementreactormeshingopen source AcknowledgmentsThe authors gratefully acknowledge the computing resources provided on Bebop, a high-performance computing cluster operated by the Laboratory Computing Resource Center at ...
Tópico(s): Nuclear reactor physics and engineering
2023 - Taylor & Francis | Nuclear Science and Engineering
Produção Nacional
Revisado por pares
Vanderlei Munhoz, Márcio Castro,
... context of high performance computing (HPC), public cloud resources have emerged as a cost‐effective alternative to expensive on‐premises clusters. However, there are several challenges and limitations in adopting this approach. This paper proposes HPC@Cloud , a provider‐agnostic open‐source software toolkit that facilitates the migration, testing, and execution of HPC applications in public clouds. The toolkit takes advantage of ...
Tópico(s): Advanced Data Storage Technologies
2023 - Wiley | Concurrency and Computation Practice and Experience
J. Fidel Perez, Nathan Swain, Herman Guillermo Dolder, Scott Christensen, Alan D. Snow, E. James Nelson, Norman L. Jones,
... addressed in this work. The first is using open‐source software tools to provide access to multiple data sources and lowering the barriers for users in management agencies at local level. This can be done through the Tethys Platform that enables web water resources modeling applications. The second is finding a practical solution for the computational requirements associated with running complex models and performing multiple simulations. This is done using Tethys Cluster that manages distributed and cloud computing resources as ...
Tópico(s): Flood Risk Assessment and Management
2016 - Wiley | JAWRA Journal of the American Water Resources Association
Produção Nacional
Revisado por pares
Maycon Viana Bordin, Dalvan Griebler, Gabriele Mencagli, Cláudio F. R. Geyer, Luiz Gustavo Fernandes,
Systems enabling the continuous processing of large data streams have recently attracted the attention of the scientific community and industrial stakeholders. Data Stream Processing Systems (DSPSs) are complex and powerful frameworks able to ease the development of streaming applications in distributed computing environments like clusters and clouds. Several systems of this kind have been released and currently maintained as open source projects, like Apache Storm and Spark Streaming. Some benchmark ...
Tópico(s): Cloud Computing and
2020 - Institute of Electrical and Electronics Engineers | IEEE Access