Data-Intensive Workflow Management

Released on by Daniel Oliveira
preview-18

  • Data-Intensive Workflow Management Book Detail

  • Author : Daniel Oliveira
  • Release Date : 2022-06-01
  • Publisher : Springer Nature
  • Genre : Computers
  • Pages : 161
  • ISBN 13 : 3031018729
  • File Size : 70,70 MB
DOWNLOAD BOOK

Data-Intensive Workflow Management by Daniel Oliveira PDF Summary

Book Description: Workflows may be defined as abstractions used to model the coherent flow of activities in the context of an in silico scientific experiment. They are employed in many domains of science such as bioinformatics, astronomy, and engineering. Such workflows usually present a considerable number of activities and activations (i.e., tasks associated with activities) and may need a long time for execution. Due to the continuous need to store and process data efficiently (making them data-intensive workflows), high-performance computing environments allied to parallelization techniques are used to run these workflows. At the beginning of the 2010s, cloud technologies emerged as a promising environment to run scientific workflows. By using clouds, scientists have expanded beyond single parallel computers to hundreds or even thousands of virtual machines. More recently, Data-Intensive Scalable Computing (DISC) frameworks (e.g., Apache Spark and Hadoop) and environments emerged and are being used to execute data-intensive workflows. DISC environments are composed of processors and disks in large-commodity computing clusters connected using high-speed communications switches and networks. The main advantage of DISC frameworks is that they support and grant efficient in-memory data management for large-scale applications, such as data-intensive workflows. However, the execution of workflows in cloud and DISC environments raise many challenges such as scheduling workflow activities and activations, managing produced data, collecting provenance data, etc. Several existing approaches deal with the challenges mentioned earlier. This way, there is a real need for understanding how to manage these workflows and various big data platforms that have been developed and introduced. As such, this book can help researchers understand how linking workflow management with Data-Intensive Scalable Computing can help in understanding and analyzing scientific big data. In this book, we aim to identify and distill the body of work on workflow management in clouds and DISC environments. We start by discussing the basic principles of data-intensive scientific workflows. Next, we present two workflows that are executed in a single site and multi-site clouds taking advantage of provenance. Afterward, we go towards workflow management in DISC environments, and we present, in detail, solutions that enable the optimized execution of the workflow using frameworks such as Apache Spark and its extensions.

Disclaimer: www.yourbookbest.com does not own Data-Intensive Workflow Management books pdf, neither created or scanned. We just provide the link that is already available on the internet, public domain and in Google Drive. If any way it violates the law or has any issues, then kindly mail us via contact us page to request the removal of the link.

Data-Intensive Workflow Management

Data-Intensive Workflow Management

File Size : 58,58 MB
Total View : 4453 Views
DOWNLOAD

Workflows may be defined as abstractions used to model the coherent flow of activities in the context of an in silico scientific experiment. They are employed i

Grid and Services Evolution

Grid and Services Evolution

File Size : 95,95 MB
Total View : 4843 Views
DOWNLOAD

Grids are a crucial enabling technology for scientific and industrial development. Grid and Services Evolution, the 11th edited volume of the CoreGRID series, w

Scientific Workflows

Scientific Workflows

File Size : 2,2 MB
Total View : 9426 Views
DOWNLOAD

Creating scientific workflow applications is a very challenging task due to the complexity of the distributed computing environments involved, the complex contr

Distributed and Parallel Systems

Distributed and Parallel Systems

File Size : 54,54 MB
Total View : 7077 Views
DOWNLOAD

Distributed and Parallel Systems: From Cluster to Grid Computing, is an edited volume based on DAPSYS 2006, the 6th Austrian-Hungarian Workshop on Distributed a

Parallel Computing

Parallel Computing

File Size : 76,76 MB
Total View : 7109 Views
DOWNLOAD

The use of parallel programming and architectures is essential for simulating and solving problems in modern computational practice. There has been rapid progre