Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures

Released on by Sonja Holl
preview-18

  • Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures Book Detail

  • Author : Sonja Holl
  • Release Date : 2014
  • Publisher : Forschungszentrum Jülich
  • Genre :
  • Pages : 207
  • ISBN 13 : 389336949X
  • File Size : 95,95 MB
DOWNLOAD BOOK

Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures by Sonja Holl PDF Summary

Book Description: Scientific workflows have emerged as a key technology that assists scientists with the design, management, execution, sharing and reuse of in silico experiments. Workflow management systems simplify the management of scientific workflows by providing graphical interfaces for their development, monitoring and analysis. Nowadays, e-Science combines such workflow management systems with large-scale data and computing resources into complex research infrastructures. For instance, e-Science allows the conveyance of best practice research in collaborations by providing workflow repositories, which facilitate the sharing and reuse of scientific workflows. However, scientists are still faced with different limitations while reusing workflows. One of the most common challenges they meet is the need to select appropriate applications and their individual execution parameters. If scientists do not want to rely on default or experience-based parameters, the best-effort option is to test different workflow set-ups using either trial and error approaches or parameter sweeps. Both methods may be inefficient or time consuming respectively, especially when tuning a large number of parameters. Therefore, scientists require an effective and efficient mechanism that automatically tests different workflow set-ups in an intelligent way and will help them to improve their scientific results. This thesis addresses the limitation described above by defining and implementing an approach for the optimization of scientific workflows. In the course of this work, scientists’ needs are investigated and requirements are formulated resulting in an appropriate optimization concept. In a following step, this concept is prototypically implemented by extending a workflow management system with an optimization framework, including general mechanisms required to conduct workflow optimization. As optimization is an ongoing research topic, different algorithms are provided by pluggable extensions (plugins) that can be loosely coupled with the framework, resulting in a generic and quickly extendable system. In this thesis, an exemplary plugin is introduced which applies a Genetic Algorithm for parameter optimization. In order to accelerate and therefore make workflow optimization feasible at all, e-Science infrastructures are utilized for the parallel execution of scientific workflows. This is empowered by additional extensions enabling the execution of applications and workflows on distributed computing resources. The actual implementation and therewith the general approach of workflow optimization is experimentally verified by four use cases in the life science domain. All workflows were significantly improved, which demonstrates the advantage of the proposed workflow optimization. Finally, a new collaboration-based approach is introduced that harnesses optimization provenance to make optimization faster and more robust in the future.

Disclaimer: www.yourbookbest.com does not own Automated Optimization Methods for Scientific Workflows in e-Science Infrastructures books pdf, neither created or scanned. We just provide the link that is already available on the internet, public domain and in Google Drive. If any way it violates the law or has any issues, then kindly mail us via contact us page to request the removal of the link.

Scientific Workflows

Scientific Workflows

File Size : 32,32 MB
Total View : 4676 Views
DOWNLOAD

Creating scientific workflow applications is a very challenging task due to the complexity of the distributed computing environments involved, the complex contr

Workflows for e-Science

Workflows for e-Science

File Size : 80,80 MB
Total View : 3241 Views
DOWNLOAD

This is a timely book presenting an overview of the current state-of-the-art within established projects, presenting many different aspects of workflow from use