Experiences of On-demand execution for large scale parameter sweep applications on OSG by swift

Zhengxiong Hou, Mike Wilde, Mihael Hategan, Xingshe Zhou, Ian Foster, Ben Clifford

科研成果: 书/报告/会议事项章节会议稿件同行评审

1 引用 (Scopus)

摘要

Large scale parameter sweep application (PSA) is one of the main grid applications, which may have different characteristics and demands. In this paper, we describe how to use swift to enable the on-demand execution of large scale PSA on open science grid (OSG). The basic on-demand concept means providing appropriate grid resources for the application, which is decided by the characteristics and demands of the application. So we can get high reliability, efficiency, and scalability for large scale independent PSA jobs on OSG. The main on-demand policies include: trust based site selection and pre-selection; scheduling policy on-demand configuration; clustering for small jobs; adaptive execution and automatic data staging; divide and conquer for the scalability. Some usage examples of swift for executing large scale PSA are presented, such as dock, blast. The experimental results for the performance of different policies are presented, with a benchmarking workload size of 10,000 jobs.

源语言英语
主期刊名2009 11th IEEE International Conference on High Performance Computing and Communications, HPCC 2009
527-532
页数6
DOI
出版状态已出版 - 2009
活动11th IEEE International Conference on High Performance Computing and Communications, HPCC 2009 - Seoul, 韩国
期限: 25 6月 200927 6月 2009

出版系列

姓名2009 11th IEEE International Conference on High Performance Computing and Communications, HPCC 2009

会议

会议11th IEEE International Conference on High Performance Computing and Communications, HPCC 2009
国家/地区韩国
Seoul
时期25/06/0927/06/09

指纹

探究 'Experiences of On-demand execution for large scale parameter sweep applications on OSG by swift' 的科研主题。它们共同构成独一无二的指纹。

引用此