CalCul: A Python-Based Workspace for High-Performance Parameters-Sweep in Scientific Legacy Codes

Gal Oren, Guy Malamud

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

Scientific legacy codes are usually holding large numbers of physical arrays which have been used and updated by the code routines, and the code parameters are set using a simple textual data file. Therefore, in cases when there is a need to perform a parallel large-scale parameters-sweep, the user needs to manually replicate the code multiple times, change the data file to its needs, run the code and control its performances- A t each working directory separately. This task is practicable when there is a need to create several computations, but impossible when there is a need to run a large-scale parallel parameters-sweep on a cluster with thousands of calculations. In this work we present CalCul-A Python-based Workspace for High-Performance Legacy Scientific Codes, which is able to automatically render most of legacy codes data files into a python object, allowing the user-using many other functionalities-to control and handle all the needs of a parameters-sweep using the simplicity and sophistication of Python libraries, and thus allowing the conversion of work with software from manual to automatic. Also, in order to not damage the way legacy software work, and in order to abstain from replacing existing work modules for these software, the CalCul system provides a mirror between the changes done using the Python object and the legacy data files, and thus allows working dually on the software-either from CalCul or from the data files itself. CalCul also interfaces with IPython interactive command shell, and in this way, the user can manage all of his scientific actions entirely in one hermetic workspace.

Original languageEnglish
Title of host publicationParallel Computing is Everywhere
EditorsGerhard R. Joubert, Patrizio Dazzi, Frans Peters, Marco Danelutto, Sanzio Bassini
PublisherIOS Press BV
Pages242-251
Number of pages10
ISBN (Electronic)9781614998426
DOIs
StatePublished - 1 Jan 2018

Publication series

NameAdvances in Parallel Computing
Volume32
ISSN (Print)0927-5452
ISSN (Electronic)1879-808X

Keywords

  • High-Performance Computing
  • Legacy Computational Scientific Codes
  • Parallel Tools
  • Parameters-Sweep
  • Python Workspace

ASJC Scopus subject areas

  • General Computer Science

Fingerprint

Dive into the research topics of 'CalCul: A Python-Based Workspace for High-Performance Parameters-Sweep in Scientific Legacy Codes'. Together they form a unique fingerprint.

Cite this