This repository contains research code for Lotaru. See:
- Lotaru: Locally Estimating Runtimes of Scientific Workflow Tasks in Heterogeneous Clusters
- Lotaru: Locally Predicting Workflow Task Runtimes for Resource Management on Heterogeneous Infrastructures
data/traces
contains task traces from executions of different workflows
and varying input sizes. The directory is structured as
data/traces/<node>/<workflow>/traces.csv
The traces are generated by Nextflow and the fields are documented in the
Nextflow documentation.
data/benchmarks
contains records of the node benchmarks.
The main code is in lotaru
. The cli application and its analysis
scripts are in lotaru/analysis
For now the cli application can be called via python -m lotaru
which
prints a general help to get started.