README.md

spa - pilot scheduler for spark applications on hpc

sample usage:

pilotspark.py example/standalone/hpc/hpc_pilot_template.sh experiments/code/conditions/hpc_scala_8n1d_pilot.json

Paper

paper.tex is the LaTeX source of a report describing experiments done with SPA. Figures contained in the paper can be generated with load_figures.sh (requires Python's matplotlib).

A pdf is uploaded for every release of the paper:

• Release 0.1 - Arxiv preprint.