Adding development / tutorial container #43
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
the developer should easily be able to test spindle, and the user should be able to run a small example or tutorial. Ideally we can also extend a container to be able to build and test in CI Signed-off-by: vsoch <[email protected]>
Signed-off-by: vsoch <[email protected]>
Signed-off-by: vsoch <[email protected]>
this now reproduces up to the same issue with overlay, which does not work on my computer. But it might work on someone elses! Signed-off-by: vsoch <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This is the start of work to add a small development environment to serve two cases:
The environment include a two node slurm cluster with centos nodes, and of course the main "login" node that the user can shell into to interact with the job manager and also install / use spindle. It is done by way of docker-compose and a new folder "docker."
A container build could also be useful to build and test spindle in CI, although that is not included here. To finish up this work I need a little help with a dummy example that can quickly show the advantages of using spindle. I had wanted to do something with Python loading (e.g., having a library that sleeps 5 seconds and showing the load being 5 vs 10 seconds) but it's not clear to me how to use spindle (the only examples are for using mpi). Is this a reasonable use case or should I install mpi and try to reproduce that example?
Finally, my last question is about the scope of user base for spindle. Is this a niche application that is only interesting to a small subset of MPI users/developers with a very specific problem, or is there something here that we could share with the larger community and say "this solves a problem that you have, here are a bunch of examples for why /how to use it."