-
Notifications
You must be signed in to change notification settings - Fork 923
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #5659 from mirelaminkova/patch-1
Update 2025-01-28-src.md
- Loading branch information
Showing
9 changed files
with
68 additions
and
13 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -2,13 +2,15 @@ | |
layout: event | ||
|
||
# Status of this page, remove these lines when ready | ||
draft: true | ||
status: wip | ||
#draft: true | ||
#status: wip | ||
|
||
# Description of your event | ||
title: Galaxy at SURF Research Cloud workshop | ||
description: | | ||
Half-day workshop demonstrating the local Galaxy instance built for users of SURF Research Cloud. | ||
Half-day workshop demonstrating the local Galaxy instance built for users of SURF Research Cloud. | ||
**Registration**: To sign up for the event, please send an email to [Mirela Minkova](mailto:[email protected]?subject=Registering%20SRC%20Galaxy%20Workshop) | ||
|
@@ -79,11 +81,11 @@ program: | |
|
||
- name: surf-research-cloud-pulsar | ||
topic: admin | ||
time: "14:10 - 14:40" | ||
time: "14:10 - 14:30" | ||
|
||
- type: custom | ||
name: Coffee Break | ||
time: "14:40" | ||
time: "14:30" | ||
- name: mapping | ||
topic: sequence-analysis | ||
time: "14:40 - 15:40" | ||
|
@@ -99,7 +101,10 @@ program: | |
- type: custom | ||
name: Borreltje | ||
time: "16:30 - 17:00" | ||
|
||
tags: | ||
- admin | ||
- surf | ||
- netherlands | ||
--- | ||
|
||
During the workshop, you will see a short demo and get a chance to test the catalog item yourself. This will be followed by a discussion about your needs as Galaxy researchers, helping us work toward a better future for the Dutch research community. We will conclude the day with drinks and networking with fellow Galaxy NL users. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -7,7 +7,12 @@ questions: | |
- How do I start a Pulsar instance on SURF Research Cloud? | ||
- How do I connect to Pulsar? | ||
objectives: | ||
- Be able to attach a Pulsar node to Galaxy and use interactive tools | ||
- Be able to attach a Pulsar node to Galaxy | ||
- Send jobs to Pulsar | ||
key_points: | ||
- With SRC you can start your own Pulsar on-demand instance in a secure environment. | ||
- The Pulsar node is publicly accessible for a Galaxy with the credentials to use. | ||
- You can send jobs to a Pulsar node from either a Galaxy instance running on SRC, or even inside your own network. | ||
requirements: | ||
- type: "none" | ||
title: Access to the SURF Research Cloud | ||
|
@@ -26,6 +31,8 @@ contributions: | |
funding: | ||
- surf | ||
|
||
priority: 11 | ||
|
||
edam_ontology: | ||
- topic_0605 # Informatics | ||
- topic_3071 # Data Management | ||
|
@@ -49,9 +56,14 @@ tags: | |
|
||
Using Pulsar via the {SRC} allows researchers to start Pulsar instances on-demand to expand their computational resources and even access GPUs to help and analyze their data in a secure environment following the {GDPR}. | ||
|
||
The instance provides secure authentication, where users must have a SURF Research account prior to this tutorial, have set the {SRAM} authentication method, and connect an SSH key to their accounts. In case you are not familiar with {SRC} and need help in setting up your accounts, please follow the instructions on the [SURF Knowledge Base](https://servicedesk.surf.nl/wiki/display/WIKI/SURF+Research+Cloud) | ||
There are two main use cases we envision this role being useful for: | ||
|
||
Saving costs on SRC | ||
: Maybe you're already running Galaxy in SRC, but you don't want to run a GPU node because it is very expensive. By using the SRC Pulsar Catalog Item, you can launch a node to do computations and then shut it down when you're done, saving money. Pulsar instances can be started and stopped on demand, depending on personal cases and requirements, giving you a lot of freedom! | ||
|
||
Accessing a GPU from a local (in UMC/hospital Galaxy) | ||
: If you do not have a GPU easily available within your institute, it may be attractive to send jobs securely to SRC, by launching a Pulsar node in SRC and attaching it to your institute's Galaxy instance. | ||
|
||
Pulsar instances can be started and stopped on demand, depending on personal cases and requirements. Inside the SRC members should have access to all publicly available catalog items. If you are not able to create a catalog item, please [contact SURF servicedesk](mailto:[email protected]). | ||
|
||
> <agenda-title></agenda-title> | ||
> | ||
|
@@ -62,6 +74,10 @@ Pulsar instances can be started and stopped on demand, depending on personal cas | |
|
||
# Prerequisites | ||
|
||
The instance provides secure authentication, where users must have a SURF Research account prior to this tutorial, have set the {SRAM} authentication method, and connect an SSH key to their accounts. In case you are not familiar with {SRC} and need help in setting up your accounts, please follow the instructions on the [SURF Knowledge Base](https://servicedesk.surf.nl/wiki/display/WIKI/SURF+Research+Cloud) | ||
|
||
Inside the SRC members should have access to all publicly available catalog items. If you are not able to create a catalog item, please [contact SURF servicedesk](mailto:[email protected]). | ||
|
||
This tutorial assumes you are member of a {CO} in {SRAM} that has access to {SRC} and a wallet with budget in SRC with enough sources to create Galaxy and Pulsar catalog items. (For more information please refer to the [SURF Knowledge Base](https://servicedesk.surf.nl/wiki/display/WIKI/Budgets%2C+wallets%2C+contracts). | ||
|
||
You should have previous experience working with data inside Galaxy. | ||
|
@@ -229,4 +245,15 @@ You can find the tool ID from the dropdown at the top right, just to the left of | |
With that, you're done, and for the length of time your node is running, your chosen tools (or everything) will be executed on that Pulsar node with more memory and CPU than the Galaxy host, and maybe a GPU as well! | ||
> <hands-on-title>Launch a Job on Pulsar</hands-on-title> | ||
> 1. Login to your Galaxy | ||
> 2. Run one of the tools you have decided to send to Pulsar | ||
> 3. On the pulsar machine, you can check that it runs by following the logs: | ||
> | ||
> ```bash | ||
> sudo journalctl -fu pulsar | ||
> ``` | ||
> | ||
{: .hands_on} | ||
Congratulations on launching Pulsar in SRC! 🌌 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -17,6 +17,8 @@ | |
subtopic: cloud | ||
contributors: | ||
- hexylena | ||
|
||
priority: 30 | ||
--- | ||
|
||
### Why Terraform | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -23,6 +23,8 @@ tags: | |
- deploying | ||
- cloud | ||
priority: 3 | ||
|
||
priority: 30 | ||
--- | ||
|
||
# Overview | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters