diff --git a/home_contents.qmd b/home_contents.qmd index f17d224c..0b8440c1 100644 --- a/home_contents.qmd +++ b/home_contents.qmd @@ -41,6 +41,10 @@ format: html - NGS technologies and challenges [{{< fa brands youtube >}}](https://youtu.be/5sUzkrucL1E) [{{< fa file-pdf >}}](topics/other/slide_sequencing.pdf) - NGS Pipelines [{{< fa brands youtube >}}](https://youtu.be/6RBhfMvDkSI) [{{< fa file-pdf >}}](topics/other/slide_ngs_pipelines.pdf) + +### Other + +- QC of FastQ reads [{{< fa file-pdf >}}](topics/other/slide_qc.pdf) [{{< fa file-lines >}}](topics/other/lab_qc.html) - Data management [{{< fa brands youtube >}}](https://youtu.be/PfcrDlhY1zE) [{{< fa file-powerpoint >}}](topics/other/slide_data_management.pdf) ### Useful resources @@ -55,4 +59,3 @@ format: html - Uppmax cheatsheet [{{< fa file-image >}}](topics/linux/assets/uppmax_cheat_sheet.png) - Mac keyboard [{{< fa file-lines >}}](topics/other/lab_mac_keyboard.html) -*** diff --git a/home_precourse.qmd b/home_precourse.qmd index ed1fea25..6f263b2b 100644 --- a/home_precourse.qmd +++ b/home_precourse.qmd @@ -84,9 +84,16 @@ Where `username` is mentioned, change to your user name. Once you have logged in to UPPMAX, run the following command. -```{r,echo=FALSE} -#| class-output: bash -cat(paste0("mkdir /proj/",upid,"/nobackup/username")) +```{r} +#| output: asis +#| echo: false +out <- paste0("mkdir /proj/", upid, "/nobackup/username") +cat( + "```{.bash filename='Terminal'}", + out, + "```", + sep = "\n" +) ``` This creates a directory with your user name. You will work inside this directory for the workshop. If you cannot write to the folder, the most likely reason is that you have not requested access to the workshop project via SUPR. This is described in step 1 above. diff --git a/topics/other/assets/mac_keyboard_alt.jpg b/topics/other/assets/mac_keyboard_alt.jpg new file mode 100644 index 00000000..2cf99eb6 Binary files /dev/null and b/topics/other/assets/mac_keyboard_alt.jpg differ diff --git a/topics/other/assets/mac_keyboard_normal.jpg b/topics/other/assets/mac_keyboard_normal.jpg new file mode 100644 index 00000000..1dea2848 Binary files /dev/null and b/topics/other/assets/mac_keyboard_normal.jpg differ diff --git a/topics/other/assets/mac_keyboard_shift.jpg b/topics/other/assets/mac_keyboard_shift.jpg new file mode 100644 index 00000000..7af577fd Binary files /dev/null and b/topics/other/assets/mac_keyboard_shift.jpg differ diff --git a/topics/other/assets/mac_keyboard_shitfAlt.jpg b/topics/other/assets/mac_keyboard_shitfAlt.jpg new file mode 100644 index 00000000..36113de0 Binary files /dev/null and b/topics/other/assets/mac_keyboard_shitfAlt.jpg differ diff --git a/topics/other/lab_connect.qmd b/topics/other/lab_connect.qmd index c62072b3..4f16ba7c 100644 --- a/topics/other/lab_connect.qmd +++ b/topics/other/lab_connect.qmd @@ -1,6 +1,6 @@ --- title: "Connecting to UPPMAX" - +description: "Connecting to UPPMAX through SSH and GUI (Browser and ThinLinc)" date: "" format: html --- @@ -37,10 +37,7 @@ Fire up the available SSH program and enter the following: $ ssh username@rackham.uppmax.uu.se ``` -Replace username with your UPPMAX username. - -Enter your password when prompted. As you type, nothing will show on the screen. -No stars, no dots. It is supposed to be that way. Just type the password and press enter, it will be fine. +Enter your password when prompted. As you type, nothing will show on the screen. No stars, no dots. It is supposed to be that way. Just type the password and press enter, it will be fine. Now your screen should look something like this: @@ -64,7 +61,7 @@ Last login: Fri May 18 15:03:59 2018 from mi04.icm.uu.se dahlo@rackham4 ~ $ ``` -Now you are connected to UPPMAX and can start working on the labs. +Now you are connected to UPPMAX and can start working. ## Remote desktop @@ -76,36 +73,43 @@ We have a ThinLinc server running at one of the login nodes which allows users t To be able to login via a web browser you will have to set up two-factor authentication first. Follow the instructions at the UPPMAX homepage, and once you are done you can continue below. - 1. Go to the login page, https://rackham-gui.uppmax.uu.se/ - 2. Enter your UPPMAX username. - 3. Enter your UPPMAX password, followed by your current two-factor authentication code. - Eg. if your password is `hunter2` and your current two-factor authentication code is `123456` you will enter `hunter2123456` as your password. - ![](assets/thinlinc_00.png){width="200px"} - 4. It will ask you which profile you want to use, so first press the `Forward` button. Then you can choose which desktop environment you want to use. `Xfce` is pretty straight-forward and easy to use, but feel free to try either of them. You get to choose every time you login so it's not a permanent choice. - ![](assets/thinlinc_01.png){width="200px"} - 5. Once your desktop has been loaded, start a terminal either by clicking the black terminal icon at the bottom of the screen, or by pressing the `Applications` button in the top left corner and select `Terminal Emulator`. - ![](assets/thinlinc_02.png){width="200px"} +1. Go to the login page, https://rackham-gui.uppmax.uu.se/ +2. Enter your UPPMAX username. +3. Enter your UPPMAX password, followed by your current two-factor authentication code. + Eg. if your password is `hunter2` and your current two-factor authentication code is `123456` you will enter `hunter2123456` as your password. + + ![](assets/thinlinc_00.png){width="200px"} + +4. It will ask you which profile you want to use, so first press the `Forward` button. Then you can choose which desktop environment you want to use. `Xfce` is pretty straight-forward and easy to use, but feel free to try either of them. You get to choose every time you login so it's not a permanent choice. + + ![](assets/thinlinc_01.png){width="200px"} + +5. Once your desktop has been loaded, start a terminal either by clicking the black terminal icon at the bottom of the screen, or by pressing the `Applications` button in the top left corner and select `Terminal Emulator`. + + ![](assets/thinlinc_02.png){width="200px"} ### ThinLink App - 1. If you haven't already done so, download the ThinLinc client matching your local computer (i.e Windows, Linux, MacOS X or Solaris) from https://www.cendio.com/thinlinc/download and install it. - 2. Launch the ThinLinc client. You should see a form where you can enter your username and password, and possibly a server name. If you only see this simple form: - ![](assets/thinlinc_03.png){width="200px"} +1. If you haven't already done so, download the ThinLinc client matching your local computer (i.e Windows, Linux, MacOS X or Solaris) from https://www.cendio.com/thinlinc/download and install it. +2. Launch the ThinLinc client. You should see a form where you can enter your username and password, and possibly a server name. If you only see this simple form as shown below, you can click **Advanced** to be able to set the server name. + + ![](assets/thinlinc_03.png){width="200px"} + +3. Change the **Server** setting to `rackham-gui.uppmax.uu.se`. +4. Change the **Name** setting to your UPPMAX username. +5. Set the **Password** setting to your UPPMAX password. +6. You do not need to change any other settings. +7. You will first come to the `ThinLinc profile chooser`. Press the `Forward` button to continue. Then you can choose which desktop environment you want to use. `Xfce` is pretty straight-forward and easy to use, but feel free to try either of them. You get to choose every time you login so it's not a permanent choice. +8. Press the **Connect** button. +9. If you connect for the first time you will see the "The server's host key is not cached ..." dialog. + + ![](assets/thinlinc_01.png){width="200px"} - you can click Advanced to be able to set the server name. - 3. Change the **Server** setting to `rackham-gui.uppmax.uu.se`. - 4. Change the **Name** setting to your UPPMAX username. - 5. Set the **Password** setting to your UPPMAX password. - 6. You do not need to change any other settings. - 7. You will first come to the `ThinLinc profile chooser`. Press the `Forward` button to continue. Then you can choose which desktop environment you want to use. `Xfce` is pretty straight-forward and easy to use, but feel free to try either of them. You get to choose every time you login so it's not a permanent choice. - 8. Press the "Connect" button. - 9. If you connect for the first time you will see the "The server's host key is not cached ..." dialog. - ![](assets/thinlinc_01.png){width="200px"} +10. Once your desktop has been loaded, start a terminal either by clicking the black terminal icon at the bottom of the screen, or by pressing the `Applications` button in the top left corner and select `Terminal Emulator`. - 10. Once your desktop has been loaded, start a terminal either by clicking the black terminal icon at the bottom of the screen, or by pressing the `Applications` button in the top left corner and select `Terminal Emulator`. - ![](assets/thinlinc_02.png){width="200px"} + ![](assets/thinlinc_02.png){width="200px"} - 11. **Two factor authentication:** The ThinLinc client connects over SSH which means it **may** be required to present a two factor authentication code. If you need to use this when logging in with SSH you also need to use it when logging in with ThinLinc (it depends on where you connect from). The ThinLinc client does not know how to ask for the two factor code, so you will need to use the grace time feature. To do this, first you have to connect with regular SSH and present the required two factor code. Once you have logged in over SSH you can safely exit again. The login server will remember that you just logged in for a few minutes and will not ask for two factor authentication again, so make sure you do not wait too long to connect with the ThinLinc client. +11. **Two factor authentication:** The ThinLinc client connects over SSH which means it **may** be required to present a two factor authentication code. If you need to use this when logging in with SSH you also need to use it when logging in with ThinLinc (it depends on where you connect from). The ThinLinc client does not know how to ask for the two factor code, so you will need to use the grace time feature. To do this, first you have to connect with regular SSH and present the required two factor code. Once you have logged in over SSH you can safely exit again. The login server will remember that you just logged in for a few minutes and will not ask for two factor authentication again, so make sure you do not wait too long to connect with the ThinLinc client. ## After connection to UPPMAX diff --git a/topics/other/lab_download_files.qmd b/topics/other/lab_download_files.qmd index 1a01bb3c..84970c6e 100644 --- a/topics/other/lab_download_files.qmd +++ b/topics/other/lab_download_files.qmd @@ -31,26 +31,42 @@ Lets assume that you have a file "results.txt" in the following folder on UPPMAX cat(paste0('/proj/',upid,'/nobackup/username/somefolder/')) ``` -`username` and `somefolder` should be replaced with your real username and a real folder name.\ +::: {.callout-note} +`username` and `somefolder` should be replaced with your real username and a real folder name. +::: + To download the file to your local workspace type: ```{r} +#| output: asis #| echo: false -#| class-output: bash -cat(paste0('scp username@rackham.uppmax.uu.se:/proj/',upid,'/nobackup/username/somefolder/results.txt .')) +out <- paste0("scp username@rackham.uppmax.uu.se:/proj/", upid, "/nobackup/username/somefolder/results.txt .") +cat( + "```{.bash filename='Local Terminal'}", + out, + "```", + sep = "\n" +) ``` Note that the last `.` means that the file will keep the original name. ## Upload a file to UPPMAX -Now lets imagine that you have developed a script on your laptop and want to upload it to UPPMAX. The script is stored in your local workspace and is called "script.sh".\ -Type this in your local workspace to upload the file to UPPMAX: +Now lets imagine that you have developed a script on your laptop and want to upload it to UPPMAX. The script is stored in your local workspace and is called "script.sh". Type this in your local workspace to upload the file to UPPMAX: + +::: {.callout-note} +`username` and `somefolder` should be replaced with your real username and a real folder name. +::: ```{r} +#| output: asis #| echo: false -#| class-output: bash -cat(paste0('scp script.sh username@rackham.uppmax.uu.se:/proj/',upid,'/nobackup/username/somefolder/.')) +out <- paste0("scp script.sh username@rackham.uppmax.uu.se:/proj/", upid, "/nobackup/username/somefolder/.") +cat( + "```{.bash filename='Local Terminal'}", + out, + "```", + sep = "\n" +) ``` - -Again, `username` and `somefolder` should be replaced with your real username and a real folder name. diff --git a/topics/other/lab_mac_keyboard.qmd b/topics/other/lab_mac_keyboard.qmd index 980d462d..cabcfcb3 100644 --- a/topics/other/lab_mac_keyboard.qmd +++ b/topics/other/lab_mac_keyboard.qmd @@ -6,13 +6,17 @@ format: html --- **Normal** -![](data/linux/mac_keyboard_normal.jpg) + +![](assets/mac_keyboard_normal.jpg) **Holding shift** -![](data/linux/mac_keyboard_shift.jpg) + +![](assets/mac_keyboard_shift.jpg) **Holding alt** -![](data/linux/mac_keyboard_alt.jpg) + +![](assets/mac_keyboard_alt.jpg) **Holding alt+shift** -![](data/linux/mac_keyboard_shitfAlt.jpg) + +![](assets/mac_keyboard_shitfAlt.jpg) diff --git a/topics/other/lab_open_session.qmd b/topics/other/lab_open_session.qmd index 9dc01aeb..f1e13073 100644 --- a/topics/other/lab_open_session.qmd +++ b/topics/other/lab_open_session.qmd @@ -15,7 +15,7 @@ library(yaml)
```{r,eval=TRUE,echo=FALSE,chunk.title=NULL} -s <- read.csv("open_session.csv",sep=";",stringsAsFactors=F,header=T,na.strings="",colClasses="character") +s <- readxl::read_xlsx("open_session.xlsx") # remove rows that are completely NA s <- s[!apply(s,1,function(x) all(is.na(x))),] cnames <- c("Room","Topic","Staff") diff --git a/topics/other/open_session.csv b/topics/other/open_session.csv deleted file mode 100644 index d129e642..00000000 --- a/topics/other/open_session.csv +++ /dev/null @@ -1,7 +0,0 @@ -room;topic;staff -Room 1;Whole genome sequencing, variant calling;Malin Larsson, Diana Ekman -Room 2;RNA-Seq, scRNA-Seq;Julie Lorent, Juliana Assis, Prasoon Agarwal, Roy Francis -Room 3;Bash, Uppmax, Computing;Martin Dahlö -Room 4;Epigenetics, Chip-Seq, RNA-Seq, scRNASeq, small RNA;Agata Smialowska, Vincent van Hoef -Room 5;NGI, Assembly, Long read sequencing;Adam Ameur, Estelle Proux -Room 6;Metagenomics, Prokaryots, RNA-Seq;Dag Ahrén, Lokesh Manoharan, John Sundh diff --git a/topics/other/open_session.xlsx b/topics/other/open_session.xlsx new file mode 100644 index 00000000..ef70ba2e Binary files /dev/null and b/topics/other/open_session.xlsx differ