|
| 1 | +# Introduction to running R, MATLAB and Julia in HPC |
| 2 | + |
| 3 | +- Course ZOOM: |
| 4 | + - https://umu.zoom.us/j/68491237582?pwd=ouFvsdAfNpXUmCVQSI88APoqVMEamb.1 |
| 5 | + - Meeting ID: 684 9123 7582 |
| 6 | + - Passcode: 269001 |
| 7 | + |
| 8 | +- Previous course ZOOM: https://umu.zoom.us/j/67471247121?pwd=4fMWhudbUAvjWm67Fh2RsI2Cakrcge.1 |
| 9 | + - Meeting ID: 674 7124 7121 |
| 10 | + - Passcode: 163517 |
| 11 | + |
| 12 | +- Planning zoom: https://umu.zoom.us/j/61208880201 |
| 13 | + |
| 14 | +## Materials page |
| 15 | + |
| 16 | +- [Rendered](https://uppmax.github.io/R-matlab-julia-HPC/) |
| 17 | +- [Source](https://github.com/UPPMAX/R-matlab-julia-HPC/tree/main) |
| 18 | + |
| 19 | +## Topics planning |
| 20 | + |
| 21 | +- [R](https://hackmd.io/gV_gdctHQPWz6eElFWfq6Q#) |
| 22 | +- [Matlab](https://hackmd.io/RTujs9MnS0ehsGD7ufNBfA#) |
| 23 | +- [Julia](https://hackmd.io/ERX9FIgyR_6wDbmcqi_8HA#) |
| 24 | + |
| 25 | +# Autumn 2026 |
| 26 | + |
| 27 | +- **19-22 October** |
| 28 | +- R: Mon 19 Oktober |
| 29 | +- MATLAB: Tue 20 Oktober |
| 30 | +- Julia: Wed 21 Oktober |
| 31 | +- Advanced: Thu 22 Oct |
| 32 | + |
| 33 | +## Next meeting 25 Sep at 10.30 |
| 34 | + |
| 35 | +### Meeting goals |
| 36 | + |
| 37 | +- Decide on needed changes due to |
| 38 | + - formatting (zensical) |
| 39 | + - arrhenius |
| 40 | + - teachers |
| 41 | + - needed improvements (evaluation) |
| 42 | + - schedule |
| 43 | +- Registration |
| 44 | + |
| 45 | +### Topics |
| 46 | +#### Registrations |
| 47 | +- 5 so far |
| 48 | +- New Ad next week (no updates) |
| 49 | +- Advertisement page for the course has been updated with the new link. The repo: https://gitlab.naiss.se/hpc/training/naiss-training/-/tree/main/docs/course_adverts/2026 |
| 50 | + - There is a page for each course under this |
| 51 | + - The link to the advertisement page for a course should then be added on the Upcoming courses page (with dates and info): https://hpc.pages.naiss.se/training/naiss-training/courses/upcoming/ |
| 52 | + |
| 53 | +#### Zensical |
| 54 | +##### Status |
| 55 | +- ported in repo copy |
| 56 | +- we need to check specific syntax |
| 57 | + - first check says it works |
| 58 | + - some small errors, like links |
| 59 | +- Add info for Arrhenius on each subject |
| 60 | +- There is a file "broken-zensical.toml" which contains the links to the evaluations and meetings. I could not quickly get it to build with that there, but we should move it back again later. |
| 61 | + |
| 62 | +##### Discussions |
| 63 | +- Follow this track? Yes or No |
| 64 | + - YES! |
| 65 | +- We need to change link to NAISS GH in |
| 66 | + - training pages |
| 67 | + |
| 68 | +#### Arrhenius |
| 69 | +##### Status |
| 70 | +- R is installed |
| 71 | + - only on CPU |
| 72 | +- R-bundles |
| 73 | + - not yet through |
| 74 | + - GCC-MPICH toolchain I/O OpenMPI/5 |
| 75 | +- RStudio |
| 76 | + - not yet through |
| 77 | +- MATLAB (just one version, 2025b so far) |
| 78 | + - perhaps 2026b on GH by course start |
| 79 | +- Julia is installed as 2 versions |
| 80 | + - both on CPU and GPU |
| 81 | + - almost latest |
| 82 | + - newest LTS |
| 83 | + |
| 84 | +##### Discussions |
| 85 | +- Installations |
| 86 | + - MATLAB |
| 87 | + - BC have close contact with Raymond |
| 88 | + - R+RStudio+bundles needed on GPU |
| 89 | + |
| 90 | +- Docs for Arrhenius |
| 91 | + - R+RStudio+bundles |
| 92 | + - Nothing |
| 93 | + - Birgitte talks to Karl J |
| 94 | + - Matlab |
| 95 | + - Basics are there |
| 96 | + - BC can take first step to expand according to HPC2N/UPPMAX etc |
| 97 | + - Julia |
| 98 | + - Basics are there |
| 99 | + - Pedro cheks content and expands with examples perhaps |
| 100 | + |
| 101 | +#### Teachers |
| 102 | +##### Status |
| 103 | +- Rebecca has left |
| 104 | +- Linus has left |
| 105 | + |
| 106 | +##### Discussions |
| 107 | +- Carlos from Mathworks may be contacted for next iteration (earlier contact with Rebecca) |
| 108 | +- Who takes Rebecca's parts? |
| 109 | + - OnDemand (R+matlab) --> Birgitte |
| 110 | + - matlab intro+modules --> Björn |
| 111 | + - Matlab GUI --> Pedro + Björn |
| 112 | +- Matlab batch and cross-nodes: Björn may have input here |
| 113 | +- Who takes Linus' parts in Julia? |
| 114 | + - Pedro takes intro |
| 115 | + - Björn takes packages |
| 116 | +- Other redistributions? |
| 117 | + - Pedro checks and give input to Björn's and Birgitte's part. |
| 118 | + |
| 119 | +- No changes for Richel (as of now)! |
| 120 | + |
| 121 | +#### Improvements from evaluation and own reflections |
| 122 | + |
| 123 | +##### Status + discussion |
| 124 | + |
| 125 | +- [R](https://forms.cloud.microsoft/Pages/AnalysisPage.aspx?AnalyzerToken=gYUW4FOr3fmmsYmBv20YfsRGEQUDXKUw&id=-aZLWjH1Mk-UZzmPGead5I9DA_EX6qtGpq8zJf2ohI1UQVMySUMzMFVDV0VIWkdTUDhZTDZORlNQNy4u) (6 answers): |
| 126 | + - Hardest: batch and interactive with parallel |
| 127 | + - 1/6 do not recommend course (did use COSMOS SENS) |
| 128 | + - Future: |
| 129 | + - COSMOS SENS |
| 130 | + - (instead of using the zip files you provided, where and how to creat .sh file?) |
| 131 | + - fundamental coding strategies in R (treating with dataframes/csv |
| 132 | + - make list of good packages in research |
| 133 | + - opencl (nvidia+AMD GPU programming) |
| 134 | + - Comments |
| 135 | + - I liked the online material about how to **prepare** and get everything set up, which has been my main issue so far. Unfortunately I could not initially run R via the terminal/ssh, so I couldn't do the practicals on batch, but I am sure I can figure it out myself. |
| 136 | + - Teacher: make sure they have started Language console or GUI |
| 137 | + - awesome material and good that you record but could you record during the lectures all of you so we get the exact thing that is thought? i'm also not fond of having to have the camera on which i felt there was pressure to do so i watched most after the course instead |
| 138 | + - different opinions. [Richel] Indeed, should we listen to our own experiences or the literature? |
| 139 | + - broad public of reseachers |
| 140 | + - skip "good for learning" instead say teacher decided to do like this and that?? |
| 141 | + - [Richel] The idea is to motivate the learners. It helps them to know the reasons behind our choices. Sure, everyone can do as they like :+1: |
| 142 | + - Trying to find some Danish literature that discusses this. |
| 143 | + - Key: "Not put pressure on people" |
| 144 | + - Still the teacher decided his/her lesson! |
| 145 | + - Yes, the teacher decides how to do the lesson, |
| 146 | + The issue is that some people feel pressured the way it has been **communicated/announced**. |
| 147 | + - [Richel] Sure, not all will agree and nobody intends to miscommunicate about this, I agree this should be prevented :+1: |
| 148 | +- [MATLAB](https://forms.office.com/Pages/AnalysisPage.aspx?AnalyzerToken=gYUW4FOr3fmmsYmBv20YfsRGEQUDXKUw&id=-aZLWjH1Mk-UZzmPGead5I9DA_EX6qtGpq8zJf2ohI1UMk9UR0FBVkQ3N08zRTVTWFUyNlkwRzJXVS4u) (1): |
| 149 | + - "you have made some really great material. thanx for recording - i didn't feel well to follow the course live so it was good to be able to watch later. I also look forward to watch the advanced session when will that be up?" |
| 150 | + - Future training: parallel matlab batch scripts |
| 151 | + - did not attend add-ons and matlab in jupyter |
| 152 | +- [Julia](https://forms.office.com/Pages/AnalysisPage.aspx?AnalyzerToken=gYUW4FOr3fmmsYmBv20YfsRGEQUDXKUw&id=-aZLWjH1Mk-UZzmPGead5I9DA_EX6qtGpq8zJf2ohI1UMjVDRVpaSDNGTEI5WVBFWVBMQU5HR0dERS4u)(1): |
| 153 | + - "Thanks for recording! I couldn't attend in person and just got time to watch the recordings yesterday, and try out the commands. " |
| 154 | + - environments hardest part |
| 155 | + - notebooks perhaps not checked by learner? |
| 156 | +- Advanced: No answers |
| 157 | + |
| 158 | + |
| 159 | +#### Slightly updated schedule |
| 160 | + |
| 161 | +- Postponed |
| 162 | + - Let's discuss among each days's teachers if one needs more time for a session. |
| 163 | +- Another meeting later? |
| 164 | + - We'll see. Keep in touch in chat room. |
| 165 | + |
| 166 | +#### General comments |
| 167 | + |
| 168 | +- Should the meetings notes be outside the repo? |
| 169 | +- We could create a tarball with everything for the students to download. Not mentioning git clone. |
| 170 | + - exercises must in docs folder to be reached (if repo is made private) |
| 171 | + |
| 172 | +---- |
| 173 | +# Autumn 2025 |
| 174 | + |
| 175 | +- **6-8, 10 October** |
| 176 | +- R: Mon 6 Oktober |
| 177 | +- MATLAB: Tue 7 Oktober |
| 178 | +- Julia: Wed 8 Oktober |
| 179 | +- Advanced: Fri 10 Oct |
| 180 | + |
| 181 | + |
| 182 | +## Next meeting 3 Oct 11.00 |
| 183 | + |
| 184 | +### Goals |
| 185 | + |
| 186 | +- Know about learners |
| 187 | +- Settle advanced day |
| 188 | +- Needs of the other days |
| 189 | + |
| 190 | +### Status |
| 191 | +- Zoom link sent out (decided in chat) |
| 192 | +- Registered 12 (?) |
| 193 | + - language-wise |
| 194 | + - 11 R; 5 matlab; 4 Julia |
| 195 | + - cluster-wise |
| 196 | + - all but C3SE |
| 197 | + |
| 198 | +### General |
| 199 | + |
| 200 | +- Extra material will be shown in the **extra** section of menu. Where tho have **files |
| 201 | + - In ``extra/`` directory |
| 202 | + - [Decided] In ``<language>/``: LS BC BB |
| 203 | + |
| 204 | +- Have we found solution for syntax highlightning? [#238](https://github.com/UPPMAX/R-matlab-julia-HPC/issues/238) |
| 205 | + |
| 206 | +- Images problems |
| 207 | + - esp. on-demand |
| 208 | + - direct urls may be solution and BB looks into it if time |
| 209 | + - trial and error with paths |
| 210 | + - or move to `docs/img` & `<root>/img` |
| 211 | + |
| 212 | +- Please check your pages for missed rst2md links. |
| 213 | + |
| 214 | +- Encourage UPPMAX users to Pelle. Only rackham if they want to finish something very soon and need some ideas. |
| 215 | + |
| 216 | +### Advanced day |
| 217 | + |
| 218 | +- Distributed |
| 219 | + - who teaches (Björn) |
| 220 | +- GPU OK? () |
| 221 | + - julia is missing (Pedro) |
| 222 | +- ML and where to put matlab&julia |
| 223 | + - together NO |
| 224 | + - focus on R & extra material for julia and matlab |
| 225 | + - make a matlab (extra) |
| 226 | + - some intro (see how far we come) BC |
| 227 | + - links to mathworks materials |
| 228 | + - Julia BC make a page |
| 229 | +- Timings [# 225 schedule](https://github.com/UPPMAX/R-matlab-julia-HPC/issues/225) |
| 230 | + |
| 231 | +### Needs |
| 232 | + |
| 233 | +#### R |
| 234 | + |
| 235 | +- all done? |
| 236 | + - Pelle there? #228 |
| 237 | + - BC has updated this morning some sections |
| 238 | + |
| 239 | +- Problem: interactive is missing the R day |
| 240 | + - solution: extend R session 30 min extra by RP |
| 241 | + - change schedule: RP |
| 242 | + - start from [existing page](https://uppmax.github.io/R-matlab-julia-HPC/r/interactive/) |
| 243 | + |
| 244 | +#### Matlab |
| 245 | + |
| 246 | +- all done? |
| 247 | + - pelle #229 |
| 248 | +- schedule |
| 249 | +- Summary by Rebecca |
| 250 | + |
| 251 | +#### Julia |
| 252 | + |
| 253 | +- Interactive session |
| 254 | + - Björn rewrites and includes |
| 255 | +- Check Pelle #230 |
| 256 | +- schedule #227 |
| 257 | + - OK? |
| 258 | +- Björn takes summary |
| 259 | +- evaluation page needed BC |
| 260 | + |
| 261 | + |
| 262 | + |
| 263 | + |
| 264 | +- [Poll/vote: Zoom room URL on HPC clusters?](https://github.com/UPPMAX/R-matlab-julia-HPC/issues/231): |
| 265 | + |
| 266 | + Decided in chat, not to do this. |
| 267 | + |
| 268 | + Currently in this course, we have a login session each day, because we cannot be sure the learners can actually login. |
| 269 | + |
| 270 | + An alternative would be to put the link to the Zoom room on our HPC clusters. |
| 271 | + Me and Björn have done so in another course. |
| 272 | + How ruthless this may sounds, there was little mention on this requirement in |
| 273 | + [the evaluation](https://uppmax.github.io/naiss_file_transfer_course/evaluations/20250905/) |
| 274 | + (sure, there is selection for the people that accept this ruthlessness). |
| 275 | + |
| 276 | + How do we feel about putting the Zoom URL for this course on our HPC clusters? |
| 277 | + |
| 278 | + In that way, we can be (more) sure the learners can actually login. Also, we'll have 1 extra hour of teaching :-) |
| 279 | + |
| 280 | + - Voting option 1: (current setup) Email Zoom room to all learners and have a daily login session: |
| 281 | + - Voting option 2: Put Zoom rooms on HPC clusters: RB |
| 282 | + |
| 283 | + |
| 284 | + |
| 285 | +## Earlier meetings |
| 286 | + |
| 287 | +[Meeting 12 Sep](https://github.com/UPPMAX/R-matlab-julia-HPC/blob/main/meeting_notes/20250912.md) |
| 288 | + |
| 289 | +[All meetings](https://github.com/UPPMAX/R-matlab-julia-HPC/tree/main/meeting_notes) |
0 commit comments