Skip to content

Commit e8697b9

Browse files
kjvbrtJuraj Smiesko
andauthored
Update of DIRAC user workflows (#179)
* Minor fixes * Reviving distributed computing section * Removing unnecesary changes * Recovering image --------- Co-authored-by: Juraj Smiesko <j@kjvbrt.org>
1 parent 06f595b commit e8697b9

8 files changed

Lines changed: 531 additions & 300 deletions

File tree

.gitignore

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,4 +40,4 @@ node_modules
4040
book.pdf
4141
*~
4242
build
43-
venv
43+
venv

5-distributed-computing/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,7 @@ Unless specified otherwise, in the remainder of this section the word `DIRAC` re
2828

2929
```{eval-rst}
3030
.. toctree::
31+
:maxdepth: 2
3132
:caption: Contents:
3233
3334
./EventProducer.md

5-distributed-computing/RegisteringToFccVO.md

Lines changed: 28 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
# Getting Started with DIRAC
1+
# Getting started with FCC distributed computing
22

33
<!-- contributors:start -->
44
:::{admonition} Page contributors
@@ -8,26 +8,29 @@ Gerardo Ganis, Juraj Smiesko, Brieuc Francois
88
:::
99
<!-- contributors:end -->
1010

11+
12+
For more detailed documentation how user's can use the distributed resources
13+
managed by iLCDirac, refer to the iLCDirac's
14+
[User Guide](https://ilcdirac-doc.web.cern.ch/DOC/Files/UserGuide/index.html).
15+
1116
## Registering to the FCC VO
1217

13-
The [standard Grid VO registration procedure][signup]
14-
should be followed to be enable to use the resources connected with the FCC VO (open a request only if you need to).
18+
The [standard Grid VO registration procedure][signup] should be followed to be
19+
able to use the resources connected with the FCC Virtual Organization (VO).
1520
If your request is pending approval for too long, please [contact us](mailto:FCC-PED-SoftwareAndComputing-Coordination@cern.ch).
1621

1722
:::{admonition} Note
1823
:class: callout
1924

20-
You need to use a browser where you have installed your certificate and the
21-
[CERN CA][cernca] certificates. Firefox usually works fine, Google Chrome
22-
usually does not work. Safari might also work.
25+
As for the VO registration, you need to use a browser where you can import your
26+
GRID certificate together with the [CERN CA][cernca] certificates. Firefox
27+
usually works fine, Google Chrome usually does not work. Safari might also work.
2328
:::
2429

25-
[signup]: https://fcc-auth.cern.ch/dashboard#!/newClient
26-
2730
## Enabling DIRAC
2831

2932
DIRAC is available on CernVM-FS. To enable the relevant applications and
30-
scripts, the following setup script needs to be sourced first
33+
scripts, the following setup script needs first to be sourced
3134

3235
```bash
3336
source /cvmfs/clicdp.cern.ch/DIRAC/bashrc
@@ -38,7 +41,9 @@ To submit jobs through DIRAC a proxy needs to be created and uploaded:
3841
```bash
3942
dirac-proxy-init -g fcc_user
4043
```
44+
4145
A successful creation looks like this:
46+
4247
```
4348
Generating proxy...
4449
Enter Certificate password:
@@ -60,11 +65,15 @@ Proxies uploaded:
6065
DN | Group | Until (GMT)
6166
/DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=ganis/CN=393971/CN=Gerardo Ganis | | 2022/05/13 12:12
6267
```
68+
6369
The last section shows the valid proxies upload to the DIRAC system. It can also be checked with
70+
6471
```bash
6572
dirac-proxy-info -m
6673
```
74+
6775
with output similar to
76+
6877
```
6978
subject : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=ganis/CN=393971/CN=Gerardo Ganis/CN=2178341058/CN=3000266373
7079
issuer : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=ganis/CN=393971/CN=Gerardo Ganis/CN=2178341058
@@ -87,12 +96,14 @@ If everything worked fine, your proxy should be mapped to the `fcc001` user. Thi
8796
export EOS_MGM_URL=root://eospublic.cern.ch
8897
XrdSecPROTOCOL=gsi,unix eos whoami
8998
```
99+
90100
the result should look similar to this:
101+
91102
```
92103
Virtual Identity: uid=140035 (99,140035) gid=2855 (99,2855) [authz:gsi] host=lxplus743.cern.ch domain=cern.ch geo-location=0513
93104
```
94105

95-
At CERN the uid of `fcc001` is 140035.
106+
At CERN the uid of `fcc001` is `140035`.
96107

97108
## Copying, browsing, accessing files
98109

@@ -116,7 +127,7 @@ $ ls -lt /eos/experiment/fcc/prod/fcc/user/g/ganis
116127
total 9545
117128
-rw-r--r--. 1 fcc001 fcc-cg 9768981 Nov 3 2021 edm4hep_test_output.root
118129
```
119-
Files can be replicated to another STorage Element, e.g. CNAF-DISK, using
130+
Files can be replicated to another Storage Element, e.g. CNAF-DISK, using
120131
`dirac-dms-replicate-lfn`:
121132
```
122133
$ dirac-dms-replicate-lfn /fcc/user/g/ganis/edm4hep_test_output.root CNAF-DISK
@@ -143,17 +154,13 @@ root [1]
143154

144155
## The web portal
145156

146-
The [DIRAC web portal][diracweb] is available to check the status of things. It shows all the jobs submitted and the
147-
files registered.
157+
The [DIRAC web portal][diracweb] is available to check the status of things. It
158+
shows all the jobs submitted and the files registered. An example screenshot
159+
is shown below.
148160

161+
![ILCDirac Web](images/dirac-web-job-listing.png)
149162

150-
:::{admonition} Note
151-
:class: callout
152-
153-
As for the VO registration, you need to use a browser where you have installed
154-
your certificate and the [CERN CA][cernca] certificates. Firefox usually works
155-
fine, Safari might also work. Google Chrome usually does not work.
156-
:::
157163

158-
[diracweb]: https://voilcdiracwebapp2.cern.ch/DIRAC/?view=tabs&theme=Crisp&url_state=1|*DIRAC.JobMonitor.classes.JobMonitor
164+
[signup]: https://fcc-auth.cern.ch/start-registration
165+
[diracweb]: https://voilcdiracwebapp2.cern.ch/DIRAC/?theme=Classic&url_state=1|*DIRAC.JobMonitor.classes.JobMonitor:,
159166
[cernca]: https://ca.cern.ch/cafiles/certificates/Grid.aspx

5-distributed-computing/Workflows.md

Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,15 +8,22 @@ Gerardo Ganis, Juraj Smiesko
88
:::
99
<!-- contributors:end -->
1010

11-
These pages provide - and dissect - examples of workflows to be run on distributed resources with the [DIRAC Interware system][dirac].
11+
>
12+
> Original author: Gerardo Ganis
13+
>
1214
13-
The python scripts discussed in these pages are available at [https://github.com/HEP-FCC/FCCDIRAC][fccdirac].
15+
These pages provide &mdash; and dissect &mdash; examples of workflows to be run
16+
on distributed resources of FCC with the [DIRAC Interware system][dirac].
17+
18+
The python scripts discussed in these pages are available at
19+
[https://github.com/HEP-FCC/FCCDIRAC][fccdirac].
1420

1521
[dirac]: https://dirac.readthedocs.io/en/latest/
16-
[fccdirac]: https://github.com/HEP-FCC/FCCDIRAC
22+
[fccdirac]: https://github.com/HEP-FCC/FCCDIRAC/tree/master/workflows
1723

1824
```{eval-rst}
1925
.. toctree::
26+
:maxdepth: 2
2027
:caption: Contents:
2128
2229
workflows/Overview.md
758 KB
Loading

0 commit comments

Comments
 (0)