Skip to content

Commit 4806295

Browse files
authored
Merge pull request #13 from Health-Informatics-UoN/Separate-wizard-docs
Moved wizard docs to separate section
2 parents cdc9eb4 + 6052c57 commit 4806295

17 files changed

Lines changed: 98 additions & 32 deletions

observablehq.config.js

Lines changed: 17 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -22,15 +22,28 @@ export default {
2222
path: "/examples-in-five-safes-tes",
2323
open: false,
2424
pages: [
25+
2526
{name: "Submitting to Five Safes TES", path: "/examples-in-five-safes-tes/submitting-to-5s-tes"},
26-
{name: "Submission layer wizards", path: "/examples-in-five-safes-tes/submission-layer-wizards"},
27+
{name: "Running arbitrary containers", path: "/examples-in-five-safes-tes/Running arbitrary containers"},
2728
{name: "Collecting results", path: "/examples-in-five-safes-tes/collecting-results"},
28-
{name: "Visualising OMOP metadata", path: "/examples-in-five-safes-tes/Bunny visualisations"},
29-
{name: "Aggregating statistics", path: "/examples-in-five-safes-tes/aggregating-statistics"},
30-
{name: "Contingency tables", path: "/examples-in-five-safes-tes/contingency-tables"},
3129
{name: "Five Safes TES messages", path: "/examples-in-five-safes-tes/5s-tes-messages"},
30+
31+
]
32+
},
33+
{
34+
name: "Wizard examples",
35+
path: "/wizard-examples",
36+
open: false,
37+
pages: [
38+
{name: "Making a submission through the Web application", path: "/wizard-examples/making-a-submission-through-the-web-application"},
39+
{name: "Submission layer wizards", path: "/wizard-examples/submission-layer-wizards"},
40+
{name: "Visualising OMOP metadata", path: "/wizard-examples/Bunny visualisations"},
41+
{name: "Aggregating statistics", path: "/wizard-examples/aggregating-statistics"},
42+
{name: "Contingency tables", path: "/wizard-examples/contingency-tables"},
43+
3244
]
3345
}
46+
3447
],
3548

3649
// Content to add to the head of the page, e.g. for a favicon:

src/examples-in-five-safes-tes.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,7 @@ The [Global Alliance for Genomics and Health](https://www.ga4gh.org/) (GA4GH) [T
2727
TES works by sending a standard format of HTTP requests to a server, which interprets these requests to run some task in its environment.
2828
<div class="tip">
2929

30-
You do not need to know how to write this format to use 5s-TES, which has [tools](examples-in-five-safes-tes/submission-layer-wizards) to help you.
30+
You do not need to know how to write this format to use 5s-TES, which has [tools](/wizard-examples/submission-layer-wizards) to help you.
3131

3232
</div>
3333

src/examples-in-five-safes-tes/5s-tes-messages.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,12 +8,12 @@ title: Five Safes TES messages
88

99
<div class="tip">
1010

11-
The information included here is not essential, but can help you understand what's going under the hood of tools like [the wizards](examples-in-five-safes-tes/submission-layer-wizards)
11+
The information included here is not essential, but can help you understand what's going under the hood of tools like [the wizards](/wizard-examples/submission-layer-wizards)
1212

1313
</div>
1414

1515
The reference documentation for TES messages specifies the standard for [creating a task](https://ga4gh.github.io/task-execution-schemas/docs/#tag/TaskService/operation/CreateTask).
16-
5s-TES accepts this format, but some fields are treated differently because of how the [submission layer](examples-in-five-safes-tes#submission-layer) processes messages before they're sent to a TES engine.
16+
5s-TES accepts this format, but some fields are treated differently because of how the [submission layer](/examples-in-five-safes-tes#submission-layer) processes messages before they're sent to a TES engine.
1717

1818
## TES fields
1919

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
theme: air
3+
style: ../entrust-style.css
4+
title: Submission layer wizards
5+
---
6+
7+
# Running arbitrary containers
8+
Five safes TES can run arbitrary containers, as long as the TRE can and will run them. This means that any analysis can be performed on a TRE.
9+
10+
In order to do this, you have to prepare a containerised version of the software you want to run. Typically, this may be a script such as python or R code, but can be any language or any tool. We do not currently support languages or tools which require external connections, such as to licence servers.
11+
12+
To containerise a script or tool in this way, the software must be executable from the command line. Arguments can be passed in at runtime using the TES messages. The command line arguments will be used in the `command` section of the `executors` in the TES message. A script will have access to input data passed in through the TES message (through mounted filepaths specified in the inputs, if any) and output data by writing files to the output path specified in the outputs section of the TES message. We recommend using /inputs and /outputs where possible.
13+
14+
The following is a list of environment variables which are used by Five Safes TES. This is primarily of interest as it outlines the names of the variables required for a connection string to the database, which is likely to be required to connect the container to the database. These variables will overwrite any that are passed through the TES message, as they are added by the submission layer.
15+
```
16+
"Any"
17+
"CATALOG"
18+
"SCHEMA"
19+
"myapi2"
20+
"myapikey"
21+
"postgresDatabase"
22+
"postgresPassword"
23+
"postgresPort"
24+
"postgresSchema"
25+
"postgresServer"
26+
"postgresUsername"
27+
"submissionId"
28+
"test"
29+
"trinoPassword"
30+
"trinoURL"
31+
"trinoUsername"
32+
```
33+
34+
Once your script or tool is ready, it must be built into a [docker container.](https://docs.docker.com/get-started/docker-concepts/building-images/writing-a-dockerfile/) The container also should be published so it can be accessed by the TRE. A simple way to publish to an accessible location is using [github.](https://docs.github.com/en/packages/working-with-a-github-packages-registry/working-with-the-container-registry?utm_source=chatgpt.com)
35+
36+
TREs can then approve and copy the container locally, to be usable on request (through a TES message). This means you can then submit a TES message to run the new image on the TRE.

src/examples-in-five-safes-tes/collecting-results.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ title: Collecting results
44
---
55
# Collecting results
66

7-
These instructions assume you have [submitted a task](submitting-to-5s-tes) using one of [the wizards](submission-layer-wizards).
7+
These instructions assume you have [submitted a task](submitting-to-5s-tes).
88

99
When you have submitted a task, you have to wait for your results to be ready to collect.
1010
If you navigate back to the view of the Submissions to a project from which you can start a wizard, you can view past submissions.

src/examples-in-five-safes-tes/submitting-to-5s-tes.md

Lines changed: 0 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -67,19 +67,3 @@ The time and date at which your current token expires are shown above the token
6767
</div>
6868

6969

70-
## Making a submission through the Web application
71-
As each submission is associated with a project, you make your submissions in the web application by first navigating to the projects view.
72-
![A screenshot of the web application, highlighting the link to the projects view](./project-in-ribbon.png)
73-
In the projects view, you can then select a project you are assigned to.
74-
75-
When you are in the project, you can select the Submissions view.
76-
![A screenshot of a project, highlighting the link to the submissions](./view-of-project.png)
77-
78-
In the Submissions view, you will be shown a button to make a new submission.
79-
Clicking the Create Submission button will give you the options
80-
81-
- TES wizard
82-
- GraphQL TES wizard
83-
![A screenshot of the Submissions view, hightlighting the button used for the wizards](./submissions-view.png)
84-
85-
[The TES wizard](submission-layer-wizards) can help you make a submission

src/wizard-examples.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
---
2+
theme: air
3+
style: entrust-style.css
4+
title: Wizard examples
5+
---
6+
7+
# Wizard examples
8+
9+
These pages walk through the submission-layer wizards in the Five Safes TES web application: choosing a wizard, filling in TES details, and submitting a task.
10+
11+
Use the links in the sidebar for step-by-step topics, or start with [Submission layer wizards](wizard-examples/submission-layer-wizards).

src/examples-in-five-safes-tes/Bunny visualisations.md renamed to src/wizard-examples/Bunny visualisations.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ title: Visualising Bunny Outputs
77
This tutorial can be run as a Jupyter notebook in the [5s-TES notebooks repository](https://github.com/Health-Informatics-UoN/5s-TES-notebooks/tree/main/OMOP-metadata), which also contains the utilities used to visualise OMOP metadata.
88

99
There are two examples of outputs from a Bunny distribution query included in the test data.
10-
This kind of data can be obtained from Five Safes TES (5STES) by submitting a TES message, which can be created by using the [custom image wizard](submission-layer-wizards#custom-image):
10+
This kind of data can be obtained from Five Safes TES (5STES) by submitting a TES message, which can be created by using the [custom image wizard](/wizard-examples/submission-layer-wizards#custom-image):
1111
![Screenshot of the custom image wizard running a bunny query](./bunny-custom-image-wizard.png)
1212

1313
The settings need to be:

src/examples-in-five-safes-tes/aggregating-statistics.md renamed to src/wizard-examples/aggregating-statistics.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ The outputs from TES tasks can be easily used to calculate basic statistics.
1212
This example will use summary statistics from a dataset in the OMOP common data model.
1313
There is a container which, given a SQL query that filters an OMOP table by your criteria, will calculate the necessary summary statistics for your final analysis.
1414

15-
This example data was collected using the [Custom Image wizard](submission-layer-wizards#custom-image) in the submission layer with these settings changed from default:
15+
This example data was collected using the [Custom Image wizard](/wizard-examples/submission-layer-wizards#custom-image) in the submission layer with these settings changed from default:
1616

1717
| Field | value |
1818
| ------- | ------------------------------------------------------------------------------ |

src/examples-in-five-safes-tes/bunny-custom-image-wizard.png renamed to src/wizard-examples/bunny-custom-image-wizard.png

File renamed without changes.

0 commit comments

Comments
 (0)