Skip to content

Commit 99e8c36

Browse files
committed
add wasabi and osdf links
1 parent 71f7267 commit 99e8c36

2 files changed

Lines changed: 49 additions & 211 deletions

File tree

hands-on/session II/1.Tutorial.ipynb

Lines changed: 16 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
"In this tutorial, you will learn how to:\n",
1111
"\n",
1212
"* Build a modular workflow integrating your application module with NSDF services for data visualization and analysis.\n",
13-
"* Load and store intermediate data from/to public storage options like Dataverse and from/to private storage such as Seal Storage.\n",
13+
"* Load and store intermediate data from/to public storage options like Dataverse and from/to private storage such as Wasabi.\n",
1414
"* Use the NSDF dashboard for data visualization and analysis. The analysis includes zooming into data for detailed analysis, cropping subregions, and saving them locally in a Python-compatible format.\n",
1515
"\n",
1616
"### **DISCLAIMER:** Please **DO NOT *Run All Cells*** because different paths can be executed leading to the same outcome"
@@ -33,7 +33,7 @@
3333
"\n",
3434
"**Step 4. Interactive Visualization and Analysis:** The last step launches a dashboard that allows users to work on large-scale data, extract and save subregions of the original dataset, and study and extract features. \n",
3535
"\n",
36-
"Throughout these steps, the workflow incorporates the use of public storage services (e.g., Dataverse, CyVerse) and private storage providers (e.g., Seal Storage, S3 AWS, IBM Cloud Object Storage). These services are connected to the conversion, visualization, and analysis steps, highlighting their crucial role in this tutorial's data processing and transformation steps.\n",
36+
"Throughout these steps, the workflow incorporates the use of public storage services (e.g., Dataverse, CyVerse) and private storage providers (e.g., Wasabi, S3 AWS, IBM Cloud Object Storage). These services are connected to the conversion, visualization, and analysis steps, highlighting their crucial role in this tutorial's data processing and transformation steps.\n",
3737
"\n",
3838
"\n",
3939
"<div>\n",
@@ -568,7 +568,7 @@
568568
"source": [
569569
"## -> Step 3: Static Visualization\n",
570570
"\n",
571-
"After the data has been generated, transformed into the correct format, and compressed, we proceed to validate the data by using Openvisus to visualize it. For this validation step, you can have data locally (Option A) or grab the IDX files previously stored from remote storage (Option B). For this specific example, we are using Seal Storage. "
571+
"After the data has been generated, transformed into the correct format, and compressed, we proceed to validate the data by using Openvisus to visualize it. For this validation step, you can have data locally (Option A) or grab the IDX files previously stored from remote storage (Option B). For this specific example, we are using Wasabi. "
572572
]
573573
},
574574
{
@@ -735,17 +735,17 @@
735735
"id": "92d18e6e",
736736
"metadata": {},
737737
"source": [
738-
"### -> Option B: Loading the Dataset from Seal Storage\n",
738+
"### -> Option B: Loading the Dataset from Wasabi\n",
739739
"\n",
740-
"For this option, the IDX dataset is uploaded into the dashboard from a private archive that has been previously generated and stored in Seal Storage."
740+
"For this option, the IDX dataset is uploaded into the dashboard from a private archive that has been previously generated and stored in Wasabi."
741741
]
742742
},
743743
{
744744
"cell_type": "markdown",
745745
"id": "5975cb46",
746746
"metadata": {},
747747
"source": [
748-
"The following cell establishes a connection with a private storage service such as Seal Storage and downloads previously generated IDX files."
748+
"The following cell establishes a connection with a private storage service such as Wasabi and downloads previously generated IDX files."
749749
]
750750
},
751751
{
@@ -756,20 +756,20 @@
756756
"outputs": [],
757757
"source": [
758758
"filename = \"Tennessee_terrain_parameters.idx\"\n",
759-
"HOME_DIR = \"s3://utah/nasa/climate_utah/somospie/\" # DONOT change this line\n",
759+
"HOME_DIR = \"s3://scientistcloud/utk/nsdf_somospie/\" # DONOT change this line\n",
760760
"data_dir = \"terrain_tennessee/\"\n",
761761
"upload_dir = HOME_DIR + data_dir\n",
762762
"s3_path = upload_dir.split(\"://\")[1]\n",
763763
"s3_path += filename\n",
764764
"remote_dir = (\n",
765-
" \"https://maritime.sealstorage.io/api/v0/s3/\"\n",
765+
" \"https://s3.us-east-1.wasabisys.com/\"\n",
766766
" + s3_path\n",
767-
" + \"?access_key=any&secret_key=any&endpoint_url=https://maritime.sealstorage.io/api/v0/s3&cached=arco\"\n",
767+
" + \"?access_key=any&secret_key=any&endpoint_url=https://s3.us-east-1.wasabisys.com&cached=arco\"\n",
768768
")\n",
769769
"\n",
770770
"db = ov.LoadDataset(remote_dir)\n",
771771
"\n",
772-
"print(\"You have successfully downloaded the IDX files from Seal Storage.\")"
772+
"print(\"You have successfully downloaded the IDX files from Wasabi.\")"
773773
]
774774
},
775775
{
@@ -985,9 +985,9 @@
985985
"id": "d01cc449",
986986
"metadata": {},
987987
"source": [
988-
"#### -> Option B. Load dataset from Seal Storage\n",
988+
"#### -> Option B. Load dataset from Wasabi\n",
989989
"\n",
990-
"This cell uploads data from a Seal Storage as input in the dashboard. "
990+
"This cell uploads data from a Wasabi as input in the dashboard. "
991991
]
992992
},
993993
{
@@ -997,7 +997,7 @@
997997
"metadata": {},
998998
"outputs": [],
999999
"source": [
1000-
"URL = \"https://maritime.sealstorage.io/api/v0/s3/utah/nasa/climate_utah/somospie/tennessee_30m_terrain/Tennessee_terrain_parameters.idx?access_key=any&secret_key=any&endpoint_url=https://maritime.sealstorage.io/api/v0/s3&cached=arco\"\n",
1000+
"URL = \"https://s3.us-east-1.wasabisys.com/scientistcloud/utk/nsdf_somospie/terrain_tennessee/Tennessee_terrain_parameters.idx?access_key=PGRPNZO8ID956Y0I37JN&secret_key=6RaEChWWzSGPFPiZLNcGyGJzDtWES1l7z7K6elue&endpoint_url=https://s3.us-east-1.wasabisys.com&cached=arco\"\n",
10011001
"print(\"You have successfully loaded the IDX Tennessee data from remote storage.\")"
10021002
]
10031003
},
@@ -1036,7 +1036,7 @@
10361036
"source": [
10371037
"### -> Geographical Region: Contiguous United States\n",
10381038
"\n",
1039-
"For the second data scenario, you can interact with geospatial data in IDX format from the Contiguous United States without storing this large dataset locally. The dashboard directly streams the data from remote storage, in this case, Seal Storage. You can interact with the data through the NSDF dashboard, zoom in, and select specific subregions of interest to download on your local machine. "
1039+
"For the second data scenario, you can interact with geospatial data in IDX format from the Contiguous United States without storing this large dataset locally. The dashboard directly streams the data from remote storage, in this case, Wasabi. You can interact with the data through the NSDF dashboard, zoom in, and select specific subregions of interest to download on your local machine. "
10401040
]
10411041
},
10421042
{
@@ -1046,7 +1046,7 @@
10461046
"metadata": {},
10471047
"outputs": [],
10481048
"source": [
1049-
"URL = \"https://maritime.sealstorage.io/api/v0/s3/utah/nasa/climate_utah/somospie/conus_30m_terrain/CONUS_30m_Terrain_Parameters.idx?access_key=any&secret_key=any&endpoint_url=https://maritime.sealstorage.io/api/v0/s3&cached=arco\"\n",
1049+
"URL = \"https://s3.us-east-1.wasabisys.com/scientistcloud/utk/nsdf_somospie/conus_30m_terrain/CONUS_30m_Terrain_Parameters.idx?access_key=PGRPNZO8ID956Y0I37JN&secret_key=6RaEChWWzSGPFPiZLNcGyGJzDtWES1l7z7K6elue&endpoint_url=https://s3.us-east-1.wasabisys.com&cached=arco\"\n",
10501050
"\n",
10511051
"print(\"You have successfully loaded the IDX CONUS data from remote storage.\")"
10521052
]
@@ -1099,7 +1099,7 @@
10991099
"\n",
11001100
"* NSF through the awards 2138811, 2103845, 2334945, and 2331152.\n",
11011101
"* The Dataverse team [link](https://dataverse.org/about)\n",
1102-
"* The Seal Storage team [link](https://www.sealstorage.io/home/#team)\n",
1102+
"* Wasabi Storage [link](https://wasabi.com/)\n",
11031103
"* Vargas Lab led by Dr. Rodrigo Vargas [link](https://www.udel.edu/academics/colleges/canr/departments/plant-and-soil-sciences/faculty-staff/rodrigo-vargas/)\n",
11041104
"\n",
11051105
"\n",

hands-on/session III/3.Tutorial_PetascaleAnalysis.ipynb

Lines changed: 33 additions & 195 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)