Skip to content

Commit d273c34

Browse files
sbernauersbernauer
authored
Merge branch 'main' into chore/improve-monitoring-stack
2 parents 4a2b1f2 + 4b4ab10 commit d273c34

8 files changed

Lines changed: 51 additions & 44 deletions

‎demos/demos-v2.yaml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -218,7 +218,6 @@ demos:
218218
- nifi
219219
- jupyterhub
220220
- grafana-dashboards
221-
- zookeeper
222221
manifests:
223222
- plainYaml: https://raw.githubusercontent.com/stackabletech/demos/main/demos/signal-processing/serviceaccount.yaml
224223
- plainYaml: https://raw.githubusercontent.com/stackabletech/demos/main/demos/signal-processing/create-timescale-tables.yaml

‎demos/nifi-kafka-druid-water-level-data/create-druid-ingestion-job.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,6 +190,6 @@ data:
190190
],
191191
"targetRowsPerSegment": 5000000
192192
},
193-
"maxNumSegmentsToMerge": 500,
193+
"maxNumSegmentsToMerge": 500
194194
}
195195
}

‎docs/modules/demos/pages/hbase-hdfs-load-cycling-data.adoc‎

Lines changed: 30 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -52,26 +52,31 @@ To list the installed Stackable services run the following command: `stackablect
5252
----
5353
$ stackablectl stacklet list
5454
55-
┌───────────┬───────────┬───────────┬──────────────────────────────────────────────────────────────┬─────────────────────────────────┐
56-
│ PRODUCT ┆ NAME ┆ NAMESPACE ┆ ENDPOINTS ┆ CONDITIONS │
57-
╞═══════════╪═══════════╪═══════════╪══════════════════════════════════════════════════════════════╪═════════════════════════════════╡
58-
│ hbase ┆ hbase ┆ default ┆ regionserver 172.18.0.2:31521 ┆ Available, Reconciling, Running │
59-
│ ┆ ┆ ┆ ui-http 172.18.0.2:32064 ┆ │
60-
│ ┆ ┆ ┆ metrics 172.18.0.2:31372 ┆ │
61-
├╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
62-
│ hdfs ┆ hdfs ┆ default ┆ datanode-default-0-listener-data 172.18.0.2:31990 ┆ Available, Reconciling, Running │
63-
│ ┆ ┆ ┆ datanode-default-0-listener-http http://172.18.0.2:30659 ┆ │
64-
│ ┆ ┆ ┆ datanode-default-0-listener-ipc 172.18.0.2:30678 ┆ │
65-
│ ┆ ┆ ┆ datanode-default-0-listener-metrics 172.18.0.2:31531 ┆ │
66-
│ ┆ ┆ ┆ namenode-default-0-http http://172.18.0.2:32543 ┆ │
67-
│ ┆ ┆ ┆ namenode-default-0-metrics 172.18.0.2:30098 ┆ │
68-
│ ┆ ┆ ┆ namenode-default-0-rpc 172.18.0.2:30915 ┆ │
69-
│ ┆ ┆ ┆ namenode-default-1-http http://172.18.0.2:31333 ┆ │
70-
│ ┆ ┆ ┆ namenode-default-1-metrics 172.18.0.2:30862 ┆ │
71-
│ ┆ ┆ ┆ namenode-default-1-rpc 172.18.0.2:31440 ┆ │
72-
├╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
73-
│ zookeeper ┆ zookeeper ┆ default ┆ ┆ Available, Reconciling, Running │
74-
└───────────┴───────────┴───────────┴──────────────────────────────────────────────────────────────┴─────────────────────────────────┘
55+
┌───────────┬───────────┬───────────┬───────────────────────────────────────────────────────────────────────────────────────────────┬─────────────────────────────────┐
56+
│ PRODUCT ┆ NAME ┆ NAMESPACE ┆ ENDPOINTS ┆ CONDITIONS │
57+
╞═══════════╪═══════════╪═══════════╪═══════════════════════════════════════════════════════════════════════════════════════════════╪═════════════════════════════════╡
58+
│ hbase ┆ hbase ┆ default ┆ master-default-0-listener-master 172.19.0.5:32001 ┆ Available, Reconciling, Running │
59+
│ ┆ ┆ ┆ master-default-0-listener-ui-http http://172.19.0.5:30709 ┆ │
60+
│ ┆ ┆ ┆ regionserver-default-0-listener-regionserver 172.19.0.4:32684 ┆ │
61+
│ ┆ ┆ ┆ regionserver-default-0-listener-ui-http http://172.19.0.4:31899 ┆ │
62+
│ ┆ ┆ ┆ regionserver-default-1-listener-regionserver 172.19.0.5:30604 ┆ │
63+
│ ┆ ┆ ┆ regionserver-default-1-listener-ui-http http://172.19.0.5:30274 ┆ │
64+
│ ┆ ┆ ┆ restserver-default-0-rest-http 172.19.0.5:32590 ┆ │
65+
│ ┆ ┆ ┆ restserver-default-0-ui-http http://172.19.0.5:31997 ┆ │
66+
├╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
67+
│ hdfs ┆ hdfs ┆ default ┆ datanode-default-0-listener-data 172.19.0.4:30883 ┆ Available, Reconciling, Running │
68+
│ ┆ ┆ ┆ datanode-default-0-listener-http http://172.19.0.4:32095 ┆ │
69+
│ ┆ ┆ ┆ datanode-default-0-listener-ipc 172.19.0.4:30086 ┆ │
70+
│ ┆ ┆ ┆ datanode-default-0-listener-metrics 172.19.0.4:31954 ┆ │
71+
│ ┆ ┆ ┆ namenode-default-0-http http://172.19.0.4:32035 ┆ │
72+
│ ┆ ┆ ┆ namenode-default-0-metrics 172.19.0.4:30468 ┆ │
73+
│ ┆ ┆ ┆ namenode-default-0-rpc 172.19.0.4:31966 ┆ │
74+
│ ┆ ┆ ┆ namenode-default-1-http http://172.19.0.5:31952 ┆ │
75+
│ ┆ ┆ ┆ namenode-default-1-metrics 172.19.0.5:32760 ┆ │
76+
│ ┆ ┆ ┆ namenode-default-1-rpc 172.19.0.5:32022 ┆ │
77+
├╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
78+
│ zookeeper ┆ zookeeper ┆ default ┆ server-zk zookeeper-server.default.svc.cluster.local:2282 ┆ Available, Reconciling, Running │
79+
└───────────┴───────────┴───────────┴───────────────────────────────────────────────────────────────────────────────────────────────┴─────────────────────────────────┘
7580
7681
----
7782

@@ -159,7 +164,8 @@ Took 13.4666 seconds
159164

160165
== Inspecting the Table
161166

162-
You can now use the table and the data. You can use all available HBase shell commands.
167+
You can now use the table and the data.
168+
You can use all available HBase shell commands.
163169

164170
[source,sql]
165171
----
@@ -192,10 +198,11 @@ COLUMN FAMILIES DESCRIPTION
192198
[TIP]
193199
====
194200
Run `stackablectl stacklet list` to get the address of the _ui-http_ endpoint.
195-
If the UI is unavailable, do a port-forward `kubectl port-forward hbase-master-default-0 16010`.
201+
Depending on the type of listener class that has been defined, the address will either be directly reachable via e.g. the NodePort IP and an externally reachable port, or via a port-forward (with e.g. `kubectl port-forward hbase-master-default-0 16010`).
196202
====
197203

198-
The HBase web UI will give you information on the status and metrics of your HBase cluster. See below for the start page.
204+
The HBase web UI will give you information on the status and metrics of your HBase cluster.
205+
See below for the start page.
199206

200207
image::hbase-hdfs-load-cycling-data/hbase-ui-start-page.png[]
201208

‎docs/modules/demos/pages/jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data.adoc‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,7 @@
1212
:jupyter: https://jupyter.org
1313
:spark-connect: https://spark.apache.org/docs/latest/spark-connect-overview.html
1414
:spark-connect-client: https://github.com/stackabletech/docker-images/blob/main/spark-connect-client/Dockerfile
15+
:repo-url: https://github.com/stackabletech/demos
1516

1617
This demo showcases the integration between {jupyterlab}[JupyterLab], {spark-connect}[Spark Connect] and {hadoop}[Apache Hadoop] deployed on the Stackable Data Platform (SDP) Kubernetes cluster.
1718
The SDP makes this integration easy by publishing a discovery ConfigMap for the HDFS cluster and a Spark Connect service.
@@ -115,7 +116,7 @@ image::jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data/jupyterlab_login.png[
115116
Log in with token `adminadmin`.
116117
You should arrive at your workspace:
117118

118-
image::jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data/jupyterlab_workspace.png[]
119+
image::jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data/jupyterlab_workspace.png[link={repo-url}/blob/{page-origin-refname}/stacks/jupyterhub-pyspark-hdfs/notebook.ipynb,linktarget=_blank,alt="JupyterLab Notebook"]
119120

120121
Now you can double-click on the `notebook` folder on the left, open and run the contained file.
121122
Click on the double arrow (⏩️) to execute the Python scripts (click on the image above to go to the notebook file).

‎docs/modules/demos/pages/logging.adoc‎

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -63,13 +63,15 @@ To list the installed Stackable services run the following command:
6363
[source,console]
6464
----
6565
$ stackablectl stacklet list
66-
┌───────────────────────┬───────────────────────┬───────────┬───────────────────────────────┬─────────────────────────────────┐
67-
│ PRODUCT ┆ NAME ┆ NAMESPACE ┆ ENDPOINTS ┆ CONDITIONS │
68-
╞═══════════════════════╪═══════════════════════╪═══════════╪═══════════════════════════════╪═════════════════════════════════╡
69-
│ zookeeper ┆ simple-zk ┆ default ┆ ┆ Available, Reconciling, Running │
70-
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
71-
│ opensearch-dashboards ┆ opensearch-dashboards ┆ default ┆ http http://172.18.0.2:30595 ┆ │
72-
└───────────────────────┴───────────────────────┴───────────┴───────────────────────────────┴─────────────────────────────────┘
66+
┌───────────────────────┬───────────────────────┬───────────┬─────────────────────────────────────────────────┬─────────────────────────────────┐
67+
│ PRODUCT ┆ NAME ┆ NAMESPACE ┆ ENDPOINTS ┆ CONDITIONS │
68+
╞═══════════════════════╪═══════════════════════╪═══════════╪═════════════════════════════════════════════════╪═════════════════════════════════╡
69+
│ zookeeper ┆ simple-zk ┆ default ┆ server-zk ┆ Available, Reconciling, Running │
70+
│ ┆ ┆ ┆ simple-zk-server.default.svc.cluster.local:2282 ┆ │
71+
├╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┼╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌╌┤
72+
│ opensearch-dashboards ┆ opensearch-dashboards ┆ default ┆ http http://172.18.0.2:31734 ┆ │
73+
│ ┆ ┆ ┆ metrics 172.18.0.2:32120 ┆ │
74+
└───────────────────────┴───────────────────────┴───────────┴─────────────────────────────────────────────────┴─────────────────────────────────┘
7375
----
7476

7577
include::partial$instance-hint.adoc[]

0 commit comments

Comments
 (0)