Skip to content

Commit 9e8a098

Browse files
committed
Initial commit (#406)
1 parent 3acf433 commit 9e8a098

2 files changed

Lines changed: 55 additions & 22 deletions

File tree

docs/modules/superset/pages/getting_started/installation.adoc

Lines changed: 11 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,21 +1,21 @@
11
= Installation
22

3-
On this page you will install the Stackable Superset Operator as well as the commons and secret Operator which are required by all Stackable Operators.
3+
On this page you will install the Stackable Superset Operator as well as the commons and secret Operator which are
4+
required by all Stackable Operators.
45

56
== Stackable Operators
67

78
There are 2 ways to run Stackable Operators
89

9-
1. Using xref:stackablectl::index.adoc[]
10-
11-
2. Using Helm
10+
. Using xref:management:stackablectl:index.adoc[]
11+
. Using Helm
1212

1313
=== stackablectl
1414

15-
stackablectl is the command line tool to interact with Stackable operators and our recommended way to install Operators.
16-
Follow the xref:stackablectl::installation.adoc[installation steps] for your platform.
15+
`stackablectl` is the command line tool to interact with Stackable operators and our recommended way to install
16+
Operators. Follow the xref:management:stackablectl:installation.adoc[installation steps] for your platform.
1717

18-
After you have installed stackablectl run the following command to install all Operators necessary for Superset:
18+
After you have installed `stackablectl`, run the following command to install all Operators necessary for Superset:
1919

2020
[source,bash]
2121
----
@@ -30,7 +30,8 @@ The tool will show
3030
[INFO ] Installing superset operator
3131
----
3232

33-
TIP: Consult the xref:stackablectl::quickstart.adoc[] to learn more about how to use stackablectl. For example, you can use the `-k` flag to create a Kubernetes cluster with link:https://kind.sigs.k8s.io/[kind].
33+
TIP: Consult the xref:management:stackablectl:quickstart.adoc[] to learn more about how to use `stackablectl`. For
34+
example, you can use the `--cluster kind` flag to create a Kubernetes cluster with link:https://kind.sigs.k8s.io/[kind].
3435

3536
=== Helm
3637

@@ -46,7 +47,8 @@ Then install the Stackable Operators:
4647
include::example$getting_started/getting_started.sh[tag=helm-install-operators]
4748
----
4849

49-
Helm will deploy the Operators in a Kubernetes Deployment and apply the CRDs for the Superset service (as well as the CRDs for the required operators). You are now ready to deploy Superset in Kubernetes.
50+
Helm will deploy the Operators in a Kubernetes Deployment and apply the CRDs for the Superset service (as well as the
51+
CRDs for the required operators). You are now ready to deploy Superset in Kubernetes.
5052

5153
== What's next
5254

docs/modules/superset/pages/index.adoc

Lines changed: 44 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -2,55 +2,86 @@
22
:description: The Stackable Operator for Apache Superset is a Kubernetes operator that can manage Apache Superset clusters. Learn about its features, resources, dependencies and demos, and see the list of supported Superset versions.
33
:keywords: Stackable Operator, Apache Superset, Kubernetes, operator, data science, data exploration, SQL, engineer, big data, CRD, StatefulSet, ConfigMap, Service, Druid, Trino, S3, demo, version
44

5-
The Stackable Operator for Apache Superset is an operator that can deploy and manage https://superset.apache.org/[Apache Superset] clusters on Kubernetes. Superset is a data exploration and visualization tool that connects to data sources via SQL. Store your data in Apache Druid or Trino, and manage your Druid and Trino instances with the Stackable Operators for xref:druid:index.adoc[Apache Druid] or xref:trino:index.adoc[Trino]. This operator helps you manage your Superset instances on Kubernetes efficiently.
5+
The Stackable Operator for Apache Superset is an operator that can deploy and manage https://superset.apache.org/[Apache
6+
Superset] clusters on Kubernetes. Superset is a data exploration and visualization tool that connects to data sources
7+
via SQL. Store your data in Apache Druid or Trino, and manage your Druid and Trino instances with the Stackable
8+
Operators for xref:druid:index.adoc[Apache Druid] or xref:trino:index.adoc[Trino]. This operator helps you manage your
9+
Superset instances on Kubernetes efficiently.
610

711
== Getting started
812

9-
Get started using Superset with Stackable Operator by following the xref:getting_started/index.adoc[]. It guides you through installing the Operator alongside a PostgreSQL database, connecting to your Superset instance and analyzing some preloaded example data.
13+
Get started using Superset with Stackable Operator by following the xref:getting_started/index.adoc[]. It guides you
14+
through installing the Operator alongside a PostgreSQL database, connecting to your Superset instance and analyzing some
15+
preloaded example data.
1016

1117
== Resources
1218

13-
The Operator manages three https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/[custom resources]: The _SupersetCluster_, _SupersetDB_ and _DruidConnection_. It creates a number of different Kubernetes resources based on the custom resources.
19+
The Operator manages three https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/[custom
20+
resources]: The _SupersetCluster_, _SupersetDB_ and _DruidConnection_. It creates a number of different Kubernetes
21+
resources based on the custom resources.
1422

1523
=== Custom resources
1624

17-
The SupersetCluster is the main resource for the configuration of the Superset instance. The resource defines only one xref:concepts:roles-and-role-groups.adoc[role], the `node`. The various configuration options are explained in the xref:usage-guide/index.adoc[]. It helps you tune your cluster to your needs by configuring xref:usage-guide/storage-resource-configuration.adoc[resource usage], xref:usage-guide/security.adoc[security], xref:usage-guide/logging.adoc[logging] and more.
25+
The SupersetCluster is the main resource for the configuration of the Superset instance. The resource defines only one
26+
xref:concepts:roles-and-role-groups.adoc[role], the `node`. The various configuration options are explained in the
27+
xref:usage-guide/index.adoc[]. It helps you tune your cluster to your needs by configuring
28+
xref:usage-guide/storage-resource-configuration.adoc[resource usage], xref:usage-guide/security.adoc[security],
29+
xref:usage-guide/logging.adoc[logging] and more.
1830

19-
When a SupersetCluster is first deployed, a SupersetDB resource is created. The SupersetDB resource is a wrapper resource for the SQL database that is used by Superset for its metadata. The resource contains some configuration but also keeps track of whether the database has been initialized or not. It is not deleted automatically if a SupersetCluster is deleted, and so can be reused.
31+
When a SupersetCluster is first deployed, a SupersetDB resource is created. The SupersetDB resource is a wrapper
32+
resource for the SQL database that is used by Superset for its metadata. The resource contains some configuration but
33+
also keeps track of whether the database has been initialized or not. It is not deleted automatically if a
34+
SupersetCluster is deleted, and so can be reused.
2035

21-
DruidConnection resources link a Superset and Druid instance. It lets you define this connection in the familiar way of deploying a resource (instead of configuring the connection via the Superset UI or API). The operator configures the connection between Druid and the Superset instance.
36+
DruidConnection resources link a Superset and Druid instance. It lets you define this connection in the familiar way of
37+
deploying a resource (instead of configuring the connection via the Superset UI or API). The operator configures the
38+
connection between Druid and the Superset instance.
2239

2340
=== Kubernetes resources
2441

2542
Based on the custom resources you define, the Operator creates ConfigMaps, StatefulSets and Services.
2643

2744
image::superset_overview.drawio.svg[A diagram depicting the Kubernetes resources created by the operator]
2845

29-
The diagram above depicts all the Kubernetes resources created by the operator, and how they relate to each other. The Jobs created for the SupersetDB and DruidConnnection resources are not shown.
46+
The diagram above depicts all the Kubernetes resources created by the operator, and how they relate to each other. The
47+
Jobs created for the SupersetDB and DruidConnnection resources are not shown.
3048

31-
For every xref:concepts:roles-and-role-groups.adoc#_role_groups[role group] you define, the Operator creates a StatefulSet with the amount of replicas defined in the RoleGroup. Every Pod in the StatefulSet has two containers: the main container running Superset and a sidecar container gathering metrics for xref:operators:monitoring.adoc[]. The Operator creates a Service for the `node` role as well as a single service per role group.
49+
For every xref:concepts:roles-and-role-groups.adoc#_role_groups[role group] you define, the Operator creates a
50+
StatefulSet with the amount of replicas defined in the RoleGroup. Every Pod in the StatefulSet has two containers: the
51+
main container running Superset and a sidecar container gathering metrics for xref:operators:monitoring.adoc[]. The
52+
Operator creates a Service for the `node` role as well as a single service per role group.
3253

33-
ConfigMaps are created, one per RoleGroup and also one for the SupersetDB. Both ConfigMaps contains two files: `log_config.py` and `superset_config.py` which contain logging and general Superset configuration respectively.
54+
ConfigMaps are created, one per RoleGroup and also one for the SupersetDB. Both ConfigMaps contains two files:
55+
`log_config.py` and `superset_config.py` which contain logging and general Superset configuration respectively.
3456

3557
== Dependencies
3658

3759
Superset requires an SQL database in which to store its metadata, dashboards and users. The Stackable platform does not have its own Operator for an SQL database but the xref:getting_started/index.adoc[] guides you through installing an example database with a Superset instance that you can use to get started.
3860

3961
== Connecting to data sources
4062

41-
Superset does not store its own data, instead it connects to other products where data is stored. On the Stackable Platform the two commonly used choices are xref:druid:index.adoc[Apache Druid] and xref:trino:index.adoc[Trino]. For Druid there is a way to xref:usage-guide/connecting-druid.adoc[connect a Druid instance declaratively] with a custom resource. For Trino this is on the roadmap. Have a look at the demos linked <<demos, below>> for examples of using Superset with Druid or Trino.
63+
Superset does not store its own data, instead it connects to other products where data is stored. On the Stackable
64+
Platform the two commonly used choices are xref:druid:index.adoc[Apache Druid] and xref:trino:index.adoc[Trino]. For
65+
Druid there is a way to xref:usage-guide/connecting-druid.adoc[connect a Druid instance declaratively] with a custom
66+
resource. For Trino this is on the roadmap. Have a look at the demos linked <<demos, below>> for examples of using
67+
Superset with Druid or Trino.
4268

4369
== [[demos]]Demos
4470

45-
Many of the Stackable xref:stackablectl::demos/index.adoc[demos] use Superset in the stack for data visualization and explaration. The demos come in two main variants.
71+
Many of the Stackable xref:demos:index.adoc[demos] use Superset in the stack for data visualization and explaration. The
72+
demos come in two main variants.
4673

4774
=== With Druid
4875

49-
The xref:stackablectl::demos/nifi-kafka-druid-earthquake-data.adoc[] and xref:stackablectl::demos/nifi-kafka-druid-water-level-data.adoc[] demos show Superset connected to xref:druid:index.adoc[Druid], exploring earthquake and water level data respectively.
76+
The xref:demos:nifi-kafka-druid-earthquake-data.adoc[] and xref:demos:nifi-kafka-druid-water-level-data.adoc[] demos
77+
show Superset connected to xref:druid:index.adoc[Druid], exploring earthquake and water level data respectively.
5078

5179
=== With Trino
5280

53-
The xref:stackablectl::demos/spark-k8s-anomaly-detection-taxi-data.adoc[], xref:stackablectl::demos/trino-taxi-data.adoc[], xref:stackablectl::demos/trino-iceberg.adoc[] and xref:stackablectl::demos/data-lakehouse-iceberg-trino-spark.adoc[] demos all use a xref:trino:index.adoc[Trino] instance on top of S3 storage that hold data to analyze. Superset is connected to Trino to analyze a variety of different datasets.
81+
The xref:demos:spark-k8s-anomaly-detection-taxi-data.adoc[], xref:demos:trino-taxi-data.adoc[],
82+
xref:demos:trino-iceberg.adoc[] and xref:demos:data-lakehouse-iceberg-trino-spark.adoc[] demos all use a
83+
xref:trino:index.adoc[Trino] instance on top of S3 storage that hold data to analyze. Superset is connected to Trino to
84+
analyze a variety of different datasets.
5485

5586
== Supported Versions
5687

0 commit comments

Comments
 (0)