You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: CHANGELOG.md
+8Lines changed: 8 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,6 +21,13 @@ All notable changes to this project will be documented in this file.
21
21
- Set `nifi.content.repository.archive.max.retention.period` to `3 days` (previously empty, which NiFi interprets as `Long.MAX_VALUE` and effectively disables time-based archive purge). Without a time-based ceiling, the content archive can grow to half the content PVC and accumulate millions of files, which makes the synchronous startup directory scan in `FileSystemRepository.initializeRepository` very slow. Users requiring a longer content-replay window can extend via `configOverrides`. The provenance audit trail is independent of this setting and unaffected ([#936]).
22
22
- test: Bump vector-aggregator to 0.55.0, replace /graphql call with gRPC call ([#940]).
23
23
24
+
### Removed
25
+
26
+
- BREAKING: Clean up leftover NiFi 1.x code and configuration.
27
+
Support for NiFi 1.x was already officially dropped in SDP 26.3, but some now-dead code and CRD fields remained.
28
+
This removes the Prometheus reporting-task Job (and its `spec.clusterConfig.createReportingTaskJob` field), the pre-2.x non-rolling upgrade handling, the dedicated metrics port, and the sensitive-properties algorithms that were only supported on NiFi 1.x.
29
+
`status.deployed_version` is retained even though it no longer drives the (now removed) non-rolling upgrade state machine, as we don't want a breaking change to the status just for this ([#954]).
30
+
24
31
### Fixed
25
32
26
33
- Fix broken link to the NiFi authorization usage guide in the `spec.clusterConfig.authorization` CRD doc (`usage-guide` -> `usage_guide`) ([#924]).
@@ -34,6 +41,7 @@ All notable changes to this project will be documented in this file.
Copy file name to clipboardExpand all lines: docs/modules/nifi/pages/usage_guide/clustering.adoc
-2Lines changed: 0 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,8 +14,6 @@ CAUTION: The cluster backend of an existing cluster should never be changed. Oth
14
14
[#backend-kubernetes]
15
15
== Kubernetes
16
16
17
-
NOTE: The Kubernetes provider is only supported by Apache NiFi 2.0 or newer. When using NiFi 1.x, use the xref:#backend-zookeeper[] backend instead.
18
-
19
17
The Kubernetes backend is used by default (unless the xref:#backend-zookeeper[] backend is configured), and stores all state in Kubernetes objects, in the same namespace as the `NifiCluster` object.
In November 2024, Apache NiFi released a new major version https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version2.0.0[`2.0.0`,window=_blank].
8
-
9
-
The NiFi `2.0.0` release changed the way of exposing Prometheus metrics significantly.
10
-
The following steps explain on how to expose Metrics in NiFi versions `1.x.x` and `2.x.x`.
11
-
12
-
== Configure metrics in NiFi `1.x.x`
13
-
14
-
For NiFi versions `1.x.x`, the operator automatically configures NiFi to export Prometheus metrics.
15
-
This is done by creating a {k8s-job}[Job,window=_blank] that connects to NiFi and configures a https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-prometheus-nar/1.26.0/org.apache.nifi.reporting.prometheus.PrometheusReportingTask/index.html[Prometheus Reporting Task,window=_blank].
16
-
17
-
IMPORTANT: Network access from the Job to NiFi is required.
18
-
If you are running a Kubernetes with restrictive {k8s-network-policies}[NetworkPolicies,window=_blank], make sure to allow access from the Job to NiFi.
19
-
20
-
See xref:operators:monitoring.adoc[] for more details.
21
-
22
-
== Disabling create-reporting-task Job
23
-
24
-
It can be helpful to disable the Job, e.g. when you configOverride an authentication mechanism, which the Job currently cannot use to authenticate against NiFi.
25
-
26
-
To achieve this use the following configuration:
27
-
28
-
[source,yaml]
29
-
----
30
-
spec:
31
-
clusterConfig:
32
-
createReportingTaskJob:
33
-
enabled: false
34
-
----
35
-
36
5
== Configure metrics in NiFi `2.x.x`
37
6
38
7
The Prometheus Reporting Task was removed in NiFi `2.x.x` in https://issues.apache.org/jira/browse/NIFI-13507[NIFI-13507,window=_blank].
Copy file name to clipboardExpand all lines: docs/modules/nifi/pages/usage_guide/overrides.adoc
-19Lines changed: 0 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -96,25 +96,6 @@ Pod overrides allow you to configure any attributes that can be configured on a
96
96
97
97
Read the xref:concepts:overrides.adoc#pod-overrides[Pod overrides concepts page] to learn more.
98
98
99
-
=== Pod overrides on create-reporting-task Job
100
-
101
-
In addition to podOverrides on the created StatefulSet we also support podOverrides on the created Kubernetes Job, which enables the export of Prometheus metrics within NiFi.
102
-
103
-
[source,yaml]
104
-
----
105
-
spec:
106
-
clusterConfig:
107
-
createReportingTaskJob:
108
-
# enabled: false # You can also turn off the Job entirely
109
-
podOverrides: # podOverrides as usual
110
-
spec:
111
-
tolerations:
112
-
- key: "key1"
113
-
operator: "Equal"
114
-
value: "value1"
115
-
effect: "NoSchedule"
116
-
----
117
-
118
99
== JVM argument overrides
119
100
120
101
Stackable operators automatically determine the set of needed JVM arguments, such as memory settings or trust- and keystores.
Copy file name to clipboardExpand all lines: docs/modules/nifi/pages/usage_guide/updating.adoc
+1-13Lines changed: 1 addition & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,16 +17,4 @@ spec:
17
17
18
18
<1> Change the NiFi version here
19
19
20
-
[WARNING]
21
-
====
22
-
NiFi clusters cannot be upgraded or downgraded in a rolling fashion due to a limitation in NiFi prior to version 2.
23
-
24
-
When upgrading between NiFi 1 versions or from NiFi 1 to NiFi 2, any change to the NiFi version in the CRD triggers a full cluster restart with brief downtime.
25
-
However, the Stackable image version can be updated in a rolling manner, provided the NiFi version remains unchanged.
26
-
27
-
Since NiFi version 2, rolling upgrades are supported.
28
-
====
29
-
30
-
== NiFi 2.0.0
31
-
32
-
Before you can upgrade to `2.0.0` you https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance[need to update] to at least version 1.27.x!
20
+
Rolling upgrades are supported, so changing the NiFi version in the CRD updates the cluster without downtime.
0 commit comments