Accomplish tasks 4 IAM Module

Author: zeroc0d3

.env.example

@@ -238,7 +238,7 @@ OTEL_ENABLED=true
 
 # Service identification
 OTEL_SERVICE_NAME=telemetryflow-core
-SERVICE_VERSION=1.1.2
+SERVICE_VERSION=1.1.4
 SERVICE_NAMESPACE=devopscorner
 SERVICE_TEAM=core
 
@@ -287,7 +287,7 @@ CLICKHOUSE_PASSWORD=telemetryflow123
 #   - TTL: 90 days (audit logs)
 
 #================================================================================================
-# POSTGRESQL CONFIGURATION
+# DATABASE CONFIGURATION
 #================================================================================================
 # IMPORTANT: PostgreSQL configuration is managed in config/postgresql/
 #            - postgresql.conf: Server settings (connections, memory, performance)
@@ -297,15 +297,22 @@ CLICKHOUSE_PASSWORD=telemetryflow123
 #   Development: Default postgres user acceptable for local testing
 #   Production: Create dedicated user with restricted permissions, strong password
 #
-# Connection Settings:
+# PostgreSQL Configuration
 POSTGRES_HOST=172.151.151.20
 POSTGRES_PORT=5432
 POSTGRES_DB=telemetryflow_db
 POSTGRES_USERNAME=postgres
 POSTGRES_PASSWORD=telemetryflow123
 
+# ClickHouse Configuration
+CLICKHOUSE_HOST=localhost
+CLICKHOUSE_PORT=8123
+CLICKHOUSE_DB=telemetryflow_db
+CLICKHOUSE_USER=default
+CLICKHOUSE_PASSWORD=telemetryflow123
+
 #================================================================================================
-# JWT & SESSION CONFIGURATION
+# TFO API & SECRET, JWT & SESSION CONFIGURATION
 #================================================================================================
 # 🔒 SECURITY CRITICAL: These secrets MUST be changed in production
 #
@@ -321,6 +328,9 @@ POSTGRES_PASSWORD=telemetryflow123
 # Or manually with Node.js:
 #   node -e "console.log(require('crypto').randomBytes(32).toString('base64'))"
 #
+TELEMETRYFLOW_API_KEY_ID=tfk_
+TELEMETRYFLOW_API_KEY_SECRET=tfs_
+
 # JWT Secret (Token signing)
 # Development: Use a simple secret for testing
 # Production: Generate a 32+ character random string
@@ -417,7 +427,7 @@ CLICKHOUSE_VERSION=latest
 # Monitoring
 OTEL_VERSION=latest
 PROMETHEUS_VERSION=latest
-JAEGER_VERSION=2.2.0
+JAEGER_VERSION=2.13.0
 GRAFANA_VERSION=latest
 
 # Management Tools

.kiro/specs/iam-module-standardization/tasks.md

@@ -56,13 +56,13 @@ This implementation plan transforms the IAM module standardization design into a
     - Validate test naming conventions
     - _Requirements: 2.6, 2.7, 2.8, 2.9, 2.10_
 
-  - [ ] 3.4 Write integration tests for coverage analyzer
+  - [x] 3.4 Write integration tests for coverage analyzer
     - Test with real Jest coverage data
     - Test threshold validation with various coverage scenarios
     - Test layer-specific analysis accuracy
     - _Requirements: 2.1, 2.2, 2.3, 2.4, 2.5_
 
-- [ ] 4. Checkpoint - Ensure documentation and coverage tools work
+- [x] 4. Checkpoint - Ensure documentation and coverage tools work
   - Ensure all tests pass, ask the user if questions arise.
 
 - [ ] 5. Implement file structure validation and fixing

README.md

@@ -602,6 +602,40 @@ curl http://localhost:3000/api
 - **OTEL Collector**: 172.151.151.30:4317/4318
 - **Prometheus**: 172.151.151.50:9090
 
+### OTEL Collector Ports
+
+| Port  | Protocol | Description           |
+| ----- | -------- | --------------------- |
+| 4317  | gRPC     | OTLP gRPC (v1 & v2)   |
+| 4318  | HTTP     | OTLP HTTP (v1 & v2)   |
+| 8888  | HTTP     | OTEL Collector metrics|
+| 8889  | HTTP     | Prometheus exporter   |
+| 13133 | HTTP     | Health check          |
+| 55679 | HTTP     | zPages (debugging)    |
+| 1777  | HTTP     | pprof (profiling)     |
+
+### OTLP Endpoints (Dual Ingestion)
+
+The collector supports both TelemetryFlow (v2) and OTEL Community (v1) endpoints:
+
+**TelemetryFlow Platform (Recommended):**
+
+```text
+POST http://localhost:4318/v2/traces
+POST http://localhost:4318/v2/metrics
+POST http://localhost:4318/v2/logs
+```
+
+**OTEL Community (Backwards Compatible):**
+
+```text
+POST http://localhost:4318/v1/traces
+POST http://localhost:4318/v1/metrics
+POST http://localhost:4318/v1/logs
+```
+
+**gRPC:** `localhost:4317` (both v1 and v2)
+
 ## Database Schema
 
 ### Core Tables

config/otel/otel-collector.yaml

@@ -267,11 +267,16 @@ exporters:
   #     num_consumers: 10
   #     queue_size: 1000
 
-  # OTLP exporter to Jaeger (uncomment to enable)
-  # otlp/jaeger:
-  #   endpoint: "jaeger:4317"
-  #   tls:
-  #     insecure: true
+  # OTLP exporter to Jaeger V2 (native OTLP support)
+  otlp/jaeger:
+    endpoint: "jaeger:4317"
+    tls:
+      insecure: true
+    retry_on_failure:
+      enabled: true
+      initial_interval: 5s
+      max_interval: 30s
+      max_elapsed_time: 300s
 
   # Loki exporter for logs (uncomment to enable)
   # loki:
@@ -348,12 +353,12 @@ service:
 
   pipelines:
     # ==========================================================================
-    # Traces pipeline - receives traces, exports to debug and spanmetrics connector
+    # Traces pipeline - receives traces, exports to Jaeger, debug, and spanmetrics connector
     # ==========================================================================
     traces:
       receivers: [otlp]
       processors: [memory_limiter, batch, resource]
-      exporters: [debug, spanmetrics, servicegraph]  # Export to connectors for derived metrics
+      exporters: [otlp/jaeger, debug, spanmetrics, servicegraph]  # Export traces to Jaeger + connectors
 
     # ==========================================================================
     # Metrics pipeline - receives metrics from OTLP

…nfig/otel/otel-collector-config-log.yaml …community/otel-collector-config-log.yamlconfig/otel/otel-collector-config-log.yaml renamed to config/otel/otel-community/otel-collector-config-log.yaml config/otel/otel-collector-config-log.yaml renamed to config/otel/otel-community/otel-collector-config-log.yaml

@@ -192,6 +192,18 @@ exporters:
     sampling_initial: 5
     sampling_thereafter: 200
 
+  # OTLP exporter for Jaeger V2 (native OTLP support)
+  # Jaeger V2 listens on 4317 (gRPC) and 4318 (HTTP) by default
+  otlp/jaeger:
+    endpoint: "${JAEGER_OTLP_ENDPOINT:-jaeger:4317}"
+    tls:
+      insecure: true
+    retry_on_failure:
+      enabled: true
+      initial_interval: 5s
+      max_interval: 30s
+      max_elapsed_time: 300s
+
   # Prometheus exporter for metrics scraping (with exemplars support)
   prometheus:
     endpoint: "0.0.0.0:8889"
@@ -271,11 +283,11 @@ service:
   extensions: [health_check, zpages, pprof]
 
   pipelines:
-    # Traces pipeline - receives traces, exports to debug and spanmetrics connector
+    # Traces pipeline - receives traces, exports to Jaeger, debug, and spanmetrics connector
     traces:
       receivers: [otlp]
       processors: [memory_limiter, batch, resource]
-      exporters: [debug, spanmetrics, servicegraph]
+      exporters: [otlp/jaeger, debug, spanmetrics, servicegraph]
 
     # Metrics pipeline - receives metrics from OTLP
     metrics:

…nfig/otel/otel-collector-config-spm.yaml …community/otel-collector-config-spm.yamlconfig/otel/otel-collector-config-spm.yaml renamed to config/otel/otel-community/otel-collector-config-spm.yaml config/otel/otel-collector-config-spm.yaml renamed to config/otel/otel-community/otel-collector-config-spm.yaml

@@ -263,39 +263,55 @@ services:
   #----------------------------------------------------------------------------------------------
   # OTEL COLLECTOR - OpenTelemetry Collector
   #----------------------------------------------------------------------------------------------
+  # Supports dual ingestion: v1 (OTEL standard) and v2 (TelemetryFlow enhanced)
+  #
+  # OTLP HTTP Endpoints:
+  #   TelemetryFlow Platform (Recommended - TFO Standalone):
+  #     POST http://localhost:4318/v2/traces
+  #     POST http://localhost:4318/v2/metrics
+  #     POST http://localhost:4318/v2/logs
+  #
+  #   OTEL Community (Backwards Compatible - OCB/Standard):
+  #     POST http://localhost:4318/v1/traces
+  #     POST http://localhost:4318/v1/metrics
+  #     POST http://localhost:4318/v1/logs
+  #
+  #   gRPC (Both versions via same port): localhost:4317
+  #----------------------------------------------------------------------------------------------
   otel-collector:
     profiles: ["monitoring", "all"]
     platform: linux/amd64
     # =============================================================================
-    # OTEL Collector Community Contributor (Standard OTEL format)
-    # image: otel/opentelemetry-collector-contrib:${OTEL_VERSION:-0.142.0}
-    # command: ["--config=/etc/otelcol-contrib/config.yaml"]
+    # TelemetryFlow Collector (TFO-Collector) - Custom TFO format with OTLP support (v1.1.1+)
+    image: telemetryflow/telemetryflow-collector:${TFO_VERSION:-latest}
+    # command: ["--config=/etc/tfo-collector/tfo-collector.yaml"]
     # =============================================================================
     # TelemetryFlow Collector OCB (TFO-Collector-OCB) - Standard OTEL format
-    image: telemetryflow/telemetryflow-collector-ocb:${OTEL_VERSION:-latest}
-    command: ["--config=/etc/tfo-collector/otel-collector.yaml"]
+    # image: telemetryflow/telemetryflow-collector-ocb:${TFO_VERSION:-latest}
+    # command: ["--config=/etc/tfo-collector/otel-collector.yaml"]
     # =============================================================================
-    # TelemetryFlow Collector (TFO-Collector) - Custom TFO format (OTLP not implemented yet)
-    # image: telemetryflow/telemetryflow-collector:${OTEL_VERSION:-latest}
-    # command: ["--config=/etc/tfo-collector/tfo-collector.yaml"]
+    # OTEL Collector Community Contributor (Standard OTEL format)
+    # image: otel/opentelemetry-collector-contrib:${OTEL_VERSION:-0.142.0}
+    # command: ["--config=/etc/otelcol-contrib/config.yaml"]
     # =============================================================================
     container_name: ${CONTAINER_OTEL:-telemetryflow_core_otel}
     restart: unless-stopped
     volumes:
-      # OTEL Collector Community Contributor config
-      # - ./config/otel/otel-collector.yaml:/etc/otelcol-contrib/config.yaml:ro
+      # TelemetryFlow Collector config (Custom TFO format)
+      - ./config/otel/tfo-collector.yaml:/etc/tfo-collector/tfo-collector.yaml:ro
       # =============================================================================
       # TelemetryFlow Collector OCB config (Standard OTEL format)
-      - ./config/otel/otel-collector.yaml:/etc/tfo-collector/otel-collector.yaml:ro
+      # - ./config/otel/otel-collector.yaml:/etc/tfo-collector/otel-collector.yaml:ro
       # =============================================================================
-      # TelemetryFlow Collector config (Custom TFO format)
-      # - ./config/otel/tfo-collector.yaml:/etc/tfo-collector/tfo-collector.yaml:ro
+      # OTEL Collector Community Contributor config (Standard OTEL format)
+      # - ./config/otel/otel-collector.yaml:/etc/otelcol-contrib/config.yaml:ro
     ports:
-      - "${PORT_OTEL_GRPC:-4317}:4317"     # OTLP gRPC
-      - "${PORT_OTEL_HTTP:-4318}:4318"     # OTLP HTTP
+      - "${PORT_OTEL_GRPC:-4317}:4317"     # OTLP gRPC (v1 & v2)
+      - "${PORT_OTEL_HTTP:-4318}:4318"     # OTLP HTTP (v1 & v2)
       - "${PORT_OTEL_METRICS:-8889}:8889"  # Prometheus metrics
       - "${PORT_OTEL_HEALTH:-13133}:13133" # Health check
-      - "${PORT_OTEL_ZPAGES:-55679}:55679" # zPage
+      - "${PORT_OTEL_ZPAGES:-55679}:55679" # zPages
+      - "${PORT_OTEL_PPROF:-1777}:1777"    # pprof
     healthcheck:
       test: ["CMD", "wget", "--spider", "-q", "http://localhost:13133"]
       interval: 10s
@@ -312,7 +328,7 @@ services:
   jaeger:
     profiles: ["monitoring", "all"]
     platform: linux/amd64
-    image: jaegertracing/jaeger:${JAEGER_VERSION:-2.2.0}
+    image: jaegertracing/jaeger:${JAEGER_VERSION:-2.13.0}
     container_name: ${CONTAINER_JAEGER:-telemetryflow_core_jaeger}
     restart: unless-stopped
     ports:

config/otel/otel-collector-config.yaml …tel-community/otel-collector-config.yamlconfig/otel/otel-collector-config.yaml renamed to config/otel/otel-community/otel-collector-config.yaml config/otel/otel-collector-config.yaml renamed to config/otel/otel-community/otel-collector-config.yaml

@@ -262,12 +262,19 @@ curl http://localhost:3000/health
 open http://localhost:3000/api
 ```
 
-### 4. OTEL Collector
+### 4. TFO-Collector (OTEL Collector)
 
 **Configuration**:
-- **Image**: otel/opentelemetry-collector-contrib:latest
-- **Config**: ./config/otel/otel-collector-config-spm.yaml
-- **Ports**: 4317 (gRPC), 4318 (HTTP), 8889 (metrics)
+- **Image**: telemetryflow/telemetryflow-collector:latest (v1.1.1+)
+- **Config**: ./config/otel/tfo-collector.yaml
+- **Ports**: 4317 (gRPC), 4318 (HTTP), 8889 (metrics), 13133 (health)
+- **Features**: 100% OTLP compliant, SpanMetrics, ServiceGraph
+
+**Key Capabilities**:
+- OTLP gRPC/HTTP receivers and exporters
+- Native Jaeger V2 integration via OTLP
+- SpanMetrics connector with exemplars
+- ServiceGraph connector for dependencies
 
 **Check Status**:
 ```bash
@@ -276,14 +283,18 @@ curl http://localhost:13133
 
 # Metrics
 curl http://localhost:8889/metrics
+
+# zPages debugging
+open http://localhost:55679/debug/tracez
 ```
 
-### 5. Jaeger
+### 5. Jaeger V2
 
 **Configuration**:
-- **Image**: jaegertracing/jaeger:2.2.0
+- **Image**: jaegertracing/jaeger:2.13.0
 - **Storage**: Memory (for development)
-- **Metrics**: Prometheus integration
+- **Metrics**: Prometheus integration via SPM
+- **Protocol**: Native OTLP support (receives from TFO-Collector)
 
 **Access UI**:
 ```bash
@@ -678,14 +689,16 @@ docker exec telemetryflow_core_clickhouse clickhouse-client --query "SELECT data
 - [Docker Compose Profiles](https://docs.docker.com/compose/profiles/)
 - [PostgreSQL Docker](https://hub.docker.com/_/postgres)
 - [ClickHouse Docker](https://hub.docker.com/r/clickhouse/clickhouse-server)
+- [TelemetryFlow Collector](https://github.com/telemetryflow/telemetryflow-collector) - Custom OTEL Collector with 100% OTLP compliance
 - [OpenTelemetry Collector](https://opentelemetry.io/docs/collector/)
-- [Jaeger Documentation](https://www.jaegertracing.io/docs/)
+- [Jaeger V2 Documentation](https://www.jaegertracing.io/docs/)
 - [Prometheus Documentation](https://prometheus.io/docs/)
 - [Grafana Documentation](https://grafana.com/docs/)
 - [Portainer Documentation](https://docs.portainer.io/)
 
 ---
 
-**Last Updated**: 2025-12-05  
-**Docker Compose Version**: 2.x  
+**Last Updated**: 2026-01-01
+**Docker Compose Version**: 2.x
 **Network**: 172.151.0.0/16
+**TFO-Collector Version**: v1.1.1+