Update read me

Author: nirmitparikh8

experiments/REGRESSION_DETECTION.md

@@ -9,8 +9,8 @@ Automated system to detect performance regressions in circuit breaker experiment
 ## How It Works
 
 1. **Baseline Collection**: Collect 5-10 historical "good" experiment runs for each experiment type
-2. **Percentile Analysis**: Calculate 3rd, 50th, and 97th percentiles for key metrics
-3. **Control Limits**: Set bounds at 3rd-97th percentile range (covers ~90% of historical variation)
+2. **Percentile Analysis**: Calculate 5th, 55th, and 95th percentiles for key metrics
+3. **Control Limits**: Set bounds at 5th-95th percentile range (covers ~90% of historical variation)
 4. **Violation Detection**: Flag experiment if >30% of time windows fall outside percentile bounds
 5. **Multi-metric Evaluation**: Check deviation from target, error rates, and rejection rates
 6. **Automated CI Integration**: GitHub Actions automatically runs full pipeline on every PR
@@ -84,13 +84,13 @@ All thresholds are easily adjustable in `regression_config.rb`:
 ```ruby
 module RegressionConfig
   # Percentile bounds for control limits
-  LOWER_PERCENTILE = 3
-  UPPER_PERCENTILE = 97
+  LOWER_PERCENTILE = 5
+  UPPER_PERCENTILE = 95
 
   # Violation thresholds (what % of time windows can violate bounds)
-  DEVIATION_VIOLATION_THRESHOLD = 0.3
-  ERROR_RATE_VIOLATION_THRESHOLD = 0.3
-  REJECTION_RATE_VIOLATION_THRESHOLD = 0.3
+  DEVIATION_VIOLATION_THRESHOLD = 0.5
+  ERROR_RATE_VIOLATION_THRESHOLD = 0.8
+  REJECTION_RATE_VIOLATION_THRESHOLD = 0.8
 
   # Minimum baseline runs needed
   MIN_BASELINE_RUNS = 10

experiments/compute_baselines.rb

@@ -1,6 +1,9 @@
 #!/usr/bin/env ruby
 # frozen_string_literal: true
 
+# This script computes the percentiles for the baseline data and saves them to a file.
+# Usage: ruby compute_baselines.rb
+
 require_relative "regression_config"
 
 MID_PERCENTILE = RegressionConfig::LOWER_PERCENTILE + (RegressionConfig::UPPER_PERCENTILE - RegressionConfig::LOWER_PERCENTILE) / 2

experiments/detect_regressions.rb

@@ -1,6 +1,8 @@
 #!/usr/bin/env ruby
 # frozen_string_literal: true
 
+# This script detects regressions in the experiments by comparing the current experiment results to the baseline data.
+# Usage: ruby detect_regressions.rb
 require_relative "regression_config"
 
 def load_baseline(experiment_name)