feat(test-local): add S3 core support and document local S3 testing in README

Author: shaypal5

README.rst

@@ -736,7 +736,7 @@ This script automatically handles Docker container lifecycle, environment variab
 .. code-block:: bash
 
   make test-mongo-local     # Run MongoDB tests with Docker
-  make test-all-local       # Run all backends with Docker
+  make test-all-local       # Run all backends locally (Docker used for mongo/redis/sql)
   make test-mongo-inmemory  # Run with in-memory MongoDB (default)
 
 **Option 3: Manual setup**
@@ -762,18 +762,21 @@ Contributors are encouraged to test against a real MongoDB instance before submi
 Testing all backends locally
 -----------------------------
 
-To test all cachier backends (MongoDB, Redis, SQL, Memory, Pickle) locally with Docker:
+To test all cachier backends (MongoDB, Redis, SQL, S3, Memory, Pickle) locally:
 
 .. code-block:: bash
 
   # Test all backends at once
   ./scripts/test-local.sh all
 
-  # Test only external backends (MongoDB, Redis, SQL)
+  # Test only external backends that require Docker (MongoDB, Redis, SQL)
   ./scripts/test-local.sh external
 
+  # Test S3 backend only (uses moto, no Docker needed)
+  ./scripts/test-local.sh s3
+
   # Test specific combinations
-  ./scripts/test-local.sh mongo redis
+  ./scripts/test-local.sh mongo redis s3
 
   # Keep containers running for debugging
   ./scripts/test-local.sh all -k
@@ -784,7 +787,7 @@ To test all cachier backends (MongoDB, Redis, SQL, Memory, Pickle) locally with
   # Test multiple files across all backends
   ./scripts/test-local.sh all -f tests/test_main.py -f tests/test_redis_core_coverage.py
 
-The unified test script automatically manages Docker containers, installs required dependencies, and runs the appropriate test suites. The ``-f`` / ``--files`` option allows you to run specific test files instead of the entire test suite. See ``scripts/README-local-testing.md`` for detailed documentation.
+The unified test script automatically manages Docker containers for MongoDB/Redis/SQL, installs required dependencies (including ``tests/requirements_s3.txt`` for S3), and runs the appropriate test suites. The ``-f`` / ``--files`` option allows you to run specific test files instead of the entire test suite. See ``scripts/README-local-testing.md`` for detailed documentation.
 
 
 Running pre-commit hooks locally

scripts/test-local.sh

@@ -45,9 +45,10 @@ CORES:
     mongo       MongoDB backend tests
     redis       Redis backend tests
     sql         SQL (PostgreSQL) backend tests
+    s3          S3 backend tests (no Docker needed)
     memory      Memory backend tests (no Docker needed)
     pickle      Pickle backend tests (no Docker needed)
-    all         All backends (equivalent to: mongo redis sql memory pickle)
+    all         All backends (equivalent to: mongo redis sql s3 memory pickle)
     external    All external backends (mongo redis sql)
     local       All local backends (memory pickle)
 
@@ -133,7 +134,7 @@ expand_cores() {
     for core in $1; do
         case $core in
             all)
-                cores="$cores mongo redis sql memory pickle"
+                cores="$cores mongo redis sql s3 memory pickle"
                 ;;
             external)
                 cores="$cores mongo redis sql"
@@ -158,6 +159,7 @@ get_markers_for_core() {
         mongo) echo "mongo" ;;
         redis) echo "redis" ;;
         sql) echo "sql" ;;
+        s3) echo "s3" ;;
         memory) echo "memory" ;;
         pickle) echo "pickle or maxage" ;;
         *) echo "$1" ;;  # Default to core name
@@ -166,11 +168,11 @@ get_markers_for_core() {
 
 # Validate cores
 validate_cores() {
-    local valid_cores="mongo redis sql memory pickle"
+    local valid_cores="mongo redis sql s3 memory pickle"
     for core in $1; do
         if ! echo "$valid_cores" | grep -qw "$core"; then
             print_message $RED "Error: Invalid core '$core'"
-            print_message $YELLOW "Valid cores: mongo, redis, sql, memory, pickle"
+            print_message $YELLOW "Valid cores: mongo, redis, sql, s3, memory, pickle"
             exit 1
         fi
     done
@@ -265,6 +267,17 @@ check_dependencies() {
         fi
     fi
 
+    # Check S3 dependencies if testing S3
+    if echo "$SELECTED_CORES" | grep -qw "s3"; then
+        if ! python -c "import boto3; import moto" 2>/dev/null; then
+            print_message $YELLOW "Installing S3 test requirements..."
+            pip install -r tests/requirements_s3.txt || {
+                print_message $RED "Failed to install S3 requirements"
+                exit 1
+            }
+        fi
+    fi
+
     print_message $GREEN "All required dependencies are installed!"
 }
 
@@ -498,7 +511,7 @@ main() {
     # Add markers if needed (only if no specific test files were given)
     if [ -z "$TEST_FILES" ]; then
         # Check if we selected all cores - if so, run all tests without marker filtering
-        all_cores="memory mongo pickle redis sql"
+        all_cores="memory mongo pickle redis s3 sql"
         selected_sorted=$(echo "$SELECTED_CORES" | tr ' ' '\n' | sort | tr '\n' ' ' | xargs)
         all_sorted=$(echo "$all_cores" | tr ' ' '\n' | sort | tr '\n' ' ' | xargs)
 
@@ -507,7 +520,7 @@ main() {
         fi
     else
         # When test files are specified, still apply markers if not running all cores
-        all_cores="memory mongo pickle redis sql"
+        all_cores="memory mongo pickle redis s3 sql"
         selected_sorted=$(echo "$SELECTED_CORES" | tr ' ' '\n' | sort | tr '\n' ' ' | xargs)
         all_sorted=$(echo "$all_cores" | tr ' ' '\n' | sort | tr '\n' ' ' | xargs)