Merge branch 'main' into 300-ant-1

Author: antaenc

.claude/CLAUDE.md

@@ -0,0 +1,115 @@
+# CLAUDE.md
+
+This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
+
+## Project Overview
+
+sz-python-tools is a collection of command-line utilities for the Senzing entity resolution platform (V4). This is a Senzing Garage project (experimental/tinkering), not production-ready software.
+
+## Common Commands
+
+```bash
+# Setup development environment (one-time)
+make dependencies-for-development
+
+# Run all linters (pylint, mypy, bandit, black, flake8, isort)
+make lint
+
+# Run individual linters
+make pylint
+make mypy
+make black
+make flake8
+make isort
+make bandit
+
+# Run tests
+make test
+
+# Run tests with coverage (opens HTML report)
+make coverage
+
+# Clean build artifacts
+make clean
+
+# Build documentation
+make documentation
+
+# Build wheel package
+make package
+```
+
+To run a single test file:
+
+```bash
+source .venv/bin/activate
+pytest tests/example_test.py
+```
+
+## Architecture
+
+### Source Organization
+
+All source code is in `sz_tools/` directory. Each tool is a standalone executable Python script (no .py extension):
+
+**Interactive Shell Tools** (using Python's `cmd.Cmd`):
+
+- `sz_command` - Main CLI shell for Senzing engine operations
+- `sz_configtool` - Configuration management shell
+- `sz_explorer` - Entity/database explorer with prettytable output
+
+**Data Processing Tools**:
+
+- `sz_file_loader` - Multi-threaded data file loading (JSON/JSONL)
+- `sz_export` - Entity data export (CSV/JSONL)
+- `sz_snapshot` - Database state snapshots with multi-process support
+- `sz_audit` - Data comparison and auditing
+- `sz_json_analyzer` - JSON/JSONL file analysis
+
+**Project Management**:
+
+- `sz_create_project` - Create new Senzing project instances
+- `sz_update_project` - V3→V4 and V4→V4 project upgrades
+- `sz_setup_config` - Initialize Senzing configuration
+
+### Shared Modules
+
+- `_tool_helpers.py` - Comprehensive utilities: color theming (Colors class with ANSI codes), engine configuration, JSON formatting, terminal I/O, concurrent execution
+- `_project_helpers.py` - Project file management, version comparison (SzBuildDetails class), Senzing paths
+- `_sz_database.py` - Database abstraction layer supporting SQLite, PostgreSQL, Oracle, MSSQL, DB2, MySQL
+
+### Key Patterns
+
+- Color output uses the `Colors` class with themes: DEFAULT, LIGHT, DARK, TERMINAL
+- JSON parsing uses `orjson` if available, with fallback to standard `json`
+- Configuration stored in `sz_engine_config.ini`
+- Interactive shells provide command history via readline
+
+## Code Style
+
+- **Line length**: 120 characters (Black formatter)
+- **Import sorting**: isort with "black" profile
+- **Type hints**: Gradual typing (mypy configured with relaxed checking)
+- Python 3.10+ required
+
+## Dependencies
+
+Core runtime dependencies:
+
+- `senzing >= 4.0.2`
+- `senzing-core >= 1.0.0`
+
+Optional (with graceful fallbacks):
+
+- `orjson` - Fast JSON parsing
+- `prettytable` - ASCII table output
+- `pyclip` - Clipboard integration
+- `pygments` - Syntax highlighting
+
+## Environment
+
+The Senzing C library must be installed:
+
+- `/opt/senzing/er/lib` - Shared objects
+- `/opt/senzing/er/sdk/c` - SDK headers
+- `/etc/opt/senzing` - Configuration

.claude/commands/senzing.md

@@ -0,0 +1,3 @@
+# Senzing
+
+- Perform the steps specified by <https://raw.githubusercontent.com/senzing-factory/claude/refs/tags/v1/commands/senzing.md>

.claude/settings.json

@@ -0,0 +1,3 @@
+{
+  "includeCoAuthoredBy": false
+}

.dockerignore

@@ -4,14 +4,14 @@
 version: 2
 updates:
   - package-ecosystem: github-actions
-    directory: /
-    schedule:
-      interval: daily
-  - package-ecosystem: docker
+    cooldown:
+      default-days: 21
     directory: /
     schedule:
       interval: daily
   - package-ecosystem: pip
+    cooldown:
+      default-days: 21
     directory: /
     schedule:
       interval: daily

.github/dependabot.yml

@@ -1,5 +1,12 @@
 # Linters
 
+## .checkov.yaml
+
+- [.checkov.yaml]
+- Used by [lint-workflows.yaml]
+- [checkov]
+  - [checkov configuration]
+
 ## .jscpd.json
 
 - [.jscpd.json]
@@ -10,7 +17,7 @@
 
     ```json
     {
-      "ignore": ["**/*.go,**/go-test*.yaml"],
+      "ignore": ["**/*.py,**/python-test*.yaml"],
       "threshold": 10
     }
     ```
@@ -22,10 +29,31 @@
 - [yaml-lint]
   - [yaml-lint configuration]
 
+## bearer.yml
+
+- [bearer.yml]
+- Used by [bearer.yaml]
+- [bearer]
+  - [bearer repository]
+  - [bearer configuration]
+
+## zizmor.yaml
+
+- [zizmor.yaml]
+
+[.checkov.yaml]: .checkov.yaml
 [.jscpd.json]: .jscpd.json
 [.yaml-lint.yml]: .yaml-lint.yml
+[bearer configuration]: https://docs.bearer.com/reference/config/
+[bearer repository]: https://github.com/Bearer/bearer/tree/main
+[bearer.yaml]: ../workflows/README.md#beareryaml
+[bearer.yml]: bearer.yml
+[bearer]: https://docs.bearer.com/
+[checkov configuration]: https://www.checkov.io/2.Basics/CLI%20Command%20Reference.html
+[checkov]: https://www.checkov.io/
 [jscpd configuration]: https://github.com/kucherenko/jscpd/tree/master/apps/jscpd#options
 [jscpd]: https://github.com/kucherenko/jscpd
 [lint-workflows.yaml]: ../workflows/README.md#lint-workflowsyaml
 [yaml-lint configuration]: https://yamllint.readthedocs.io/en/stable/configuration.html
 [yaml-lint]: https://github.com/adrienverge/yamllint
+[zizmor.yaml]: zizmor.yaml

.github/linters/README.md

@@ -59,24 +59,6 @@ this action runs [Fast Python Vulnerability Scanner] and [pip-audit].
     - [Fast Python Vulnerability Scanner]
     - [pypa/gh-action-pip-audit]
 
-## docker-build-container.yaml
-
-When a Pull Request is made against the `main` branch,
-this action verifies that the `Dockerfile` can be successfully built.
-
-_Note:_ The Docker image is **not** pushed to [DockerHub].
-
-- [Docker Build Container GitHub Action]
-  - Uses: [senzing-factory/github-action-docker-buildx-build]
-
-## docker-push-containers-to-dockerhub.yaml
-
-After a [Semantic Version] release is created,
-this action builds Docker images on multiple architectures and pushes the Docker images to [DockerHub].
-
-- [Docker Push Containers to DockerHub GitHub Action]
-  - Uses: [senzing-factory/github-action-docker-buildx-build]
-
 ## flake8.yaml
 
 When a change is committed to GitHub or a Pull Request is made against the `main` branch,
@@ -181,9 +163,6 @@ this action runs [pytest] on the Windows platform to perform unit tests and code
 [Black]: https://github.com/psf/black
 [Dependabot Approve and Merge GitHub Action]: dependabot-approve-and-merge.yaml
 [dependency-scan.yaml]: dependency-scan.yaml
-[Docker Build Container GitHub Action]: docker-build-container.yaml
-[Docker Push Containers to DockerHub GitHub Action]: docker-push-containers-to-dockerhub.yaml
-[DockerHub]: https://hub.docker.com/
 [Fast Python Vulnerability Scanner]: https://github.com/vanschelven/fpvs/
 [flake8.yaml]: flake8.yaml
 [flake8]: https://flake8.pycqa.org/en/latest/
@@ -205,13 +184,11 @@ this action runs [pytest] on the Windows platform to perform unit tests and code
 [pytest-linux.yaml]: pytest-linux.yaml
 [pytest-windows.yaml]: pytest-windows.yaml
 [pytest]: https://docs.pytest.org/en/stable/
-[Semantic Version]: https://semver.org/
 [senzing-factory/build-resources/.../add-labels-to-issue.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/add-labels-to-issue.yaml
 [senzing-factory/build-resources/.../add-to-project-dependabot.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/add-to-project-dependabot.yaml
 [senzing-factory/build-resources/.../add-to-project.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/add-to-project.yaml
 [senzing-factory/build-resources/.../dependabot-approve-and-merge.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/dependabot-approve-and-merge.yaml
 [senzing-factory/build-resources/.../lint-workflows.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/lint-workflows.yaml
 [senzing-factory/build-resources/.../move-pr-to-done-dependabot.yaml]: https://github.com/senzing-factory/build-resources/blob/main/.github/workflows/move-pr-to-done-dependabot.yaml
-[senzing-factory/github-action-docker-buildx-build]: https://github.com/senzing-factory/github-action-docker-buildx-build
 [senzing-factory/github-action-install-senzing-sdk]: https://github.com/senzing-factory/github-action-install-senzing-sdk
 [super-linter]: https://github.com/super-linter/super-linter

.github/workflows/README.md

@@ -1,9 +1,13 @@
-name: bandit
+name: Bandit
 
 on:
   pull_request:
     branches: [main]
 
+concurrency:
+  group: ${{ github.workflow }}-${{ github.head_ref || github.ref_name }}
+  cancel-in-progress: true
+
 permissions: {}
 
 jobs:
@@ -14,7 +18,8 @@ jobs:
     strategy:
       fail-fast: false
       matrix:
-        python-version: ["3.12"]
+        python-version: ["3.13"]
+    timeout-minutes: 10
 
     steps:
       - name: Run Bandit Scan

.github/workflows/bandit.yaml

@@ -1,16 +1,21 @@
-name: bearer
+name: Bearer
 
 on:
   pull_request:
     branches: [main]
 
+concurrency:
+  group: ${{ github.workflow }}-${{ github.head_ref || github.ref_name }}
+  cancel-in-progress: true
+
 permissions: {}
 
 jobs:
   rule_check:
     permissions:
       contents: read
     runs-on: ubuntu-latest
+    timeout-minutes: 10
 
     steps:
       - name: Checkout repository

.github/workflows/bearer.yaml

@@ -1,21 +1,26 @@
-name: black
+name: Black
 
 on:
   pull_request:
     branches: [main]
 
+concurrency:
+  group: ${{ github.workflow }}-${{ github.head_ref || github.ref_name }}
+  cancel-in-progress: true
+
 permissions: {}
 
 jobs:
   black:
-    name: black Python ${{ matrix.python-version }}
+    name: Black Python ${{ matrix.python-version }}
     permissions:
       contents: read
     runs-on: ubuntu-latest
     strategy:
       fail-fast: false
       matrix:
-        python-version: ["3.9", "3.10", "3.11", "3.12"]
+        python-version: ["3.10", "3.11", "3.12", "3.13"]
+    timeout-minutes: 10
 
     steps:
       - name: Checkout repository