Add support for additional vendor RAW families

Introduce handling for Casio, Sanyo, KyoceraRaw, Reconyx, Hp, Jvc, Ge, Motorola, Nintendo, and Microsoft across the codebase. Changes include: extend VendorRawProcessingFamily enum and vendor_raw_processing_family_name; add classification functions and tag/name/IFD heuristics in vendor_raw_processing.cc; expose new summaries in TransferSafetyAudit and populate them in transfer_safety_audit_from_store; add Python bindings and metaread/tool printing for the new families; update tests and many docs (MD/RST) to reflect the expanded family list and rendered-image safety semantics. These updates expand conservative vendor RAW/source-processing summaries and rendered-transfer safety coverage for the additional vendors.

Author: ssh4net

CHANGES.md

@@ -19,18 +19,21 @@ Changes compared with `0.4.8`.
 - Added `vendor_raw_processing_from_store()` and
   `classify_vendor_raw_processing_field()` for conservative Sony, Canon,
   Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung,
-  Ricoh, Apple, DJI, Google, and FLIR RAW/source-processing field summaries,
+  Ricoh, Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw, Reconyx, HP, JVC,
+  GE, Motorola, Nintendo, and Microsoft RAW/source-processing field summaries,
   including a vendor-private RAW table bucket for private or unknown table
   entries.
 - Python `Document` and `TransferSourceSnapshot` now expose
   `vendor_raw_processing(family)` for the same grouped
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR summaries.
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft summaries.
 - Added `transfer_safety_audit_from_store()` plus Python
   `transfer_safety_audit()` methods so hosts can preflight rendered-image
   drops by source group, filtered count, C2PA invalidation count, and
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR RAW/source-processing bucket.
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft RAW/source-processing bucket.
 
 ### Changed
 
@@ -42,16 +45,18 @@ Changes compared with `0.4.8`.
   and drops them for rendered outputs.
 - Rendered-image transfer safety now also filters decoded Sony, Canon, Nikon,
   Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, Ricoh,
-  Apple, DJI, Google, and FLIR MakerNote fields classified as source RAW,
+  Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw, Reconyx, HP, JVC, GE,
+  Motorola, Nintendo, and Microsoft MakerNote fields classified as source RAW,
   computational, thermal, color/WB, geometry/storage, raw-data, sensor,
-  lens-correction, or vendor-private table metadata.
+  lens-correction, preview/face geometry, stitch/panorama geometry, or
+  vendor-private table metadata.
 - `metaread` and `python -m openmeta.python.metaread` now print compact Phase
   One RAW geometry/processing summaries when those decoded fields are present.
 - `metaread` and `python -m openmeta.python.metaread` now print compact
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR
-  `vendor_raw_processing[...]` summaries when matching decoded fields are
-  present.
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft `vendor_raw_processing[...]` summaries when
+  matching decoded fields are present.
 - BMFF foreign-`meta` insertion now upgrades supported `iloc` version 0/1
   graphs to output `iloc` version 2 when inserted metadata needs 32-bit item
   IDs, removing the previous requirement that the target already used
@@ -77,16 +82,19 @@ Changes compared with `0.4.8`.
   normalized Phase One RAW geometry and raw-processing helper behavior.
 - Added public synthetic coverage for
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR RAW/source-processing
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft RAW/source-processing
   classification and grouped summary behavior.
 - Extended rendered-image safety coverage to verify Phase One/Leaf RAW
   geometry, color, raw-data/storage, black-level, and sensor-calibration fields
   are counted as raw-specific metadata and filtered from rendered transfers.
 - Extended rendered-image safety coverage to verify decoded Sony, Canon, Nikon,
   Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, Ricoh,
-  Apple, DJI, Google, and FLIR source-processing fields are counted as
+  Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw, Reconyx, HP, JVC, GE,
+  Motorola, Nintendo, and Microsoft source-processing fields are counted as
   raw/source-specific metadata and filtered from rendered transfers, including
-  anonymous/private RAW, computational, and thermal table entries.
+  anonymous/private RAW, computational, thermal, preview, face-geometry, and
+  stitch/panorama table entries.
 - Added rendered-image writer-output coverage for JPEG, TIFF/DNG, PNG, WebP,
   JP2, JXL, HEIF, AVIF, and CR3 metadata rewrites to verify serialized outputs
   omit source RAW calibration, vendor private RAW tables, MakerNotes, camera

docs/api_stability.md

@@ -22,8 +22,8 @@ different status.
 | Generic metadata traversal: `visit_metadata(...)`, `MetadataSink`, `ExportOptions`, `ExportItem` | `openmeta/interop_export.h` | Stable | v1 traversal contract. Borrowed names are valid only during `MetadataSink::on_item(...)`. |
 | `ExportNameStyle::Canonical` and `ExportNameStyle::XmpPortable` | `openmeta/interop_export.h` | Stable | Stable naming modes for key-space-aware and portable exports. |
 | `ExportNameStyle::FlatHost` | `openmeta/interop_export.h` | Stable | Stable v1 flat host naming contract. See [flat_host_mapping.md](flat_host_mapping.md). |
-| Vendor RAW-processing summaries: `vendor_raw_processing_from_store(...)`, `classify_vendor_raw_processing_field(...)` | `openmeta/vendor_raw_processing.h` | Experimental | Conservative grouped source-RAW/source-processing field summaries for decoded Sony, Canon, Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, Ricoh, Apple, DJI, Google, and FLIR MakerNotes, including vendor-private, computational, and thermal table buckets. Intended for audit/UI and rendered-transfer safety decisions, not for writing vendor RAW/source-processing values into rendered targets. |
-| Transfer safety audit: `transfer_safety_audit_from_store(...)` | `openmeta/metadata_transfer.h` | Experimental | Preflight summary of source entries and entries filtered or invalidated by `TransferSafetyMode`, including Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/Samsung/Ricoh/Apple/DJI/Google/FLIR RAW/source-processing buckets. Intended for diagnostics and host UI before preparing rendered-image transfers. |
+| Vendor RAW-processing summaries: `vendor_raw_processing_from_store(...)`, `classify_vendor_raw_processing_field(...)` | `openmeta/vendor_raw_processing.h` | Experimental | Conservative grouped source-RAW/source-processing field summaries for decoded Sony, Canon, Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, Ricoh, Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw, Reconyx, HP, JVC, GE, Motorola, Nintendo, and Microsoft MakerNotes, including vendor-private, computational, thermal, preview, face-geometry, and stitch/panorama buckets. Intended for audit/UI and rendered-transfer safety decisions, not for writing vendor RAW/source-processing values into rendered targets. |
+| Transfer safety audit: `transfer_safety_audit_from_store(...)` | `openmeta/metadata_transfer.h` | Experimental | Preflight summary of source entries and entries filtered or invalidated by `TransferSafetyMode`, including Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/GE/Motorola/Nintendo/Microsoft RAW/source-processing buckets. Intended for diagnostics and host UI before preparing rendered-image transfers. |
 | Source snapshot type and read helpers: `TransferSourceSnapshot`, `read_transfer_source_snapshot_file(...)`, `read_transfer_source_snapshot_bytes(...)`, `build_transfer_source_snapshot(...)` | `openmeta/metadata_transfer.h` | Experimental | Current snapshots are decoded-store-backed and do not preserve raw source packets for passthrough. Const reuse is safe when callers do not mutate the snapshot and do not share returned result objects across writers. |
 | Fileless preparation: `prepare_metadata_for_target_snapshot(...)` | `openmeta/metadata_transfer.h` | Experimental | Intended for hosts that already decoded metadata and want to prepare transfer artifacts without reopening the source file. |
 | Snapshot execution: `execute_prepared_transfer_snapshot(...)` | `openmeta/metadata_transfer.h` | Experimental | Intended for deferred save/writeback from a reusable decoded source snapshot. |

docs/development.md

@@ -1139,7 +1139,8 @@ Current Python binding entry points:
   source metadata queries.
 - `Document.vendor_raw_processing(family)` for
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR grouped RAW/source-processing field
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft grouped RAW/source-processing field
   summaries.
 
 Current C++ interop entry points:

docs/host_integration.md

@@ -430,7 +430,7 @@ Use `TransferProfile::safety` for the broad source/destination relationship:
 | Mode | Use when | Transfer policy |
 | --- | --- | --- |
 | `CompatibleFile` | Metadata is repackaged or recompressed into a compatible file/pixel representation | Preserve source camera, color, ICC, and camera-specific data except target-owned image-layout fields |
-| `RenderedImage` | Pixels may have changed, especially RAW-to-JPEG/PNG/WebP/JXL/HEIF/AVIF export | Keep general/time/GPS/IPTC/portable XMP; drop source raw color calibration, linearization/crop/correction metadata, vendor RAW/source-processing geometry/color/correction/thermal/computational fields, camera raw settings XMP, source ICC, opaque MakerNotes, and non-C2PA JUMBF |
+| `RenderedImage` | Pixels may have changed, especially RAW-to-JPEG/PNG/WebP/JXL/HEIF/AVIF export | Keep general/time/GPS/IPTC/portable XMP; drop source raw color calibration, linearization/crop/correction metadata, vendor RAW/source-processing geometry/color/correction/thermal/computational/private/stitch fields, camera raw settings XMP, source ICC, opaque MakerNotes, and non-C2PA JUMBF |
 
 See [writer_target_contract.md](writer_target_contract.md#transfer-safety-matrix)
 for the detailed per-group transfer matrix.
@@ -525,12 +525,14 @@ The `metaread` command prints compact `phaseone_raw_geometry=...` and
 ## 10. Query Vendor RAW Processing Metadata
 
 For Sony, Canon, Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta,
-Sigma, Samsung, Ricoh, Apple, DJI, Google, and FLIR, OpenMeta exposes a
+Sigma, Samsung, Ricoh, Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw,
+Reconyx, HP, JVC, GE, Motorola, Nintendo, and Microsoft, OpenMeta exposes a
 conservative grouped summary instead of vendor-specific decoded values. The
 helper reports whether decoded MakerNote fields look like source RAW color/WB,
 geometry/storage, lens correction, raw-data, sensor-calibration,
-computational, thermal, or vendor-private table metadata. Use it to audit
-transfer safety decisions and host UI, not as a rendered-output write source.
+computational, thermal, preview/face geometry, stitch/panorama geometry, or
+vendor-private table metadata. Use it to audit transfer safety decisions and
+host UI, not as a rendered-output write source.
 
 ```cpp
 #include "openmeta/vendor_raw_processing.h"
@@ -568,7 +570,7 @@ print(audit["filtered_raw_color_calibration"])
 ```
 
 `metaread` prints
-`vendor_raw_processing[sony|canon|nikon|fujifilm|pentax|panasonic|olympus|kodak|minolta|sigma|samsung|ricoh]=...`
+`vendor_raw_processing[sony|canon|nikon|fujifilm|pentax|panasonic|olympus|kodak|minolta|sigma|samsung|ricoh|apple|dji|google|flir|casio|sanyo|kyoceraraw|reconyx|hp|jvc|ge|motorola|nintendo|microsoft]=...`
 summaries when matching decoded fields are present.
 
 ## 11. Build `MetaStore` Yourself

docs/metadata_transfer_plan.md

@@ -208,10 +208,10 @@ Implemented:
 - rendered-output safety mode: `TransferProfile::safety =
   TransferSafetyMode::RenderedImage` additionally drops source raw color
   calibration, linearization/crop/correction metadata, vendor RAW
-  geometry/color/correction fields, camera raw settings XMP, source ICC
-  profiles, MakerNotes, and non-C2PA JUMBF data. It is intended for
-  RAW-to-rendered or otherwise pixel-changing exports where host code must
-  provide target-correct color/profile data.
+  geometry/color/correction/thermal/computational/private/stitch fields,
+  camera raw settings XMP, source ICC profiles, MakerNotes, and non-C2PA JUMBF
+  data. It is intended for RAW-to-rendered or otherwise pixel-changing exports
+  where host code must provide target-correct color/profile data.
 - bounded DNG-style merge policy in the file-helper path:
   source-supplied preview/aux front structures replace the target front
   structures, while existing target page tails and trailing auxiliary

docs/sphinx/api_stability.rst

@@ -76,18 +76,21 @@ Host-facing API map
      - Experimental
      - Conservative grouped source-RAW/source-processing field summaries for decoded Sony,
        Canon, Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta,
-       Sigma, Samsung, Ricoh, Apple, DJI, Google, and FLIR MakerNotes,
-       including vendor-private, computational, and thermal table buckets.
-       Intended for audit/UI and rendered-transfer safety decisions, not for
-       writing vendor RAW/source-processing values into rendered targets.
+       Sigma, Samsung, Ricoh, Apple, DJI, Google, FLIR, Casio, Sanyo,
+       KyoceraRaw, Reconyx, HP, JVC, GE, Motorola, Nintendo, and Microsoft
+       MakerNotes, including vendor-private, computational, thermal, preview,
+       face-geometry, and stitch/panorama buckets. Intended for audit/UI and
+       rendered-transfer safety decisions, not for writing vendor
+       RAW/source-processing values into rendered targets.
    * - Transfer safety audit:
        ``transfer_safety_audit_from_store(...)``
      - ``openmeta/metadata_transfer.h``
      - Experimental
      - Preflight summary of source entries and entries filtered or invalidated
        by ``TransferSafetyMode``, including
        Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/
-       Sigma/Samsung/Ricoh/Apple/DJI/Google/FLIR RAW/source-processing
+       Sigma/Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/
+       Reconyx/HP/JVC/GE/Motorola/Nintendo/Microsoft RAW/source-processing
        buckets. Intended for diagnostics and host UI before preparing
        rendered-image transfers.
    * - Source snapshot type and read helpers:

docs/sphinx/development.rst

@@ -68,7 +68,8 @@ Python binding entry points:
   source metadata queries.
 - ``Document.vendor_raw_processing(family)`` for
   Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/Sigma/
-  Samsung/Ricoh/Apple/DJI/Google/FLIR grouped RAW/source-processing field
+  Samsung/Ricoh/Apple/DJI/Google/FLIR/Casio/Sanyo/KyoceraRaw/Reconyx/HP/JVC/
+  GE/Motorola/Nintendo/Microsoft grouped RAW/source-processing field
   summaries.
 
 C++ adapter entry points:

docs/sphinx/host_integration.rst

@@ -407,7 +407,7 @@ Use ``TransferProfile::safety`` for the broad source/destination relationship:
      - Preserve source camera, color, ICC, and camera-specific data except target-owned image-layout fields
    * - ``RenderedImage``
      - Pixels may have changed, especially RAW-to-JPEG/PNG/WebP/JXL/HEIF/AVIF export
-     - Keep general/time/GPS/IPTC/portable XMP; drop source raw color calibration, linearization/crop/correction metadata, vendor RAW/source-processing geometry/color/correction/thermal/computational fields, camera raw settings XMP, source ICC, opaque MakerNotes, and non-C2PA JUMBF
+     - Keep general/time/GPS/IPTC/portable XMP; drop source raw color calibration, linearization/crop/correction metadata, vendor RAW/source-processing geometry/color/correction/thermal/computational/private/stitch fields, camera raw settings XMP, source ICC, opaque MakerNotes, and non-C2PA JUMBF
 
 See :ref:`transfer-safety-matrix` for the detailed per-group transfer matrix.
 
@@ -503,12 +503,14 @@ Vendor RAW Processing Metadata
 ------------------------------
 
 For Sony, Canon, Nikon, Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta,
-Sigma, Samsung, Ricoh, Apple, DJI, Google, and FLIR, OpenMeta exposes a
+Sigma, Samsung, Ricoh, Apple, DJI, Google, FLIR, Casio, Sanyo, KyoceraRaw,
+Reconyx, HP, JVC, GE, Motorola, Nintendo, and Microsoft, OpenMeta exposes a
 conservative grouped summary instead of vendor-specific decoded values. The
 helper reports whether decoded MakerNote fields look like source RAW color/WB,
 geometry/storage, lens correction, raw-data, sensor-calibration,
-computational, thermal, or vendor-private table metadata. Use it to audit
-transfer safety decisions and host UI, not as a rendered-output write source.
+computational, thermal, preview/face geometry, stitch/panorama geometry, or
+vendor-private table metadata. Use it to audit transfer safety decisions and
+host UI, not as a rendered-output write source.
 
 .. code-block:: cpp
 
@@ -546,7 +548,7 @@ Python uses the same family enum:
    print(audit["filtered_raw_color_calibration"])
 
 ``metaread`` prints
-``vendor_raw_processing[sony|canon|nikon|fujifilm|pentax|panasonic|olympus|kodak|minolta|sigma|samsung|ricoh]=...``
+``vendor_raw_processing[sony|canon|nikon|fujifilm|pentax|panasonic|olympus|kodak|minolta|sigma|samsung|ricoh|apple|dji|google|flir|casio|sanyo|kyoceraraw|reconyx|hp|jvc|ge|motorola|nintendo|microsoft]=...``
 summaries when matching decoded fields are present.
 
 Related pages

docs/sphinx/writer_target_contract.rst

@@ -58,12 +58,15 @@ target-owned image-layout filter above. ``RenderedImage`` is for exports whose
 pixels may have changed, including RAW-to-rendered outputs. It keeps general
 descriptive metadata, time fields, GPS, IPTC, and portable XMP, but filters
 source raw color calibration, linearization/crop/correction tags, vendor RAW
-geometry/color/correction tags for Phase One/Leaf, Sony, Canon, Nikon,
-Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, and
-Ricoh, Apple/Google computational capture fields, DJI/FLIR thermal processing
-fields, camera raw settings XMP, source ICC profiles, MakerNotes, and non-C2PA
-JUMBF data. Host code should provide target-correct ICC/profile data and image
-specs separately.
+geometry/color/correction/private tags for Phase One/Leaf, Sony, Canon, Nikon,
+Fujifilm, Pentax, Panasonic, Olympus, Kodak, Minolta, Sigma, Samsung, Ricoh,
+Apple/Google computational capture fields, DJI/FLIR thermal processing fields,
+Casio/Sanyo preview or face-geometry fields, KyoceraRaw WB fields, Reconyx
+trail-camera processing/environment fields, HP/JVC/GE private placeholders,
+Motorola source-rendering/sensor fields, Nintendo parallax/camera-info fields,
+Microsoft stitch/panorama geometry fields, camera raw settings XMP, source ICC
+profiles, MakerNotes, and non-C2PA JUMBF data. Host code should provide
+target-correct ICC/profile data and image specs separately.
 
 .. _transfer-safety-matrix:
 
@@ -137,8 +140,9 @@ controls. Hosts may still strip more metadata.
        ``ColorMatrix1``, ``ColorMatrix2``, ``WB_RGBLevels``,
        sensor-calibration flat fields and linearization coefficients,
        Sony/Canon/Nikon/Fujifilm/Pentax/Panasonic/Olympus/Kodak/Minolta/
-       Sigma/Samsung/Ricoh/Apple MakerNote color, HDR, and white-balance
-       coefficient tables
+       Sigma/Samsung/Ricoh/Apple/Casio/Sanyo/KyoceraRaw/Reconyx/Motorola
+       MakerNote color, HDR, source-rendering, and white-balance coefficient
+       tables
      - Keep only for compatible RAW/DNG-style transfer
      - Drop
      - These values describe how to turn original sensor data into rendered
@@ -160,7 +164,11 @@ controls. Hosts may still strip more metadata.
        raw-histogram fields, Samsung Type2 raw/color/correction fields, Ricoh
        sensor/crop/vignetting fields, Apple computational capture/HDR fields,
        Google HDR+ and shot-log fields, DJI thermal parameter tables, FLIR
-       thermal raw-data/radiometric calibration/palette/PiP fields, Canon
+       thermal raw-data/radiometric calibration/palette/PiP fields,
+       Casio/Sanyo preview image, face geometry, and private data-dump fields,
+       Reconyx trail-camera environment/trigger fields, HP/JVC/GE private
+       placeholders, Motorola sensor fields, Nintendo parallax/camera-info
+       fields, Microsoft stitch/panorama geometry fields, Canon
        crop/aspect/color-data tables, and Nikon NEF/distortion/vignette tables
        or named correction fields
      - Keep only for compatible RAW/DNG-style transfer