Migrate JSON ingestion specs into gem (#1224)

## Why
The JSON ingestion gem should own the JSON-schema tests that cover its
extracted implementation so the gem can enforce full coverage without a
SimpleCov skip.

## What
- Move JSON schema generation, metadata merge, pruner, and matcher specs
into `elasticgraph-json_ingestion`.
- Add JSON-ingestion artifact-manager integration coverage for versioned
schema artifacts, version-bump enforcement, metadata refresh, and schema
evolution diagnostics.
- Add focused wrapper/scalar specs for the remaining extracted
JSON-ingestion paths.
- Remove the temporary SimpleCov filter for
`elasticgraph-json_ingestion`.

## Verification
- `script/run_gem_specs elasticgraph-json_ingestion`
- `script/type_check elasticgraph-json_ingestion`
- `BUNDLE_GEMFILE=Gemfile bundle exec rspec --format progress
spec/integration/elastic_graph/schema_definition/rake_tasks_spec.rb
spec/unit/elastic_graph/schema_definition/runtime_metadata/scalar_types_by_name_spec.rb`
from `elasticgraph-schema_definition/`
- `bundle exec standardrb ...` on touched specs/support

`script/run_gem_specs elasticgraph-schema_definition` and
`script/run_gem_specs elasticgraph-json_ingestion` both pass with 100%
coverage (with the test datastore booted).

## Follow-ups

- The migrated spec files keep the compact `module
JSONIngestion::SchemaDefinition` form so that git/GitHub detects them as
file moves. A follow-up PR (after this stack merges) will convert them
to the standard nested module style and re-indent.
- The JSON-schema-versioning scenarios that the new
`schema_artifact_manager_extension_spec.rb` covers have been removed
from the core `rake_tasks_spec.rb`; the core lines they exercised are
now covered by focused unit specs instead.

## Stack
Current PR is marked with `->`.

- [#1199 Add JSON ingestion gem
shell](#1199)
- [#1200 Add schema definition extension
plumbing](#1200)
- [#1201 Move JSON schema helpers to json ingestion
gem](#1201)
- [#1203 Namespace JSON schema helpers under JSON
ingestion](#1203)
- [#1204 Add JSON ingestion indexing
extensions](#1204)
- [#1215 Wire JSON ingestion schema extension
modules](#1215)
- [#1205 Use JSON ingestion as schema definition
extension](#1205)
- [#1202 Document JSON ingestion schema
APIs](#1202)
- -> [#1224 Migrate JSON ingestion specs into
gem](#1224)
- [#1220 Add configurable indexing event
decoder](#1220)

Author: jwils

elasticgraph-json_ingestion/lib/elastic_graph/json_ingestion/schema_definition/factory_extension.rb

@@ -90,7 +90,7 @@ def new_scalar_type(name)
               extended_type.json_schema(**options)
             end
 
-            yield extended_type if block_given?
+            yield extended_type
             extended_type.finalize_json_schema_configuration!
           end
         end
@@ -104,7 +104,7 @@ def new_scalar_indexing_field_type(scalar_type:)
         def new_type_with_subfields(schema_kind, name, wrapping_type:, field_factory:)
           super(schema_kind, name, wrapping_type: wrapping_type, field_factory: field_factory) do |type|
             extended_type = type.extend(SchemaElements::TypeWithSubfieldsExtension) # : ::ElasticGraph::SchemaDefinition::SchemaElements::TypeWithSubfields & SchemaElements::TypeWithSubfieldsExtension
-            yield extended_type if block_given?
+            yield extended_type
           end
         end
 

elasticgraph-json_ingestion/lib/elastic_graph/json_ingestion/schema_definition/indexing/field_type/enum.rb

@@ -7,6 +7,7 @@
 # frozen_string_literal: true
 
 require "delegate"
+require "elastic_graph/json_ingestion/schema_definition/indexing/field_type/value_semantics"
 require "elastic_graph/schema_definition/indexing/field_type/enum"
 
 module ElasticGraph
@@ -19,6 +20,10 @@ module FieldType
           #
           # @private
           class Enum < DelegateClass(ElasticGraph::SchemaDefinition::Indexing::FieldType::Enum)
+            prepend ValueSemantics
+
+            # @dynamic __getobj__
+
             # @return [Hash<String, ::Object>] additional ElasticGraph metadata to put in the JSON schema for this enum type.
             def json_schema_field_metadata_by_field_name
               {}

elasticgraph-json_ingestion/lib/elastic_graph/json_ingestion/schema_definition/indexing/field_type/scalar.rb

@@ -7,6 +7,7 @@
 # frozen_string_literal: true
 
 require "delegate"
+require "elastic_graph/json_ingestion/schema_definition/indexing/field_type/value_semantics"
 require "elastic_graph/schema_definition/indexing/field_type/scalar"
 require "elastic_graph/support/hash_util"
 
@@ -19,6 +20,10 @@ module FieldType
           #
           # @private
           class Scalar < DelegateClass(ElasticGraph::SchemaDefinition::Indexing::FieldType::Scalar)
+            prepend ValueSemantics
+
+            # @dynamic __getobj__
+
             # @return [Hash] empty hash, as scalar types have no subfields
             def json_schema_field_metadata_by_field_name
               {}

elasticgraph-json_ingestion/lib/elastic_graph/json_ingestion/schema_definition/indexing/field_type/union.rb

@@ -7,6 +7,7 @@
 # frozen_string_literal: true
 
 require "delegate"
+require "elastic_graph/json_ingestion/schema_definition/indexing/field_type/value_semantics"
 require "elastic_graph/schema_definition/indexing/field_type/union"
 
 module ElasticGraph
@@ -18,6 +19,10 @@ module FieldType
           #
           # @private
           class Union < DelegateClass(ElasticGraph::SchemaDefinition::Indexing::FieldType::Union)
+            prepend ValueSemantics
+
+            # @dynamic __getobj__
+
             # @return [Hash] empty hash, as union types have no subfields
             def json_schema_field_metadata_by_field_name
               {}

elasticgraph-json_ingestion/lib/elastic_graph/json_ingestion/schema_definition/indexing/field_type/value_semantics.rb

@@ -0,0 +1,52 @@
+# Copyright 2024 - 2026 Block, Inc.
+#
+# Use of this source code is governed by an MIT-style
+# license that can be found in the LICENSE file or at
+# https://opensource.org/licenses/MIT.
+#
+# frozen_string_literal: true
+
+module ElasticGraph
+  module JSONIngestion
+    module SchemaDefinition
+      module Indexing
+        module FieldType
+          # Provides value-equality semantics for the JSON-schema-aware field type wrappers that delegate
+          # to a wrapped core field type without adding any state of their own (`Scalar`, `Enum`, `Union`).
+          #
+          # `DelegateClass` defines `==` so that it unwraps only the *left* operand before comparing, which
+          # means `wrapper == equivalent_wrapper` compares the wrapped object against the right-hand
+          # *wrapper* (rather than against its wrapped object) and is therefore never equal--even though
+          # `hash` delegates to the wrapped object and reports them equal. That inconsistency breaks the
+          # `eql?`/`hash` contract and causes `Set`/`Hash`/`uniq` de-duplication to treat equivalent
+          # wrappers as distinct. Here we unwrap both sides so two wrappers around equal objects compare
+          # equal, keeping `==`/`eql?`/`hash` consistent. (`FieldType::Object` solves the same problem with
+          # its own implementation because it carries additional JSON schema state in its equality.)
+          #
+          # @private
+          module ValueSemantics
+            # @param other [Object] the object to compare against
+            # @return [Boolean] true when `other` wraps an equal field type (or is the wrapped field type itself)
+            def ==(other)
+              case other
+              when ValueSemantics
+                __getobj__ == other.__getobj__
+              else
+                super
+              end
+            end
+
+            def eql?(other)
+              self == other
+            end
+
+            # @return [Integer] a hash code derived from the wrapped field type
+            def hash
+              __getobj__.hash
+            end
+          end
+        end
+      end
+    end
+  end
+end

elasticgraph-json_ingestion/sig/elastic_graph/json_ingestion/schema_definition/factory_extension.rbs

@@ -13,14 +13,14 @@ module ElasticGraph
           subfields: ::Array[Indexing::Field],
           mapping_options: ::ElasticGraph::SchemaDefinition::Mixins::HasTypeInfo::optionsHash
         ) -> Indexing::FieldType::Object
-        def new_scalar_type: (::String) ?{ (::ElasticGraph::SchemaDefinition::SchemaElements::ScalarType & SchemaElements::ScalarTypeExtension) -> void } -> (::ElasticGraph::SchemaDefinition::SchemaElements::ScalarType & SchemaElements::ScalarTypeExtension)
+        def new_scalar_type: (::String) { (::ElasticGraph::SchemaDefinition::SchemaElements::ScalarType & SchemaElements::ScalarTypeExtension) -> void } -> (::ElasticGraph::SchemaDefinition::SchemaElements::ScalarType & SchemaElements::ScalarTypeExtension)
         def new_scalar_indexing_field_type: (scalar_type: ::ElasticGraph::SchemaDefinition::SchemaElements::ScalarType) -> Indexing::FieldType::Scalar
         def new_type_with_subfields: (
           ::ElasticGraph::SchemaDefinition::SchemaElements::schemaKind,
           ::String,
           wrapping_type: ::ElasticGraph::SchemaDefinition::SchemaElements::anyObjectType,
           field_factory: ::Method
-        ) ?{ (::ElasticGraph::SchemaDefinition::SchemaElements::TypeWithSubfields & SchemaElements::TypeWithSubfieldsExtension) -> void } -> (::ElasticGraph::SchemaDefinition::SchemaElements::TypeWithSubfields & SchemaElements::TypeWithSubfieldsExtension)
+        ) { (::ElasticGraph::SchemaDefinition::SchemaElements::TypeWithSubfields & SchemaElements::TypeWithSubfieldsExtension) -> void } -> (::ElasticGraph::SchemaDefinition::SchemaElements::TypeWithSubfields & SchemaElements::TypeWithSubfieldsExtension)
         def new_union_indexing_field_type: (::Hash[::String, Indexing::FieldType::Object]) -> Indexing::FieldType::Union
         def new_results: () -> ::ElasticGraph::SchemaDefinition::Results
         def new_schema_artifact_manager: (**untyped) -> ::ElasticGraph::SchemaDefinition::SchemaArtifactManager

elasticgraph-json_ingestion/sig/elastic_graph/json_ingestion/schema_definition/indexing/field_type/enum.rbs

@@ -8,9 +8,12 @@ module ElasticGraph
           end
 
           class Enum < EnumSupertype
+            include ValueSemantics
+
             def json_schema_field_metadata_by_field_name: () -> ::Hash[::String, JSONSchemaFieldMetadata]
             def format_field_json_schema_customizations: (::Hash[::String, untyped]) -> ::Hash[::String, untyped]
             def to_json_schema: () -> ::Hash[::String, untyped]
+            def __getobj__: () -> ::ElasticGraph::SchemaDefinition::Indexing::FieldType::Enum
           end
         end
       end

elasticgraph-json_ingestion/sig/elastic_graph/json_ingestion/schema_definition/indexing/field_type/scalar.rbs

@@ -8,9 +8,12 @@ module ElasticGraph
           end
 
           class Scalar < ScalarSupertype
+            include ValueSemantics
+
             def json_schema_field_metadata_by_field_name: () -> ::Hash[::String, JSONSchemaFieldMetadata]
             def format_field_json_schema_customizations: (::Hash[::String, untyped]) -> ::Hash[::String, untyped]
             def to_json_schema: () -> ::Hash[::String, untyped]
+            def __getobj__: () -> ::ElasticGraph::SchemaDefinition::Indexing::FieldType::Scalar
           end
         end
       end

elasticgraph-json_ingestion/sig/elastic_graph/json_ingestion/schema_definition/indexing/field_type/union.rbs

@@ -8,11 +8,14 @@ module ElasticGraph
           end
 
           class Union < UnionSupertype
+            include ValueSemantics
+
             def self.new: (::ElasticGraph::SchemaDefinition::Indexing::FieldType::Union) -> instance
 
             def json_schema_field_metadata_by_field_name: () -> ::Hash[::String, JSONSchemaFieldMetadata]
             def format_field_json_schema_customizations: (::Hash[::String, untyped]) -> ::Hash[::String, untyped]
             def to_json_schema: () -> ::Hash[::String, untyped]
+            def __getobj__: () -> ::ElasticGraph::SchemaDefinition::Indexing::FieldType::Union
           end
         end
       end

elasticgraph-json_ingestion/sig/elastic_graph/json_ingestion/schema_definition/indexing/field_type/value_semantics.rbs

@@ -0,0 +1,22 @@
+module ElasticGraph
+  module JSONIngestion
+    module SchemaDefinition
+      module Indexing
+        module FieldType
+          module ValueSemantics : _Delegator
+            def ==: (untyped other) -> bool
+            def eql?: (untyped other) -> bool
+            def hash: () -> ::Integer
+          end
+
+          interface _Delegator
+            def __getobj__: () -> untyped
+
+            # Provided by `DelegateClass`; `ValueSemantics#==` calls `super` to fall back to it.
+            def ==: (untyped other) -> bool
+          end
+        end
+      end
+    end
+  end
+end