Extend the connector to support gRPC APIs.
Requirements:
- Accept protobuf service definitions (.proto files or reflection)
- Map protobuf message types to Arrow/Spark schemas
- Call unary and server-streaming RPCs
- Handle gRPC pagination patterns (page tokens in request/response messages)
- Reuse existing Arrow conversion and Spark integration layers
Design considerations:
- Separate parser module (
grpc/Parser) for protobuf schema extraction
- Use ScalaPB or grpc-java for client generation
- Config:
type = grpc, proto = "path/to/service.proto", endpoint = "host:port"
- Server-streaming RPCs map naturally to fs2 Streams
Blocked by: Manual REST config workflow complete
Extend the connector to support gRPC APIs.
Requirements:
Design considerations:
grpc/Parser) for protobuf schema extractiontype = grpc,proto = "path/to/service.proto",endpoint = "host:port"Blocked by: Manual REST config workflow complete