Add initial conformance test

[williammartin]

Description

Given you have both github/github-mcp-server and mcp/github images available locally.

Requires -tags conformance to avoid polluting go test ./... with failures due to missing deps.

A failure looks like:

➜  github-mcp-server git:(wm/conformance-test) ✗ GITHUB_PERSONAL_ACCESS_TOKEN=foo go test -tags conformance -count 1 ./conformance
--- FAIL: TestCapabilities (0.57s)
    conformance_test.go:121: waiting for anthropic server to start...
    conformance_test.go:121: waiting for github server to start...
    conformance_test.go:33: sending anthropic: {"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2024-11-05","capabilities":{},"clientInfo":{"name":"ConformanceTest","version":"0.0.1"}}}

    conformance_test.go:33: received from anthropic: {"result":{"protocolVersion":"2024-11-05","capabilities":{"tools":{}},"serverInfo":{"name":"github-mcp-server","version":"0.1.0"}},"jsonrpc":"2.0","id":1}


    conformance_test.go:33: sending github: {"jsonrpc":"2.0","id":1,"method":"initialize","params":{"protocolVersion":"2024-11-05","capabilities":{},"clientInfo":{"name":"ConformanceTest","version":"0.0.1"}}}

    conformance_test.go:33: received from github: {"jsonrpc":"2.0","id":1,"result":{"protocolVersion":"2024-11-05","capabilities":{"resources":{},"tools":{"listChanged":true}},"serverInfo":{"name":"github-mcp-server","version":"0.0.1"}}}


    conformance_test.go:154: capabilities mismatch:
        Resources
        Tools.ListChanged

Notes

Lots of quality of life improvements to be had, lots of shortcuts taken, lots lots lots.

I tried to use testcontainers first to get some lifecycle management out of the box but it turns out they don't provide any way to get a handle to stdin.

I know the mark3labs module provides types for us, and probably we'll end up using them, but I was exploring the schema ground up as I was writing this, so it was exploratory for me too.

[SamMorrowDrums]

I think that's great work to get started. I think lettings these evolve and not standing in the way is the best way to get this going, so this is a bit of a LGTM review, but I did glance over all the lines 😅

[williammartin]

Well, the test currently fails so I don't want to merge it but thanks 😬 I'll probably put these behind a build tag.

[SamMorrowDrums]

Well, the test currently fails so I don't want to merge it but thanks 😬

Yeah I figured you'd fix it first, but whether you do that now, or in multiple PRs to me is secondary.

[williammartin]

Don't look too closely.

[williammartin]

Avert your eyes.

[williammartin]

Is call of Cthulhu.