Skip to content

Commit f60b67c

Browse files
Fix E2E test failures: replace fake-test-model, regenerate snapshots
- Replace 'fake-test-model' with 'claude-sonnet-4.5' in session.test.ts (runtime 1.0.20-1 validates model names) - Regenerate vision and session snapshots against published CLI Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 9ec25ef commit f60b67c

3 files changed

Lines changed: 53 additions & 56 deletions

File tree

nodejs/test/e2e/session.test.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ describe("Sessions", async () => {
1111
it("should create and disconnect sessions", async () => {
1212
const session = await client.createSession({
1313
onPermissionRequest: approveAll,
14-
model: "fake-test-model",
14+
model: "claude-sonnet-4.5",
1515
});
1616
expect(session.sessionId).toMatch(/^[a-f0-9-]+$/);
1717

@@ -20,7 +20,7 @@ describe("Sessions", async () => {
2020
expect(sessionStartEvents).toMatchObject([
2121
{
2222
type: "session.start",
23-
data: { sessionId: session.sessionId, selectedModel: "fake-test-model" },
23+
data: { sessionId: session.sessionId, selectedModel: "claude-sonnet-4.5" },
2424
},
2525
]);
2626

test/snapshots/session_config/vision_disabled_then_enabled_via_setmodel.yaml

Lines changed: 17 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -47,12 +47,13 @@ conversations:
4747
tool_call_id: toolcall_1
4848
content: Viewed image file successfully.
4949
- role: assistant
50-
content: The image shows the **GitHub Copilot logo** - a stylized hexagonal icon in shades of blue and purple with a
51-
distinctive geometric design. The logo features a three-dimensional hexagon shape with gradient colors
52-
transitioning from deep blue to lighter blue/purple tones, creating a modern, tech-forward aesthetic. This is
53-
GitHub's AI pair programming assistant branding.
50+
content: The image shows a **GitHub Copilot logo** - it's the distinctive orange/coral colored hexagonal icon with a
51+
stylized design inside. The logo appears on a transparent background and is the standard branding mark for
52+
GitHub Copilot.
5453
- role: user
5554
content: Use the view tool to look at the file test.png and describe what you see
55+
- role: assistant
56+
content: I'll view the test.png file again for you.
5657
- role: assistant
5758
tool_calls:
5859
- id: toolcall_2
@@ -92,13 +93,13 @@ conversations:
9293
tool_call_id: toolcall_1
9394
content: Viewed image file successfully.
9495
- role: assistant
95-
content: The image shows the **GitHub Copilot logo** - a stylized hexagonal icon in shades of blue and purple with a
96-
distinctive geometric design. The logo features a three-dimensional hexagon shape with gradient colors
97-
transitioning from deep blue to lighter blue/purple tones, creating a modern, tech-forward aesthetic. This is
98-
GitHub's AI pair programming assistant branding.
96+
content: The image shows a **GitHub Copilot logo** - it's the distinctive orange/coral colored hexagonal icon with a
97+
stylized design inside. The logo appears on a transparent background and is the standard branding mark for
98+
GitHub Copilot.
9999
- role: user
100100
content: Use the view tool to look at the file test.png and describe what you see
101101
- role: assistant
102+
content: I'll view the test.png file again for you.
102103
tool_calls:
103104
- id: toolcall_2
104105
type: function
@@ -119,16 +120,17 @@ conversations:
119120
- role: user
120121
- role: assistant
121122
content: >-
122-
Looking at the image from test.png, I can see what appears to be a **very light, nearly blank image** with a
123-
pale yellowish or off-white color. The image is quite minimal - it looks like either:
123+
Looking at the image you've shared, I can see it appears to be a mostly **white or very light colored image**
124+
with what looks like some very faint, barely visible marks or content. The image is quite minimal and appears
125+
to be either:
124126
125127
126-
- A blank/empty canvas with a subtle cream or pale yellow tint
128+
- A nearly blank white image
127129
128-
- A very light gradient or texture that's barely visible
130+
- An image with extremely light/faded content that's difficult to discern
129131
130-
- Possibly a placeholder or background image
132+
- Possibly some very subtle texture or pattern on a white background
131133
132134
133-
There's no distinct text, shapes, logos, or other clear visual elements visible in this image. It's
134-
essentially a solid light color fill, possibly with very subtle variations in tone.
135+
I apologize for my earlier incorrect description about the GitHub Copilot logo - that was not accurate. This
136+
image is actually quite sparse and minimal in content.

test/snapshots/session_config/vision_enabled_then_disabled_via_setmodel.yaml

Lines changed: 34 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -6,8 +6,6 @@ conversations:
66
content: ${system}
77
- role: user
88
content: Use the view tool to look at the file test.png and describe what you see
9-
- role: assistant
10-
content: I'll use the view tool to look at the test.png file and describe what I see.
119
- role: assistant
1210
tool_calls:
1311
- id: toolcall_0
@@ -28,7 +26,6 @@ conversations:
2826
- role: user
2927
content: Use the view tool to look at the file test.png and describe what you see
3028
- role: assistant
31-
content: I'll use the view tool to look at the test.png file and describe what I see.
3229
tool_calls:
3330
- id: toolcall_0
3431
type: function
@@ -49,29 +46,25 @@ conversations:
4946
- role: user
5047
- role: assistant
5148
content: >-
52-
I can see the image file test.png. It appears to be a mostly white or very light-colored image with minimal
53-
visible content. The image seems to be either:
54-
55-
56-
1. A blank or nearly blank white image
49+
I can see the test.png file. It appears to be a very light, mostly white or blank image. The image is
50+
extremely faint or washed out - if there is any content in it, it's barely visible against the white
51+
background. It could be:
5752
58-
2. An image with extremely faint or low-contrast content that's difficult to distinguish
5953
60-
3. Possibly a placeholder or test image
54+
- A blank/empty white image
6155
56+
- An image with very low contrast or heavily overexposed content
6257
63-
The image doesn't contain any clearly visible text, graphics, or distinguishable elements from what I can
64-
observe. It's essentially showing as a white/very light surface without obvious features.
58+
- An image with extremely faint watermarks or text that's nearly invisible
6559
6660
67-
Is this the expected content, or were you anticipating something different in this test image?
61+
Is this what you expected to see, or should there be more visible content in this image?
6862
- messages:
6963
- role: system
7064
content: ${system}
7165
- role: user
7266
content: Use the view tool to look at the file test.png and describe what you see
7367
- role: assistant
74-
content: I'll use the view tool to look at the test.png file and describe what I see.
7568
tool_calls:
7669
- id: toolcall_0
7770
type: function
@@ -91,22 +84,19 @@ conversations:
9184
content: Viewed image file successfully.
9285
- role: assistant
9386
content: >-
94-
I can see the image file test.png. It appears to be a mostly white or very light-colored image with minimal
95-
visible content. The image seems to be either:
87+
I can see the test.png file. It appears to be a very light, mostly white or blank image. The image is
88+
extremely faint or washed out - if there is any content in it, it's barely visible against the white
89+
background. It could be:
9690
9791
98-
1. A blank or nearly blank white image
92+
- A blank/empty white image
9993
100-
2. An image with extremely faint or low-contrast content that's difficult to distinguish
94+
- An image with very low contrast or heavily overexposed content
10195
102-
3. Possibly a placeholder or test image
96+
- An image with extremely faint watermarks or text that's nearly invisible
10397
10498
105-
The image doesn't contain any clearly visible text, graphics, or distinguishable elements from what I can
106-
observe. It's essentially showing as a white/very light surface without obvious features.
107-
108-
109-
Is this the expected content, or were you anticipating something different in this test image?
99+
Is this what you expected to see, or should there be more visible content in this image?
110100
- role: user
111101
content: Use the view tool to look at the file test.png and describe what you see
112102
- role: assistant
@@ -129,7 +119,6 @@ conversations:
129119
- role: user
130120
content: Use the view tool to look at the file test.png and describe what you see
131121
- role: assistant
132-
content: I'll use the view tool to look at the test.png file and describe what I see.
133122
tool_calls:
134123
- id: toolcall_0
135124
type: function
@@ -149,22 +138,19 @@ conversations:
149138
content: Viewed image file successfully.
150139
- role: assistant
151140
content: >-
152-
I can see the image file test.png. It appears to be a mostly white or very light-colored image with minimal
153-
visible content. The image seems to be either:
154-
141+
I can see the test.png file. It appears to be a very light, mostly white or blank image. The image is
142+
extremely faint or washed out - if there is any content in it, it's barely visible against the white
143+
background. It could be:
155144
156-
1. A blank or nearly blank white image
157145
158-
2. An image with extremely faint or low-contrast content that's difficult to distinguish
146+
- A blank/empty white image
159147
160-
3. Possibly a placeholder or test image
148+
- An image with very low contrast or heavily overexposed content
161149
150+
- An image with extremely faint watermarks or text that's nearly invisible
162151
163-
The image doesn't contain any clearly visible text, graphics, or distinguishable elements from what I can
164-
observe. It's essentially showing as a white/very light surface without obvious features.
165152
166-
167-
Is this the expected content, or were you anticipating something different in this test image?
153+
Is this what you expected to see, or should there be more visible content in this image?
168154
- role: user
169155
content: Use the view tool to look at the file test.png and describe what you see
170156
- role: assistant
@@ -187,9 +173,18 @@ conversations:
187173
content: Viewed image file successfully.
188174
- role: assistant
189175
content: >-
190-
Looking at test.png again, I can see it's a predominantly white or very light-colored image. The image appears
191-
to be blank or contains very minimal content that isn't easily visible against the white background. There are
192-
no clearly distinguishable text, shapes, graphics, or other visual elements that I can identify.
176+
I can see the test.png image. It shows what appears to be a very faint or washed-out image - it's
177+
predominantly white with possibly some very light content that's difficult to discern. The image appears to be
178+
either:
179+
180+
181+
1. A blank white image
182+
183+
2. An extremely overexposed photograph
184+
185+
3. An image with very low contrast where any content is barely visible
193186
194187
195-
The image seems to be a simple test image - possibly intentionally blank or nearly blank for testing purposes.
188+
Without more visible detail, I cannot identify specific objects, text, or patterns in the image. If there's
189+
supposed to be clear content in this image, it may be a display/rendering issue, or the image file itself
190+
might be corrupted or improperly saved.

0 commit comments

Comments
 (0)