Skip to content

docs(cesium-context7): improve skill description, restructure content, and add evals#24

Open
MKartaviciute wants to merge 3 commits into
mainfrom
maka/update-cesium-context7-with-eval
Open

docs(cesium-context7): improve skill description, restructure content, and add evals#24
MKartaviciute wants to merge 3 commits into
mainfrom
maka/update-cesium-context7-with-eval

Conversation

@MKartaviciute
Copy link
Copy Markdown
Contributor

@MKartaviciute MKartaviciute commented Mar 18, 2026

Description

This pull request significantly revises the Cesium Context7 skill documentation to clarify usage guidelines, improve workflow instructions, and add example queries. It also introduces a new evaluation file to test the skill's behavior across common Cesium-related scenarios. The most important changes are grouped below:

Documentation overhaul and workflow improvements:

  • The SKILL.md file for cesium-context7 has been rewritten to clarify when and how to use the skill, emphasize always fetching documentation before writing or reviewing code, and provide a concise workflow with example queries for CesiumJS, Unreal, Unity, and 3D Tiles. It now includes a table of library IDs and query tips for better results.
  • The previous .github/skills/cesium-context7/SKILL.md version has been removed, eliminating redundant and less clear instructions.

Evaluation and testing additions:

  • A new evals.json file has been added under skills/cesium-context7/evals/, containing five realistic evaluation scenarios. These cover CesiumJS entity placement, 3D Tiles refinement, Unreal Engine globe anchoring, CesiumJS camera animation, and feature styling, each with expectations for correct tool usage and accurate, documentation-based answers.

Issue number and link

Testing plan

Author checklist

  • I have submitted a Contributor License Agreement
  • I have performed a self-review of my code

@MKartaviciute MKartaviciute marked this pull request as ready for review March 18, 2026 09:40
@MKartaviciute MKartaviciute requested a review from jdehorty March 18, 2026 09:41
@MKartaviciute MKartaviciute assigned rkkr and unassigned rkkr Mar 18, 2026
@MKartaviciute MKartaviciute requested a review from rkkr March 18, 2026 09:41
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there supposed to be a harness for this file? How are you running this?

{
"id": 3,
"prompt": "I'm using Cesium for Unreal Engine 5. I have a Blueprint actor that I want to always stay at a fixed lat/lon on the globe, even as the player moves around. I tried setting the actor's world position but it drifts. What's the correct way to do this?",
"expected_output": "Guidance on using ACesiumGlobeAnchor (Globe Anchor) component to lock a Blueprint actor to a geographic coordinate, based on fetched docs from /cesiumgs/cesium-unreal.",
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is ACesiumGlobeAnchor a hallucinated class name? Where did this come from?

@@ -1,73 +0,0 @@
---
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PR removes .github/skills/cesium-context7/SKILL.md, but the README still tells users to configure that exact path for GitHub Copilot.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is under workspace specific recommendations, so I don't think it is a problem. The issue is that it is quite difficult to main the same content in 2 places

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants