|
| 1 | +--- |
| 2 | +mode: 'agent' |
| 3 | +description: 'Update src/tokenEstimators.json and src/modelPricing.json with missing models found in GitHub Copilot documentation.' |
| 4 | +tools: ['fetch', 'read_file', 'write_file', 'search_files'] |
| 5 | +--- |
| 6 | + |
| 7 | +# Sync Copilot Model Data |
| 8 | + |
| 9 | +Update `src/tokenEstimators.json` and `src/modelPricing.json` with missing models found in GitHub Copilot documentation. |
| 10 | + |
| 11 | +## Requirements |
| 12 | + |
| 13 | +1. Fetch and parse the GitHub Copilot supported models documentation page: |
| 14 | + - URL: https://docs.github.com/en/copilot/reference/ai-models/supported-models |
| 15 | + - Extract all model names from the "Supported AI models in Copilot" section |
| 16 | + - Model names should be normalized (lowercase, hyphens instead of spaces) |
| 17 | +2. Compare the extracted models list to: |
| 18 | + - `src/tokenEstimators.json` - contains character-to-token ratio estimators |
| 19 | + - `src/modelPricing.json` - contains pricing data (cost per million tokens) |
| 20 | +3. For each model from the documentation that is missing from either JSON file: |
| 21 | + - Add it to the appropriate JSON file(s) |
| 22 | + - Use sensible defaults based on existing similar models |
| 23 | + |
| 24 | +> **IMPORTANT**: Only add models that are **explicitly listed** on the documentation page above. Do NOT add models based on your own knowledge of AI models, third-party sources, or speculation about what models might exist. If a model is not present on that specific documentation page, it must not be added. |
| 25 | +
|
| 26 | +## Token Estimators (`src/tokenEstimators.json`) |
| 27 | + |
| 28 | +For missing models in tokenEstimators.json: |
| 29 | +- Add new entry to the `estimators` object |
| 30 | +- Use a default ratio of `0.25` (4 characters per token) unless you can infer from model family: |
| 31 | + - GPT-4 models: `0.25` |
| 32 | + - GPT-3.5 models: `0.25` |
| 33 | + - Claude models: `0.25` |
| 34 | + - o1 models: `0.25` |
| 35 | +- Format example: |
| 36 | + ```json |
| 37 | + "gpt-4o": 0.25 |
| 38 | + ``` |
| 39 | +- Maintain alphabetical ordering within model families |
| 40 | +- Group related models together (e.g., all gpt-4 variants, all claude variants) |
| 41 | + |
| 42 | +## Model Pricing (`src/modelPricing.json`) |
| 43 | + |
| 44 | +For missing models in modelPricing.json: |
| 45 | +- Add new entry to the `pricing` object |
| 46 | +- Structure: |
| 47 | + ```json |
| 48 | + "model-name": { |
| 49 | + "input": 0.00, |
| 50 | + "output": 0.00 |
| 51 | + } |
| 52 | + ``` |
| 53 | +- Where `input` and `output` are cost per million tokens |
| 54 | +- Use `0.00` as default (pricing will need manual verification later) |
| 55 | +- Add a note to the PR body that pricing needs verification |
| 56 | +- Maintain alphabetical ordering within model families |
| 57 | +- Group related models together |
| 58 | + |
| 59 | +## Metadata Updates |
| 60 | + |
| 61 | +- **ONLY** update `lastUpdated` field in `src/modelPricing.json` to today's date (YYYY-MM-DD format) **if you added new models to the pricing file** |
| 62 | +- If no models were added, do NOT update the `lastUpdated` field |
| 63 | +- Do NOT modify the `sources` section unless you have specific pricing data |
| 64 | +- Do NOT add models that are not explicitly listed on the documentation page — if a model is not on that page, skip it entirely |
| 65 | + |
| 66 | +## Output Format |
| 67 | + |
| 68 | +1. Make all necessary changes to both JSON files |
| 69 | +2. Ensure proper JSON formatting (2-space indentation) |
| 70 | +3. Maintain existing structure and patterns |
| 71 | +4. If no changes are needed, do nothing |
| 72 | + |
| 73 | +## Constraints |
| 74 | + |
| 75 | +- **Only add models that appear on the GitHub Copilot supported models documentation page** (`https://docs.github.com/en/copilot/reference/ai-models/supported-models`). Do NOT add models from any other source, from your own training knowledge, or that you believe might exist — only what is explicitly listed on that page. |
| 76 | +- Only modify `src/tokenEstimators.json` and `src/modelPricing.json` |
| 77 | +- Do not open a PR (the workflow will handle that) |
| 78 | +- Preserve all existing entries and formatting conventions |
| 79 | +- Use consistent spacing and indentation with existing file style |
| 80 | +- Models should be normalized (lowercase, hyphens instead of spaces) |
| 81 | + |
0 commit comments