Skip to content

Commit cc1ad7c

Browse files
jimbobbennettclaude
jimbobbennett
and
claude
committed
Add arize-ax and phoenix plugins
Bundle the 9 Arize skills into an arize-ax plugin and the 3 Phoenix skills into a phoenix plugin for easier installation as single packages. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent d18e2c8 commit cc1ad7c

File tree

6 files changed

+117
-0
lines changed

6 files changed

+117
-0
lines changed

‎.github/plugin/marketplace.json‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,12 @@
1010
"email": "copilot@github.com"
1111
},
1212
"plugins": [
13+
{
14+
"name": "arize-ax",
15+
"source": "arize-ax",
16+
"description": "Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.",
17+
"version": "1.0.0"
18+
},
1319
{
1420
"name": "automate-this",
1521
"source": "automate-this",
@@ -393,6 +399,12 @@
393399
"description": "Complete toolkit for developing custom code components using Power Apps Component Framework for model-driven and canvas apps",
394400
"version": "1.0.0"
395401
},
402+
{
403+
"name": "phoenix",
404+
"source": "phoenix",
405+
"description": "Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation.",
406+
"version": "1.0.0"
407+
},
396408
{
397409
"name": "php-mcp-development",
398410
"source": "php-mcp-development",

‎docs/README.plugins.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,6 +25,7 @@ See [CONTRIBUTING.md](../CONTRIBUTING.md#adding-plugins) for guidelines on how t
2525

2626
| Name | Description | Items | Tags |
2727
| ---- | ----------- | ----- | ---- |
28+
| [arize-ax](../plugins/arize-ax/README.md) | Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI. | 9 items | arize, llm, observability, tracing, evaluation, instrumentation, datasets, experiments, prompt-optimization |
2829
| [automate-this](../plugins/automate-this/README.md) | Record your screen doing a manual process, drop the video on your Desktop, and let Copilot CLI analyze it frame-by-frame to build working automation scripts. Supports narrated recordings with audio transcription. | 1 items | automation, screen-recording, workflow, video-analysis, process-automation, scripting, productivity, copilot-cli |
2930
| [awesome-copilot](../plugins/awesome-copilot/README.md) | Meta prompts that help you discover and generate curated GitHub Copilot agents, instructions, prompts, and skills. | 4 items | github-copilot, discovery, meta, prompt-engineering, agents |
3031
| [azure-cloud-development](../plugins/azure-cloud-development/README.md) | Comprehensive Azure cloud development tools including Infrastructure as Code, serverless functions, architecture patterns, and cost optimization for building scalable cloud applications. | 11 items | azure, cloud, infrastructure, bicep, terraform, serverless, architecture, devops |
@@ -59,6 +60,7 @@ See [CONTRIBUTING.md](../CONTRIBUTING.md#adding-plugins) for guidelines on how t
5960
| [ospo-sponsorship](../plugins/ospo-sponsorship/README.md) | Tools and resources for Open Source Program Offices (OSPOs) to identify, evaluate, and manage sponsorship of open source dependencies through GitHub Sponsors, Open Collective, and other funding platforms. | 1 items | |
6061
| [partners](../plugins/partners/README.md) | Custom agents that have been created by GitHub partners | 20 items | devops, security, database, cloud, infrastructure, observability, feature-flags, cicd, migration, performance |
6162
| [pcf-development](../plugins/pcf-development/README.md) | Complete toolkit for developing custom code components using Power Apps Component Framework for model-driven and canvas apps | 0 items | power-apps, pcf, component-framework, typescript, power-platform |
63+
| [phoenix](../plugins/phoenix/README.md) | Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation. | 3 items | phoenix, arize, llm, observability, tracing, evaluation, openinference, instrumentation |
6264
| [php-mcp-development](../plugins/php-mcp-development/README.md) | Comprehensive resources for building Model Context Protocol servers using the official PHP SDK with attribute-based discovery, including best practices, project generation, and expert assistance | 2 items | php, mcp, model-context-protocol, server-development, sdk, attributes, composer |
6365
| [polyglot-test-agent](../plugins/polyglot-test-agent/README.md) | Multi-agent pipeline for generating comprehensive unit tests across any programming language. Orchestrates research, planning, and implementation phases using specialized agents to produce tests that compile, pass, and follow project conventions. | 9 items | testing, unit-tests, polyglot, test-generation, multi-agent, tdd, csharp, typescript, python, go |
6466
| [power-apps-code-apps](../plugins/power-apps-code-apps/README.md) | Complete toolkit for Power Apps Code Apps development including project scaffolding, development standards, and expert guidance for building code-first applications with Power Platform integration. | 2 items | power-apps, power-platform, typescript, react, code-apps, dataverse, connectors |

‎plugins/arize-ax/.github/plugin/plugin.json‎

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
{
2+
"name": "arize-ax",
3+
"description": "Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.",
4+
"version": "1.0.0",
5+
"author": {
6+
"name": "Arize AI"
7+
},
8+
"repository": "https://github.com/github/awesome-copilot",
9+
"license": "MIT",
10+
"keywords": [
11+
"arize",
12+
"llm",
13+
"observability",
14+
"tracing",
15+
"evaluation",
16+
"instrumentation",
17+
"datasets",
18+
"experiments",
19+
"prompt-optimization"
20+
],
21+
"skills": [
22+
"./skills/arize-ai-provider-integration/",
23+
"./skills/arize-annotation/",
24+
"./skills/arize-dataset/",
25+
"./skills/arize-evaluator/",
26+
"./skills/arize-experiment/",
27+
"./skills/arize-instrumentation/",
28+
"./skills/arize-link/",
29+
"./skills/arize-prompt-optimization/",
30+
"./skills/arize-trace/"
31+
]
32+
}

‎plugins/arize-ax/README.md‎

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
# Arize AX Plugin
2+
3+
Arize AX platform skills for LLM observability, evaluation, and optimization. Includes trace export, instrumentation, datasets, experiments, evaluators, AI provider integrations, annotations, prompt optimization, and deep linking to the Arize UI.
4+
5+
## Installation
6+
7+
```bash
8+
# Using Copilot CLI
9+
copilot plugin install arize-ax@awesome-copilot
10+
```
11+
12+
## What's Included
13+
14+
### Skills
15+
16+
| Skill | Description |
17+
|-------|-------------|
18+
| `arize-trace` | Export and analyze Arize traces and spans for debugging LLM applications using the ax CLI. |
19+
| `arize-instrumentation` | Add Arize AX tracing to applications using a two-phase agent-assisted workflow. |
20+
| `arize-dataset` | Create, manage, and query versioned evaluation datasets using the ax CLI. |
21+
| `arize-experiment` | Run experiments against datasets and compare results using the ax CLI. |
22+
| `arize-evaluator` | Create and run LLM-as-judge evaluators for automated scoring of spans and experiments. |
23+
| `arize-ai-provider-integration` | Store and manage LLM provider credentials for use with evaluators. |
24+
| `arize-annotation` | Create annotation configs and bulk-apply human feedback labels to spans. |
25+
| `arize-prompt-optimization` | Optimize LLM prompts using production trace data, evaluations, and annotations. |
26+
| `arize-link` | Generate deep links to the Arize UI for traces, spans, sessions, datasets, and more. |

‎plugins/phoenix/.github/plugin/plugin.json‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
{
2+
"name": "phoenix",
3+
"description": "Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation.",
4+
"version": "1.0.0",
5+
"author": {
6+
"name": "Arize AI"
7+
},
8+
"repository": "https://github.com/github/awesome-copilot",
9+
"license": "MIT",
10+
"keywords": [
11+
"phoenix",
12+
"arize",
13+
"llm",
14+
"observability",
15+
"tracing",
16+
"evaluation",
17+
"openinference",
18+
"instrumentation"
19+
],
20+
"skills": [
21+
"./skills/phoenix-cli/",
22+
"./skills/phoenix-evals/",
23+
"./skills/phoenix-tracing/"
24+
]
25+
}

‎plugins/phoenix/README.md‎

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
# Phoenix Plugin
2+
3+
Phoenix AI observability skills for LLM application debugging, evaluation, and tracing. Includes CLI debugging tools, LLM evaluation workflows, and OpenInference tracing instrumentation.
4+
5+
## Installation
6+
7+
```bash
8+
# Using Copilot CLI
9+
copilot plugin install phoenix@awesome-copilot
10+
```
11+
12+
## What's Included
13+
14+
### Skills
15+
16+
| Skill | Description |
17+
|-------|-------------|
18+
| `phoenix-cli` | Debug LLM applications using the Phoenix CLI. Fetch traces, analyze errors, review experiments, inspect datasets, and query the GraphQL API. |
19+
| `phoenix-evals` | Build and run evaluators for AI/LLM applications using Phoenix. |
20+
| `phoenix-tracing` | OpenInference semantic conventions and instrumentation for Phoenix AI observability. |

0 commit comments

Comments
 (0)