Skip to content

Commit add614f

Browse files
authored
Sattensil/agentcontrol config naming (#67)
* Rebrand prose: AI Configs product -> AgentControl, primitive -> config
1 parent e6ab09b commit add614f

51 files changed

Lines changed: 359 additions & 359 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.claude-plugin/plugin.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "launchdarkly",
33
"version": "1.0.0",
4-
"description": "LaunchDarkly agent skills and MCP servers for feature flag management, AI configuration, and metrics",
4+
"description": "LaunchDarkly agent skills and MCP servers for feature flag management, AgentControl, and metrics",
55
"author": {
66
"name": "LaunchDarkly",
77
"email": "support@launchdarkly.com"

.codex-plugin/plugin.json

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "launchdarkly-mcp",
33
"version": "0.6.1",
4-
"description": "Connect Codex to LaunchDarkly over MCP: AI Configs and feature management (FM) hosted endpoints, plus bundled guidance for using the tools.",
4+
"description": "Connect Codex to LaunchDarkly over MCP: configs and feature management (FM) hosted endpoints, plus bundled guidance for using the tools.",
55
"author": {
66
"name": "LaunchDarkly",
77
"url": "https://launchdarkly.com"
@@ -20,15 +20,15 @@
2020
"mcpServers": "./.mcp.json",
2121
"interface": {
2222
"displayName": "LaunchDarkly",
23-
"shortDescription": "Feature flags, AI Configs, and environments via MCP.",
24-
"longDescription": "Use LaunchDarkly’s hosted MCP servers for AI Configs and FM, or run the same surface locally with npx @launchdarkly/mcp-server (see repository README). Authenticate with your LaunchDarkly API access token when prompted.",
23+
"shortDescription": "Feature flags, configs, and environments via MCP.",
24+
"longDescription": "Use LaunchDarkly’s hosted MCP servers for configs and FM, or run the same surface locally with npx @launchdarkly/mcp-server (see repository README). Authenticate with your LaunchDarkly API access token when prompted.",
2525
"developerName": "LaunchDarkly",
2626
"category": "Developer tools",
2727
"capabilities": ["Read", "Write"],
2828
"websiteURL": "https://launchdarkly.com",
2929
"defaultPrompt": [
3030
"List my LaunchDarkly feature flags for this project.",
31-
"Show AI Config targeting for the config I care about."
31+
"Show config targeting for the config I care about."
3232
],
3333
"brandColor": "#3DD6F5"
3434
}

.cursor-plugin/plugin.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"name": "launchdarkly",
33
"version": "1.0.2",
4-
"description": "LaunchDarkly agent skills and mcp server for feature flag management, AI configuration, and skill authoring",
4+
"description": "LaunchDarkly agent skills and mcp server for feature flag management, AgentControl, and skill authoring",
55
"author": {
66
"name": "LaunchDarkly",
77
"email": "support@launchdarkly.com"

README.md

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# LaunchDarkly Agent Skills
22

3-
LaunchDarkly's public collection of AI agent skills and playbooks. These skills encode repeatable workflows for working with LaunchDarkly, so coding agents can execute common tasks safely and consistently.
3+
LaunchDarkly's public collection of agent skills and playbooks. These skills encode repeatable workflows for working with LaunchDarkly, so coding agents can execute common tasks safely and consistently.
44

55
## What Is This Repo?
66

@@ -18,19 +18,19 @@ Agent Skills are modular, text-based playbooks that teach an agent how to perfor
1818
| `feature-flags/launchdarkly-flag-cleanup` | Safely remove flags from code using LaunchDarkly as the source of truth |
1919
| `feature-flags/launchdarkly-guarded-rollout` | Configure guarded rollouts with progressive traffic, metric monitoring, and rollback |
2020

21-
### AI Configs
21+
### AgentControl
2222

2323
| Skill | Description |
2424
|-------|-------------|
25-
| `agentcontrol/configs-create` | Create AI Configs with variations for agent or completion mode |
26-
| `agentcontrol/migrate` | Migrate an app with hardcoded LLM prompts to AI Configs in five stages (extract, wrap, tools, tracking, evals) |
27-
| `agentcontrol/configs-update` | Update and delete AI Configs, manage lifecycle |
28-
| `agentcontrol/configs-variations` | Manage AI Config variations for A/B testing |
25+
| `agentcontrol/configs-create` | Create configs with variations for agent or completion mode |
26+
| `agentcontrol/migrate` | Migrate an app with hardcoded LLM prompts to AgentControl in five stages (extract, wrap, tools, tracking, evals) |
27+
| `agentcontrol/configs-update` | Update and delete configs, manage lifecycle |
28+
| `agentcontrol/configs-variations` | Manage config variations for A/B testing |
2929
| `agentcontrol/tools` | Create and attach tools for function calling |
30-
| `agentcontrol/projects` | Create and manage projects to organize AI Configs |
31-
| `agentcontrol/online-evals` | Attach LLM-as-a-judge evaluators to AI Configs |
32-
| `agentcontrol/configs-targeting` | Configure targeting rules for AI Config rollouts |
33-
| `agentcontrol/snippets` | Create and manage reusable prompt snippets across AI Configs |
30+
| `agentcontrol/projects` | Create and manage projects to organize configs |
31+
| `agentcontrol/online-evals` | Attach LLM-as-a-judge evaluators to configs |
32+
| `agentcontrol/configs-targeting` | Configure targeting rules for config rollouts |
33+
| `agentcontrol/snippets` | Create and manage reusable prompt snippets across configs |
3434
| `agentcontrol/agent-graphs` | Create and manage multi-agent graphs with routing and handoffs |
3535

3636
### Experiments

eval-scores.json

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -11,22 +11,22 @@
1111
"lastRun": "2026-05-20T19:16:00.930Z",
1212
"perTest": [
1313
{
14-
"description": "Create an AI Config for my customer support bot. It uses LangGraph and needs per",
14+
"description": "Create a config for my customer support bot. It uses LangGraph and needs per",
1515
"pass": true,
1616
"score": 1
1717
},
1818
{
19-
"description": "I need an AI Config for our blog summarizer. We call the OpenAI API directly wit",
19+
"description": "I need a config for our blog summarizer. We call the OpenAI API directly wit",
2020
"pass": true,
2121
"score": 1
2222
},
2323
{
24-
"description": "Create a new AI Config for our analytics agent. Project key is \"data-platform\".\n",
24+
"description": "Create a new config for our analytics agent. Project key is \"data-platform\".\n",
2525
"pass": true,
2626
"score": 1
2727
},
2828
{
29-
"description": "Create an AI Config called \"email-assistant\" for composing emails. Project is \"c",
29+
"description": "Create a config called \"email-assistant\" for composing emails. Project is \"c",
3030
"pass": true,
3131
"score": 0.8333333333333334
3232
}
@@ -46,12 +46,12 @@
4646
"score": 0.95
4747
},
4848
{
49-
"description": "We no longer need the content-writer AI Config. Please remove it from active use",
49+
"description": "We no longer need the content-writer config. Please remove it from active use",
5050
"pass": true,
5151
"score": 1
5252
},
5353
{
54-
"description": "Update the support-chatbot AI Config in project \"support-app\": change the name t",
54+
"description": "Update the support-chatbot config in project \"support-app\": change the name t",
5555
"pass": true,
5656
"score": 1
5757
},
@@ -76,12 +76,12 @@
7676
"lastRun": "2026-05-20T19:16:00.936Z",
7777
"perTest": [
7878
{
79-
"description": "I need to give our support-chatbot AI Config the ability to search our knowledge",
79+
"description": "I need to give our support-chatbot config the ability to search our knowledge",
8080
"pass": true,
8181
"score": 1
8282
},
8383
{
84-
"description": "Create an AI tool called \"create-ticket\" that accepts title (required string), p",
84+
"description": "Create an agent tool called \"create-ticket\" that accepts title (required string), p",
8585
"pass": true,
8686
"score": 1
8787
},

evals/aiconfig-create/promptfooconfig.yaml

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ tests:
2828
- description: "Happy path: creates agent-mode config for a LangGraph chatbot using setup-ai-config"
2929
vars:
3030
user_request: >
31-
Create an AI Config for my customer support bot. It uses LangGraph and
31+
Create a config for my customer support bot. It uses LangGraph and
3232
needs persistent instructions. The project key is "acme-app".
3333
Use Claude Sonnet as the model.
3434
codebase_context: ""
@@ -82,7 +82,7 @@ tests:
8282

8383
- type: llm-rubric
8484
value: |
85-
Evaluate whether the agent correctly created an AI Config in agent mode.
85+
Evaluate whether the agent correctly created a config in agent mode.
8686
Score 1.0 if all of the following are met:
8787
1. The agent chose agent mode (appropriate for LangGraph with persistent instructions).
8888
2. The agent created a config with a meaningful key and name derived from the use case.
@@ -100,7 +100,7 @@ tests:
100100
- description: "Completion mode: creates completion-mode config for direct OpenAI API use"
101101
vars:
102102
user_request: >
103-
I need an AI Config for our blog summarizer. We call the OpenAI API
103+
I need a config for our blog summarizer. We call the OpenAI API
104104
directly with a messages array (system + user). Project key is "blog-app",
105105
use gpt-4o.
106106
codebase_context: >
@@ -151,7 +151,7 @@ tests:
151151
- description: "Exploration: browses existing configs before creating when context is sparse"
152152
vars:
153153
user_request: >
154-
Create a new AI Config for our analytics agent. Project key is "data-platform".
154+
Create a new config for our analytics agent. Project key is "data-platform".
155155
codebase_context: ""
156156
assert:
157157
- type: javascript
@@ -184,7 +184,7 @@ tests:
184184
- description: "Post-creation: response mentions targeting step or aiconfig-targeting"
185185
vars:
186186
user_request: >
187-
Create an AI Config called "email-assistant" for composing emails.
187+
Create a config called "email-assistant" for composing emails.
188188
Project is "comms-app", use gpt-4o-mini in completion mode.
189189
codebase_context: ""
190190
assert:

evals/aiconfig-tools/promptfooconfig.yaml

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,8 +3,8 @@
33
# Run with shared defaults:
44
# promptfoo eval -c shared/defaults.yaml -c aiconfig-tools/promptfooconfig.yaml
55
#
6-
# The aiconfig-tools skill covers creating AI tool definitions and attaching
7-
# them to AI Config variations. Key invariant: tools must be created with
6+
# The aiconfig-tools skill covers creating agent tool definitions and attaching
7+
# them to config variations. Key invariant: tools must be created with
88
# raw JSON Schema format (not OpenAI function-calling wrapper), and must be
99
# created before being attached.
1010
description: "End-to-end evaluation of the aiconfig-tools skill"
@@ -25,7 +25,7 @@ tests:
2525
- description: "Creates a tool with correct raw JSON Schema and attaches it to a variation"
2626
vars:
2727
user_request: >
28-
I need to give our support-chatbot AI Config the ability to search our
28+
I need to give our support-chatbot config the ability to search our
2929
knowledge base. Create a tool called "search-knowledge-base" with a
3030
query parameter and a limit parameter, then attach it to the "default"
3131
variation. Project key is "support-app".
@@ -82,7 +82,7 @@ tests:
8282
- description: "Uses raw JSON Schema for tool schema, not the OpenAI function wrapper"
8383
vars:
8484
user_request: >
85-
Create an AI tool called "create-ticket" that accepts title (required
85+
Create an agent tool called "create-ticket" that accepts title (required
8686
string), priority (enum: low, medium, high), and description (optional
8787
string). Attach it to the default variation of the support-chatbot config.
8888
Project key is "support-app".

evals/aiconfig-update/promptfooconfig.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -76,7 +76,7 @@ tests:
7676
- description: "Archives a config instead of deleting when asked to remove it"
7777
vars:
7878
user_request: >
79-
We no longer need the content-writer AI Config. Please remove it from
79+
We no longer need the content-writer config. Please remove it from
8080
active use. Project key is "marketing".
8181
codebase_context: >
8282
The content-writer config has 3 variations. It's been inactive for two
@@ -114,7 +114,7 @@ tests:
114114
- description: "Updates config metadata — name, description, tags — without touching variations"
115115
vars:
116116
user_request: >
117-
Update the support-chatbot AI Config in project "support-app":
117+
Update the support-chatbot config in project "support-app":
118118
change the name to "Customer Support Agent", add a description
119119
"Handles tier-1 support inquiries", and add tags "support" and "production".
120120
codebase_context: >

evals/mocks/tool-responses.json

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -247,7 +247,7 @@
247247
"key": "support-chatbot",
248248
"name": "Support Chatbot",
249249
"mode": "agent",
250-
"description": "AI-powered support agent for customer tickets",
250+
"description": "Agent-powered support agent for customer tickets",
251251
"tags": [
252252
"support",
253253
"production"
@@ -284,7 +284,7 @@
284284
"key": "{{configKey}}",
285285
"name": "{{configName}}",
286286
"mode": "agent",
287-
"description": "AI Config",
287+
"description": "config",
288288
"tags": [],
289289
"archived": false,
290290
"variations": [

0 commit comments

Comments
 (0)