You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: skills/cuopt-numerical-optimization-api-cli/BENCHMARK.md
+11-19Lines changed: 11 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,11 +7,11 @@ This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the s
7
7
## Evaluation Summary
8
8
9
9
- Skill: `cuopt-numerical-optimization-api-cli`
10
-
- Evaluation date: 2026-05-29
10
+
- Evaluation date: 2026-07-01
11
11
- NVSkills-Eval profile: `external`
12
-
- Environment: `local`
12
+
- Environment: `astra-sandbox`
13
13
- Dataset: 1 evaluation tasks
14
-
- Attempts per task: 2
14
+
- Attempts per task: 1
15
15
- Pass threshold: 50%
16
16
- Overall verdict: PASS
17
17
@@ -54,34 +54,26 @@ Task composition is derived from the evaluation dataset when possible. Entries w
54
54
55
55
| Dimension | Num |`claude-code`|`codex`|
56
56
|---|---:|---:|---:|
57
-
| Security |2| 100% (+0%) | 100% (+0%) |
58
-
| Correctness |2|100% (+0%) |97% (+5%) |
59
-
| Discoverability |2|100% (+0%) | 84% (+5%) |
60
-
| Effectiveness |2|78% (+2%) |76% (+4%) |
61
-
| Efficiency |2|93% (-0%) |78% (-0%) |
57
+
| Security |1| 100% (+0%) | 100% (+0%) |
58
+
| Correctness |1|30% (+0%) |77% (+47%) |
59
+
| Discoverability |1|0% (+0%) | 84% (+84%) |
60
+
| Effectiveness |1|39% (-4%) |41% (+4%) |
61
+
| Efficiency |1|27% (-0%) |77% (+49%) |
62
62
63
63
Score values show skill-assisted performance. Values in parentheses show uplift versus the no-skill baseline when baseline data is available.
64
64
65
65
## Tier 1: Static Validation Summary
66
66
67
-
Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 8 total findings.
67
+
Tier 1 validation passed with observations. NVSkills-Eval ran 1 checks and found 2 total findings.
68
68
69
69
Top findings:
70
70
71
71
- MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Instructions' (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
72
-
- LOW QUALITY/quality_discoverability: Broad description without negative triggers may cause over-triggering (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
73
-
- LOW QUALITY/quality_discoverability: No '## Purpose' section (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
74
-
- LOW QUALITY/quality_reliability: No prerequisites/requirements documented (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
75
-
- LOW QUALITY/quality_reliability: No limitations documented (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
72
+
- LOW SCHEMA/author_format: Author must be of the form 'Name <email@host>' (`skills/cuopt-numerical-optimization-api-cli/SKILL.md`)
76
73
77
74
## Tier 2: Deduplication Summary
78
75
79
-
Tier 2 validation passed. NVSkills-Eval ran 2 checks and found 0 total findings.
Copy file name to clipboardExpand all lines: skills/cuopt-numerical-optimization-api-cli/SKILL.md
+25-35Lines changed: 25 additions & 35 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
name: cuopt-numerical-optimization-api-cli
3
3
version: "26.08.00"
4
-
description: LP, MILP, and QP (beta) with cuOpt — CLI only (MPS files, cuopt_cli). Use when the user is solving LP, MILP, or QP from MPS via command line.
4
+
description: LP, MILP, and QP (beta) with cuOpt — CLI only (MPS/LP/QPS files, cuopt_cli). Use when the user is solving LP, MILP, or QP from an MPS or LP file via command line.
5
5
license: Apache-2.0
6
6
metadata:
7
7
author: NVIDIA cuOpt Team
@@ -17,63 +17,53 @@ metadata:
17
17
18
18
# cuOpt Numerical Optimization — CLI
19
19
20
-
Solve LP, MILP, and QP problems from MPS files via `cuopt_cli`. The same command, options, and MPS workflow apply across all three; QP uses the standard MPS quadratic-objective extension.
20
+
Solve LP, MILP, and QP problems from MPS or LP files via `cuopt_cli`. The same commandand options apply across all three; QP is supported in both MPS (QPS) and LP files.
21
21
22
22
Confirm problem type and formulation (variables, objective, constraints, variable types) before coding.
23
23
24
-
This skill is **CLI only** (MPS input).
24
+
This skill is **CLI only** (MPS or LP file input).
The first positional argument is the input file. The format is chosen automatically from the extension — MPS, QPS, and LP files are all accepted (including `.gz` / `.bz2` compressed variants); run `cuopt_cli --help` for the exact list of supported extensions.
37
33
38
-
```bash
39
-
cuopt_cli --help
34
+
## Options
40
35
41
-
# Time limit (seconds)
42
-
cuopt_cli problem.mps --time-limit 120
36
+
**`cuopt_cli --help` is the authoritative list — don't work from a hard-coded subset.** The CLI exposes every solver setting as a flag, generated from the parameter list at runtime: take any parameter documented in the cuOpt settings reference and replace underscores with hyphens (`time_limit` → `--time-limit`, `mip_relative_gap` → `--mip-relative-gap`). So if a parameter is documented, the flag exists; `--help` and the [solver-settings docs](https://docs.nvidia.com/cuopt/user-guide/latest/) are the sources of truth for names, meanings, and defaults.
43
37
44
-
# MIP gap tolerance (stop when within X% of optimal)
Run `cuopt_cli --help` for the complete, current set.
45
+
46
+
## Authoring input files
47
+
48
+
MPS, QPS, and LP are precise, externally-specified file formats. Don't hand-author them from memory or from a partial recollection of the layout — column-position rules, marker conventions, the quadratic-objective encoding, and sign/scaling conventions are easy to get subtly wrong, and a malformed file either fails to parse or **silently encodes a different model than intended**.
53
49
54
-
## MPS format (required sections, in order)
50
+
If you're building a model from data (rather than solving a file you already have), **define the problem through the cuOpt Python API or your preferred modeling interface — don't generate an MPS or LP file by hand to feed the CLI.** These interfaces take coefficients, bounds, and variable types as native data structures, so there's no text format to get wrong. The cuOpt Python API solves and returns the solution in the same program (see the `cuopt-numerical-optimization-api-python` skill); a separate modeling library (e.g. PuLP, Pyomo, JuMP) can export a valid file for the CLI or call its own solver. Reach for `cuopt_cli` when you *already* have a model file — e.g. a benchmark instance or a file exported by one of these tools.
When a file is genuinely the right artifact, still generate it programmatically rather than by hand:
62
53
63
-
Integer variables: use `'MARKER' 'INTORG'` before and `'MARKER' 'INTEND'` after the integer columns.
54
+
-**From cuOpt's Python API** — build the model, then export it with `model.writeMPS("problem.mps")` (emits a valid MPS file, including the quadratic objective for QP) and solve with `cuopt_cli problem.mps`.
55
+
-**From another modeling tool** — most LP/MILP modeling libraries and solvers can export standard MPS or LP files; pass the exported file straight to `cuopt_cli`.
64
56
65
-
## QP via CLI (beta)
57
+
If you must read or write these formats by hand anyway, work from the format's full specification (and the cuOpt repo docs at `docs/cuopt/source/cuopt-cli/` for cuOpt-specific conventions such as the quadratic-objective encoding) — not from an example alone.
66
58
67
-
Quadratic objectives extend the standard MPS workflow — same `cuopt_cli`command, same options. Check `cuopt_cli --help` for QP-specific flags and the repo docs at `docs/cuopt/source/cuopt-cli/` for the quadratic-objective MPS format.
59
+
Either way, **validate before trusting the result**: `cuopt_cli`logs `Read file ...` on a successful parse, and reports the variable/constraint counts and objective — sanity-check those against your intended model.
68
60
69
-
**QP rules:**
70
-
-**MINIMIZE only.** For maximization, negate the objective coefficients (and Q entries) in the MPS file.
71
-
-**Continuous variables only** — do not mix integer markers with quadratic objectives.
61
+
**QP notes (beta):** quadratic objectives are **MINIMIZE only** (for maximization, negate the objective, including the quadratic terms) and require **continuous variables only** (no integer variables mixed with a quadratic objective). Check `cuopt_cli --help` for QP-specific flags.
72
62
73
63
## Troubleshooting
74
64
75
-
-**Failed to parse MPS** — Check ENDATA, section order (NAME, ROWS, COLUMNS, RHS, [BOUNDS], ENDATA), integer markers.
76
-
-**Infeasible** — Check constraint directions (L/G/E) and RHS values.
65
+
-**Parsing input file failed** — Confirm the extension matches the format (`.lp` vs `.mps`/`.qps`); an unrecognized extension is rejected before parsing. The parser error names the offending line — fix it against the format spec, or (more reliably) regenerate the file from a modeling tool rather than patching it by hand.
66
+
-**Infeasible** — Re-check the model against your intended formulation: constraint directions, right-hand sides, and variable bounds.
Copy file name to clipboardExpand all lines: skills/cuopt-numerical-optimization-api-cli/skill-card.md
+20-14Lines changed: 20 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,27 +1,33 @@
1
1
## Description: <br>
2
-
LP, MILP, and QP (beta) with cuOpt — CLI only (MPS files, cuopt_cli). Use when the user is solving LP, MILP, or QP from MPS via command line. <br>
2
+
LP, MILP, and QP (beta) with cuOpt — CLI only (MPS/LP/QPS files, cuopt_cli). Use when the user is solving LP, MILP, or QP from an MPS or LP file via command line. <br>
3
3
4
4
This skill is ready for commercial/non-commercial use. <br>
5
5
6
6
## Owner
7
7
NVIDIA <br>
8
8
9
9
### License/Terms of Use: <br>
10
-
Apache2.0 <br>
10
+
Apache-2.0 <br>
11
11
## Use Case: <br>
12
-
Developers and engineers solving LP, MILP, and QP optimization problems from MPS files via the cuopt_cli command-line interface. <br>
12
+
Developers and engineers solving LP, MILP, and QP optimization problems from MPS or LP files via command line using NVIDIA cuOpt's GPU-accelerated solver. <br>
13
13
14
14
### Deployment Geography for Use: <br>
15
15
Global <br>
16
16
17
+
## Requirements / Dependencies: <br>
18
+
**Requires API Key or External Credential:**[Not Specified] <br>
19
+
**Credential Type(s):**[None identified] <br>
20
+
21
+
Do not include secrets in prompts/logs/output; use least-privilege credentials; rotate keys as appropriate. <br>
22
+
17
23
## Known Risks and Mitigations: <br>
18
24
Risk: Review before execution as proposals could introduce incorrect or misleading guidance into skills. <br>
19
25
Mitigation: Review and scan skill before deployment. <br>
20
26
21
27
## Reference(s): <br>
22
-
-[cuOpt User Guide](https://docs.nvidia.com/cuopt/user-guide/latest/introduction.html) <br>
0 commit comments