22 lines (18 loc) · 642 Bytes

Lem v0.1 Conformance

1. Definition

Conformance means producing the expected output or error code for every test in the suite.

2. Test Categories

Parsing: valid/invalid syntax
Runtime: correct evaluation of expressions/statements
Result/try: error propagation
Effects: effect set enforcement
Linear: resource safety
Diagnostics: error code, span, message

3. Test Format

name: string
source: Lem code
expect: output string or error code

4. Runner

lem test runs all conformance tests
Output: stable, machine-readable summary (JSON) and human-readable table
Fails if any test does not match expected