Fix build issues

[arsym-dev]

Changes

• Generate tokenizer .ts files when building for the first time.
• Fix some compile issues
• Add test token patterns

Problem

Github Actions is failing all tests since Nov 10, 2025 (commit aaa46a5..e1559b8). It is attempting to locate files in src/tokenizer/generated, but they have been deleted and gitignored.

The error is as follows:

ERROR in ./src/tokenizer/tokenizer.ts 11:20-42
Module not found: Error: Can't resolve './generated' in '/home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer'
resolve './generated' in '/home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer'
  using description file: /home/runner/work/vscode-language-renpy/vscode-language-renpy/package.json (relative path: ./src/tokenizer)
    using description file: /home/runner/work/vscode-language-renpy/vscode-language-renpy/package.json (relative path: ./src/tokenizer/generated)
      no extension
        /home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer/generated doesn't exist
      .ts
        /home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer/generated.ts doesn't exist
      .js
        /home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer/generated.js doesn't exist
      as directory
        /home/runner/work/vscode-language-renpy/vscode-language-renpy/src/tokenizer/generated doesn't exist
 @ ./src/extension.ts 51:20-52

ERROR in ./src/tokenizer/tokenizer.ts:11:31
TS2307: Cannot find module './generated' or its corresponding type declarations.
     9 | import { LogCategory, logCatMessage } from "../logger";
    10 |
  > 11 | import { RenpyPatterns } from "./generated";
       |                               ^^^^^^^^^^^^^
    12 | import { isMatchPattern, isRangePattern, isRepoPattern, Range, Token, TokenPosition, TokenTree, TreeNode } from "./token-definitions";
    13 | import { TokenCapturePattern, TokenMatchPattern, TokenPatternCapture, TokenRangePattern, TokenRepoPattern } from "./token-pattern-types";
    14 |