[WIP] Add SCB and Riksbank quantitative integration for economic analysis by Copilot · Pull Request #2042 · Hack23/riksdagsmonitor

Copilot · 2026-04-27T00:48:49Z

github-actions · 2026-04-27T00:49:30Z

🏷️ Automatic Labeling Summary

This PR has been automatically labeled based on the files changed and PR metadata.

Applied Labels: size-xs

Label Categories

🗳️ Content: news, dashboard, visualization, intelligence
💻 Technology: html-css, javascript, workflow, security
📊 Data: cia-data, riksdag-data, data-pipeline, schema
🌍 I18n: i18n, translation, rtl
🔒 ISMS: isms, iso-27001, nist-csf, cis-controls
🏗️ Infrastructure: ci-cd, deployment, performance, monitoring
🔄 Quality: testing, accessibility, documentation, refactor
🤖 AI: agent, skill, agentic-workflow

For more information, see .github/labeler.yml.

github-actions · 2026-04-27T00:49:57Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/3b652eec-4c5c-4fdd-90cf-3f98cc7ed90c Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

github-actions · 2026-04-27T08:06:15Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

github-actions · 2026-04-27T08:22:07Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

Copilot

Pull request overview

Adds Swedish ground-truth quantitative tooling (SCB + Riksbank) and template hooks to support more data-backed economic transmission analysis alongside the existing IMF-first canon.

Changes:

Introduces new CLIs for fetching SCB table payloads (with curated presets) and Riksbank web/JSON artifacts, including provenance fields and persistence hooks.
Extends the persistence layer to store Riksbank artifacts with sidecar metadata.
Updates analysis templates and skills docs to standardize when/how to incorporate SCB/Riksbank quantitative context, plus adds Vitest coverage for the new helpers.

Reviewed changes

Copilot reviewed 10 out of 10 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
tests/scb-fetch.test.ts	Adds unit tests for SCB CLI parsing, presets, value-codes parsing, and outage/no-data behavior.
tests/riksbank-fetch.test.ts	Adds unit tests for Riksbank CLI parsing, URL allowlisting, and HTML/JSON response handling.
tests/data-persistence.test.ts	Adds coverage for persisting Riksbank artifacts and verifying sidecar metadata.
scripts/scb-fetch.ts	New SCB CLI wrapper with curated presets, argument parsing, provenance payload construction, and persistence.
scripts/riksbank-fetch.ts	New Riksbank fetch CLI with URL validation, provenance, and persistence support.
scripts/parliamentary-data/data-persistence.ts	Adds `riksbank` to persistence document types and implements `persistRiksbankData`.
analysis/templates/intelligence-assessment.md	Adds a standard SCB+Riksbank quantitative transmission checklist block.
analysis/templates/comparative-international.md	Adds a Swedish ground-truth transmission layer table and usage guidance.
.github/skills/riksdag-regering-mcp/SKILL.md	Documents pairing parliamentary evidence with SCB/Riksbank quantitative outputs.
.github/skills/data-science-for-intelligence/SKILL.md	Updates skill guidance to include SCB/Riksbank transmission modeling constraints (IMF remains cross-country canon).

Copilot · 2026-04-27T08:26:37Z

+  const target = assertRiksbankFetchTarget(url);
+  const response = await fetch(target, {
+    headers: { Accept: 'application/json, text/html, application/pdf;q=0.8, text/plain;q=0.7' },
+  });
+  if (!response.ok) throw new Error(`Riksbank fetch error: ${response.status} ${response.statusText}`);
+  const contentType = response.headers.get('content-type') ?? 'application/octet-stream';
+  const retrievedAt = new Date().toISOString();
+  if (contentType.includes('json')) {
+    const json = await response.json() as unknown;
+    return {
+      provider: 'riksbank',
+      kind,
+      url: target.toString(),
+      contentType,
+      retrievedAt,
+      json,
+      economicProvenance: {
+        provider: 'riksbank',
+        dataflow: 'riksbank-web',
+        indicator: kind,
+        url: target.toString(),
+        retrieved_at: retrievedAt,
+      },
+    };
+  }
+  const text = await response.text();
+  return {


fetchRiksbankPayload advertises PDF support in the Accept header, but the non-JSON branch always calls response.text(). If the endpoint returns application/pdf, this will decode binary as UTF-8 and read the entire PDF into memory before slicing, producing corrupted output and potentially large memory usage. Handle application/pdf explicitly (e.g., arrayBuffer() + size cap and persist as a .pdf/base64 field) and add an abort timeout similar to StatskontoretClient.fetchWithTimeout (scripts/statskontoret-client.ts:226).

Copilot · 2026-04-27T08:26:38Z

+  const response = await fetch(target, {
+    headers: { Accept: 'application/json, text/html, application/pdf;q=0.8, text/plain;q=0.7' },
+  });
+  if (!response.ok) throw new Error(`Riksbank fetch error: ${response.status} ${response.statusText}`);
+  const contentType = response.headers.get('content-type') ?? 'application/octet-stream';


The Riksbank CLI currently fails hard on any network error or non-2xx response (fetchRiksbankPayload throws). The PR/issue description calls out an outage fallback to cached analysis/data/riksbank/ artifacts; to meet that, consider returning a fail-soft payload (e.g., status: "no-data" + warning + empty content) on fetch failures so downstream workflows/templates can degrade gracefully instead of exiting.

Copilot · 2026-04-27T08:26:38Z

+    label: 'Labour Force Survey (AKU)',
+    domain: 'labour',
+    defaultValueCodes: Object.freeze({ Tid: 'top(8)' }),
+    notes: 'Quarterly labour-market layer for AU unemployment and employment comparisons.',


Typo in preset notes: "AU unemployment" should be "AKU unemployment" to match the preset/key and the Swedish Labour Force Survey acronym.

Suggested change

notes: 'Quarterly labour-market layer for AU unemployment and employment comparisons.',

notes: 'Quarterly labour-market layer for AKU unemployment and employment comparisons.',

Copilot · 2026-04-27T08:26:38Z

+| Price shock / relief channel | `tsx scripts/scb-fetch.ts preset --preset cpi` + `--preset fuel-prices` | `scb` | — | Does the measure materially affect household cost pressure? |
+| Labour-market sensitivity | `tsx scripts/scb-fetch.ts preset --preset aku` | `scb` | — | Does unemployment amplify or mute the political signal? |
+| Household exposure | `tsx scripts/scb-fetch.ts preset --preset household-economy` | `scb` | — | Which voter segments face the strongest disposable-income effect? |
+| Monetary-policy reaction function | `tsx scripts/riksbank-fetch.ts repo-rate-path` + `minutes` | `riksbank` | — | Does the Riksbank path support or contradict the claimed transmission? |


The command examples in the table are incomplete/ambiguous: tsx scripts/scb-fetch.ts preset --preset cpi cannot be combined with a bare --preset fuel-prices (it requires a second tsx scripts/scb-fetch.ts preset ... invocation), and the Riksbank row similarly shows + minutes without the full tsx scripts/riksbank-fetch.ts minutes command. Please spell out both commands explicitly so the template is copy/paste correct.

Suggested change

| Price shock / relief channel | `tsx scripts/scb-fetch.ts preset --preset cpi` + `--preset fuel-prices` | `scb` | — | Does the measure materially affect household cost pressure? |

| Labour-market sensitivity | `tsx scripts/scb-fetch.ts preset --preset aku` | `scb` | — | Does unemployment amplify or mute the political signal? |

| Household exposure | `tsx scripts/scb-fetch.ts preset --preset household-economy` | `scb` | — | Which voter segments face the strongest disposable-income effect? |

| Monetary-policy reaction function | `tsx scripts/riksbank-fetch.ts repo-rate-path` + `minutes` | `riksbank` | — | Does the Riksbank path support or contradict the claimed transmission? |

| Price shock / relief channel | `tsx scripts/scb-fetch.ts preset --preset cpi` + `tsx scripts/scb-fetch.ts preset --preset fuel-prices` | `scb` | — | Does the measure materially affect household cost pressure? |

| Labour-market sensitivity | `tsx scripts/scb-fetch.ts preset --preset aku` | `scb` | — | Does unemployment amplify or mute the political signal? |

| Household exposure | `tsx scripts/scb-fetch.ts preset --preset household-economy` | `scb` | — | Which voter segments face the strongest disposable-income effect? |

| Monetary-policy reaction function | `tsx scripts/riksbank-fetch.ts repo-rate-path` + `tsx scripts/riksbank-fetch.ts minutes` | `riksbank` | — | Does the Riksbank path support or contradict the claimed transmission? |

pethers · 2026-04-27T08:34:13Z

@copilot apply changes based on the comments in this thread

…timeout/outage Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/9a198a77-7c64-4245-a198-3fbe79ef71a5 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot · 2026-04-27T08:40:52Z

@copilot apply changes based on the comments in this thread

Applied all four reviewer comments in b927852:

Fixed AKU typo in scripts/scb-fetch.ts.
Spelled out the full tsx scripts/... commands in the intelligence-assessment template.
Added application/pdf handling in scripts/riksbank-fetch.ts with a 5 MB cap and base64 encoding.
Added an abort timeout and fail-soft status: "no-data" payload (instead of throwing) for network/non-2xx outages, plus expanded Vitest coverage for PDF/outage/HTTP-error paths.

github-actions · 2026-04-27T08:41:50Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

Copilot

Pull request overview

Copilot reviewed 10 out of 10 changed files in this pull request and generated 6 comments.

Copilot · 2026-04-27T09:03:38Z

+  const sourceUrl = typeof response === 'object' && response !== null && 'url' in response
+    ? String((response as { url?: unknown }).url)
+    : undefined;


sourceUrl is derived by stringifying any present url property; if url exists but is undefined/non-string, this will write a misleading value like "undefined" into the sidecar metadata. Consider narrowing this to typeof response.url === 'string' && response.url.length > 0 before persisting it.

Copilot · 2026-04-27T09:03:38Z

+      `Riksbank fetch failed (${detail}); callers should fall back to cached analysis/data/riksbank/ artifacts.`,
+    );
+  }
+  clearTimeout(timeoutId);
+


The request timeout is cleared immediately after fetch() resolves, before the response body is consumed (json(), text(), arrayBuffer()). This means a slow/large body can hang indefinitely even though a timeout was configured. Keep the timeout active until after the body has been fully read (e.g., wrap the entire fetch+parse flow in a try/finally and clear the timer in finally).

Copilot · 2026-04-27T09:03:39Z

+  if (contentType.includes('pdf')) {
+    const buffer = await response.arrayBuffer();
+    if (buffer.byteLength > PDF_MAX_BYTES) {
+      return buildOutagePayload(
+        kind,


response.arrayBuffer() reads the full PDF into memory before enforcing PDF_MAX_BYTES, so the size cap does not actually prevent large memory allocations. Consider checking Content-Length up front and/or streaming the body with an incremental byte counter and aborting once the cap is exceeded.

Copilot · 2026-04-27T09:03:39Z

+  const text = await response.text();
+  const title = extractTitle(text);
+  return {
+    provider: 'riksbank',
+    kind,


response.text() reads the full response into memory and only then slices to TEXT_MAX_BYTES. If the endpoint returns unexpectedly large HTML, this can still cause high memory usage. Prefer enforcing a maximum via Content-Length and/or streaming with an early abort before accumulating the entire body.

Copilot · 2026-04-27T09:03:39Z

+    response = await fetch(target, {
+      headers: { Accept: 'application/json, text/html, application/pdf;q=0.8, text/plain;q=0.7' },
+      signal: controller.signal,
+    });
+  } catch (error) {


The host allowlist is only enforced on the initial URL; fetch() will follow redirects by default, which can allow downloading content from a different host than the one validated. To keep the allowlist meaningful, consider using redirect: 'manual' (or validating response.url / Location on redirects) and rejecting cross-host redirects.

Copilot · 2026-04-27T09:03:39Z

+async function main(): Promise<void> {
+  const { command, flags, booleans } = parseRiksbankArgs(process.argv.slice(2));
+  if (command === 'help') {
+    process.stdout.write(HELP);
+    return;
+  }
+  const kind = command === 'fetch' ? parseRiksbankKind(flags.get('kind') ?? '') : command;
+  const url = flags.get('url') ?? DEFAULT_URLS[kind];


When using the fetch command, a missing --kind flag currently produces an "unknown Riksbank artifact kind" error (because '' is passed through). This is harder to diagnose than an explicit "missing required flag --kind" message. Consider adding a small requireRiksbankFlag() helper (similar to requireSCBFlag) and using it for --kind (and optionally --url).

Suggested change

async function main(): Promise<void> {

const { command, flags, booleans } = parseRiksbankArgs(process.argv.slice(2));

if (command === 'help') {

process.stdout.write(HELP);

return;

}

const kind = command === 'fetch' ? parseRiksbankKind(flags.get('kind') ?? '') : command;

const url = flags.get('url') ?? DEFAULT_URLS[kind];

function requireRiksbankFlag(

flags: ReadonlyMap<string, string>,

name: string,

): string {

const value = flags.get(name)?.trim();

if (!value) throw new Error(`missing required flag --${name}`);

return value;

}

async function main(): Promise<void> {

const { command, flags, booleans } = parseRiksbankArgs(process.argv.slice(2));

if (command === 'help') {

process.stdout.write(HELP);

return;

}

const kind =

command === 'fetch' ? parseRiksbankKind(requireRiksbankFlag(flags, 'kind')) : command;

const urlFlag = flags.get('url')?.trim();

const url = urlFlag && urlFlag.length > 0 ? urlFlag : DEFAULT_URLS[kind];

pethers · 2026-04-27T09:05:58Z

@copilot apply changes based on the comments in this thread

…rceUrl Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/d07d61b5-6010-4413-b8ac-3867415b50b4 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot · 2026-04-27T09:13:59Z

@copilot apply changes based on the comments in this thread

Applied all six reviewer comments in 3a58ef3:

data-persistence.ts: narrowed sourceUrl to typeof === 'string' && length > 0 so non-string url properties no longer leak "undefined" into sidecar metadata.
riksbank-fetch.ts: timeout now covers the entire fetch + body read via try/finally; PDF/text/JSON paths pre-check Content-Length and stream the body with an incremental byte counter that aborts once the cap is exceeded; redirects are followed manually with redirect: 'manual', re-validating the Location host against the allowlist on each hop (max 3); requireRiksbankFlag produces an explicit missing required flag --kind error; repeated cancel/release boilerplate extracted into safeCancel / safeReleaseLock helpers.
Vitest coverage extended for Content-Length pre-check, manual-redirect chaining, and off-allowlist redirect rejection (10/10 Riksbank tests pass; full suite 59/59).

github-actions · 2026-04-27T09:14:54Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

pethers · 2026-04-27T09:22:01Z

@copilot analyse and improve TypeScript & JavaScript Testing / Unit Tests (Vitest) (pull_request)
TypeScript & JavaScript Testing / Unit Tests (Vitest) (pull_request)Failing after 49s

Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/1f2cad03-23d5-4764-b572-386ed5014ef1 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot · 2026-04-27T09:28:23Z

@copilot analyse and improve [TypeScript & JavaScript Testing / Unit Tests (Vitest) (pull_request)](https://github.com/Hack23/riksdagsmonitor/actions/runs/24986596601/job/73161333306?p...

Root cause was the npm run typedoc step (not Vitest itself — Vitest never got to run because typedoc failed first). Typedoc's TypeScript checker did not narrow the discriminated union { exceeded: false; bytes } | { exceeded: true; bytesRead } after the early-return guard, producing TS2339: Property 'bytes' does not exist at four sites.

Fixed in 9d6938c by replacing the union with a uniform { exceeded: boolean; bytes: Uint8Array; bytesRead: number } shape — bytes is empty when exceeded is true, callers still guard on exceeded before consuming, and no narrowing is required. Verified locally: npm run typedoc now reports 0 errors, tsc --project tsconfig.scripts.json --noEmit clean, and 10/10 Riksbank Vitest specs pass.

github-actions · 2026-04-27T09:29:21Z

🔍 Lighthouse Performance Audit

Category	Score	Status
Performance	85/100	🟡
Accessibility	95/100	🟢
Best Practices	90/100	🟢
SEO	95/100	🟢

📥 Download full Lighthouse report

Budget Compliance: Performance budgets enforced via budget.json

Initial plan

1e37bf0

Copilot AI assigned Copilot and pethers Apr 27, 2026

Copilot started work on behalf of pethers April 27, 2026 00:48 View session

Copilot AI linked an issue Apr 27, 2026 that may be closed by this pull request

[Methodology] SCB & Riksbank quantitative integration (CPI, AKU, fuel-price) for economic transmission analysis #2026

Closed

5 tasks

github-actions Bot added the size-xs Extra small change (< 10 lines) label Apr 27, 2026

Copilot AI requested a review from pethers April 27, 2026 00:50

Copilot stopped work on behalf of pethers due to an error April 27, 2026 00:50
Copilot has encountered an internal error. If the problem persists, please contact GitHub Support, including the request ID `780A:10BD5D:258C8D3:2F2F522:69EEB2C6`. To retry, leave a comment on this pu...

Copilot started work on behalf of pethers April 27, 2026 07:51 View session

Copilot finished work on behalf of pethers April 27, 2026 07:55

Copilot started work on behalf of pethers April 27, 2026 08:00 View session

Add SCB and Riksbank fetch helpers

b1ee628

Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/3b652eec-4c5c-4fdd-90cf-3f98cc7ed90c Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

github-actions Bot added documentation Documentation updates testing Test coverage refactor Code refactoring skill Skill configuration size-l Large change (250-1000 lines) labels Apr 27, 2026

Copilot finished work on behalf of pethers April 27, 2026 08:10

Merge branch 'main' into copilot/add-scb-riksbank-integration

0e7985c

pethers marked this pull request as ready for review April 27, 2026 08:21

Copilot AI review requested due to automatic review settings April 27, 2026 08:21

Copilot started reviewing on behalf of pethers April 27, 2026 08:21 View session

Copilot AI reviewed Apr 27, 2026

View reviewed changes

Copilot started work on behalf of pethers April 27, 2026 08:34 View session

Address reviewer feedback: AKU typo, template commands, Riksbank PDF/…

b927852

…timeout/outage Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/9a198a77-7c64-4245-a198-3fbe79ef71a5 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot finished work on behalf of pethers April 27, 2026 08:41

pethers requested a review from Copilot April 27, 2026 08:56

Copilot started reviewing on behalf of pethers April 27, 2026 08:58 View session

Copilot AI reviewed Apr 27, 2026

View reviewed changes

Copilot started work on behalf of pethers April 27, 2026 09:06 View session

Harden Riksbank fetch: streaming caps, manual redirects, narrowed sou…

3a58ef3

…rceUrl Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/d07d61b5-6010-4413-b8ac-3867415b50b4 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot finished work on behalf of pethers April 27, 2026 09:15

Copilot started work on behalf of pethers April 27, 2026 09:22 View session

Fix typedoc TS2339 by unifying readBodyWithCap return type

9d6938c

Agent-Logs-Url: https://github.com/Hack23/riksdagsmonitor/sessions/1f2cad03-23d5-4764-b572-386ed5014ef1 Co-authored-by: pethers <1726836+pethers@users.noreply.github.com>

Copilot finished work on behalf of pethers April 27, 2026 09:29

pethers merged commit 686710b into main Apr 27, 2026
16 checks passed

pethers deleted the copilot/add-scb-riksbank-integration branch April 27, 2026 09:44

	notes: 'Quarterly labour-market layer for AU unemployment and employment comparisons.',
	notes: 'Quarterly labour-market layer for AKU unemployment and employment comparisons.',

Conversation

Copilot AI commented Apr 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Apr 27, 2026

🏷️ Automatic Labeling Summary

Label Categories

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

pethers commented Apr 27, 2026

Uh oh!

Copilot AI commented Apr 27, 2026

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 27, 2026

Choose a reason for hiding this comment

Uh oh!

pethers commented Apr 27, 2026

Uh oh!

Copilot AI commented Apr 27, 2026

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

pethers commented Apr 27, 2026

Uh oh!

Copilot AI commented Apr 27, 2026

Uh oh!

github-actions Bot commented Apr 27, 2026

🔍 Lighthouse Performance Audit

Uh oh!

Uh oh!

Reviewers

Assignees

Copilot AI commented Apr 27, 2026 •

edited

Loading