Issues

Add User Avatar Upload & Display in Settings and App UI

#66

· pandablue0809 opened

on Jan 3, 2026

LLMs consistently misattribute Project Gutenberg quotes to well-known authors

#64

· dv2202 opened

on Dec 31, 2025

New idea: Multi-turn & Compositional Reasoning Evaluation

#62

· sharmaanchita opened

on Dec 20, 2025

New idea: Sealed Execution Environment for Model Evaluation

#59

· sharmaanchita opened

on Dec 20, 2025

[later] Develop a storage solution for API keys (initially as environment variables, later as a Key Management System).

#24

· saifmir700 opened

on Mar 19, 2025

Implement rate limiting so the next prompt is sent only after the first is completed with all providers or timed out

#23

· saifmir700 opened

on Mar 19, 2025

Script that lets validators send prompts to all providers simultaneously.

#22

· saifmir700 opened

on Mar 19, 2025

Py SDK functions to create CID from JSON, Dict (convert to JSON first), and raw file

#21

· saifmir700 opened

on Mar 19, 2025

SDK function to validate signatures on Aggregate Metrics Evaluation JSON, Response SCore Audit JSON

#20

· saifmir700 opened

on Mar 19, 2025

Build an SDK framework to allow AI model providers to add plugins for their API. SEE DETAILS

#19

· saifmir700 opened

on Mar 19, 2025

Develop methods for AI researchers and users to spot-check validator responses. | Implement a mechanism to reprompt AI providers and verify response quality.

#18

· saifmir700 opened

on Mar 19, 2025

• Implement did:key or did:pkh for validator identities. | Develop a centralized resolver for metadata linked to DIDs. | Ensure validators use a consistent did:string as their immutable ID | [Later] Support did:plc or similar for key rotation.

#17

· saifmir700 opened

on Mar 19, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add User Avatar Upload & Display in Settings and App UI

LLMs consistently misattribute Project Gutenberg quotes to well-known authors

New idea: Multi-turn & Compositional Reasoning Evaluation

New idea: Sealed Execution Environment for Model Evaluation

[later] Develop a storage solution for API keys (initially as environment variables, later as a Key Management System).

Implement rate limiting so the next prompt is sent only after the first is completed with all providers or timed out

Script that lets validators send prompts to all providers simultaneously.

Py SDK functions to create CID from JSON, Dict (convert to JSON first), and raw file

SDK function to validate signatures on Aggregate Metrics Evaluation JSON, Response SCore Audit JSON

Build an SDK framework to allow AI model providers to add plugins for their API. SEE DETAILS

Develop methods for AI researchers and users to spot-check validator responses. | Implement a mechanism to reprompt AI providers and verify response quality.

• Implement did:key or did:pkh for validator identities. | Develop a centralized resolver for metadata linked to DIDs. | Ensure validators use a consistent did:string as their immutable ID | [Later] Support did:plc or similar for key rotation.

Uh oh!

Search results