Skip to content

Commit 7ffedce

Browse files
committed
feat: add documentation for new ai risk hub
1 parent 38d6215 commit 7ffedce

17 files changed

+186
-79
lines changed

docs/organizations/ai-risk-hub.md

Lines changed: 183 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,183 @@
1+
---
2+
description: The organization's AI Risk Hub dashboard provides an overview of all the AI issues detected in the repositories applied to the organization's AI Policy standard and your organization's risk level based on your AI practices.
3+
---
4+
5+
# AI Risk Hub
6+
7+
The **AI Risk Hub** gives you visibility into the AI usage, dependencies, and risks across your organization's repositories. It brings together AI policy compliance, risk assessment, and a detailed inventory of AI resources found in your codebase.
8+
It also provides an overview of all the AI issues detected in the repositories applied to the organization's AI Policy standard and your organization's risk level based on your AI practices. Here, you can navigate through the issues detected in your repositories and filter them by severity and category. You can also filter the issues by selecting specific repositories or using [the segments that you have set up](segments.md).
9+
10+
!!! important
11+
This dashboard is a Business tier feature, generally available until May 18.
12+
13+
To access the AI Risk Hub, select an organization from the top navigation bar and click on **AI Risk** on the left navigation sidebar.
14+
15+
Inside this hub, you can find the following pages to help you monitor the AI risk of your organization:
16+
- [Overview](#overview)
17+
- [AI Inventory](#ai-inventory)
18+
19+
---
20+
21+
## Overview
22+
23+
The **Overview** tab is the main dashboard for monitoring AI risk across your organization. It includes:
24+
25+
- [AI Policy Compliance](#ai-policy-compliance)
26+
- [Risk Level](#risk-level)
27+
- [AI Risk Checklist](#ai-risk-checklist)
28+
- [Repositories with most AI issues](#repositories-with-most-ai-issues)
29+
- [AI Inventory summary](#ai-inventory-summary)
30+
31+
![AI Risk Hub overview](images/ai-risk-hub.png)
32+
33+
### AI Policy Compliance
34+
35+
This section shows whether your organization has an AI Policy enabled and how your repositories are performing against it.
36+
37+
The AI Policy is a curated set of rules designed to detect AI-related risks in your code. When enabled, Codacy applies AI-specific patterns to your repositories and enforces them on pull request checks. You can enable the policy directly from this section.
38+
39+
Once enabled, the section display a breakdown of AI issues by **severity** and **category**.
40+
41+
If you already have the AI Policy enabled, an **Edit** button lets you manage which repositories have the policy applied.
42+
43+
The AI Policy covers four categories of AI-specific risks:
44+
45+
#### Unapproved model calls
46+
47+
Detects usage of disallowed or non-compliant AI models in your codebase, giving you visibility into potential compliance violations.
48+
49+
#### AI Safety
50+
51+
Flags missing or incorrect safety practices when using AI-generated or AI-integrated code.
52+
53+
#### Hardcoded secrets
54+
55+
Detects hardcoded API keys, credentials, and secrets related to AI services.
56+
57+
#### Vulnerabilities (insecure dependencies / SCA)
58+
59+
Identifies vulnerable AI-related dependencies and packages through software composition analysis.
60+
61+
![AI Policy Compliance](images/ai-risk-policy-compliance.png)
62+
63+
---
64+
65+
### Risk Level
66+
67+
This panel shows your organization's overall **AI Risk Level**: **High**, **Medium**, or **Low**.
68+
69+
The risk level is calculated based on whether essential AI safeguards have been enabled in Codacy. These safeguards are listed in the [AI Risk Checklist](#ai-risk-checklist).
70+
71+
![Risk Level](images/ai-risk-level.png)
72+
73+
---
74+
75+
### AI Risk Checklist
76+
77+
The AI Risk Checklist outlines the source code controls that Codacy recommends enabling across your organization:
78+
79+
- **AI Policy enabled:** Enable the AI Policy inside the AI Risk Hub tab.
80+
- **Coverage enabled:** Set up code coverage for your repositories.
81+
- **Enforced gates:** Add quality gates to your repositories and apply gate policies across your organization.
82+
- **Protected pull requests:** Protect pull requests by enforcing quality gates in your Git workflow.
83+
- **Daily vulnerability scans:** Enable Proactive SCA to protect your repositories from dependency vulnerabilities.
84+
- **Applications scanned:** Enable App scanning to scan web applications and APIs for security vulnerabilities.
85+
86+
The more controls you have enabled, the lower your organization's AI risk level.
87+
88+
![AI Risk Checklist](images/ai-risk-checklist.png)
89+
90+
---
91+
92+
### Repositories with most AI issues
93+
94+
This panel shows your repositories ranked by number of open AI issues, in descending order.
95+
96+
You can filter the list by:
97+
98+
- **AI category** (unapproved model calls, AI safety, hardcoded secrets, vulnerabilities)
99+
- **Severity** (critical, high, medium, low, info)
100+
- **Checklist status**
101+
- **Repository** or **segment**
102+
103+
Each entry shows how the repository's AI issue count has changed compared to the previous month.
104+
105+
![Repositories with most AI issues](images/ai-risk-repositories.png)
106+
107+
---
108+
109+
### AI Inventory summary
110+
111+
This section shows a high-level view of the AI resources discovered across your repositories, broken down by provider. For each provider, you can see the number of resources and repositories involved, as well as a breakdown by resource type.
112+
113+
The section surfaces the top AI providers detected in your organization. You can click through to the full [AI Inventory](#ai-inventory) for a detailed view.
114+
115+
![AI Inventory summary](images/ai-risk-inventory-overview.png)
116+
117+
---
118+
119+
## AI Inventory
120+
121+
The **AI Inventory** tab gives you a detailed, searchable view of all AI resources discovered across your organization's repositories. Resources are detected through static analysis and represent actual AI usage found in the code — not just configuration.
122+
123+
![AI Inventory](images/ai-risk-inventory.png)
124+
125+
### Resource types
126+
127+
Codacy detects four types of AI resources:
128+
129+
| Type | Pattern ID | Description |
130+
|------|------------|-------------|
131+
| Model usage | `ai_model_usage` | Direct calls to AI model APIs |
132+
| Dependency | `ai_dependency` | AI SDKs and packages included as dependencies |
133+
| API key | `ai_key` | AI service API keys and credentials found in code |
134+
| Endpoint / env variable | `ai_env_endpoint` | Environment variables and endpoint references for AI services |
135+
136+
### Supported providers
137+
138+
Codacy detects resources from the following AI providers:
139+
140+
- OpenAI
141+
- Anthropic
142+
- Google
143+
- Microsoft
144+
- Amazon
145+
- Mistral
146+
- Cohere
147+
- Groq
148+
- Together AI
149+
- Replicate
150+
- DeepSeek
151+
- Pinecone
152+
- Community models
153+
154+
### How it works
155+
156+
The inventory is built from static analysis of your repositories' source code. For each AI resource found, Codacy records:
157+
158+
- Which **provider** the resource belongs to (e.g. OpenAI, Anthropic)
159+
- What **type** of resource it is (model usage, dependency, API key, endpoint)
160+
- The **marker** that identifies it (e.g. model name, package name)
161+
- How many **repositories** contain it
162+
- How many total **references** to it exist
163+
164+
### Navigating the inventory
165+
166+
Resources are listed as expandable entries. You can drill into each one to see:
167+
168+
1. **Repositories** — which repositories contain the resource, with file counts and reference counts per repository
169+
2. **Files** — within each repository, the specific files where the resource appears
170+
3. **Lines** — within each file, the exact lines where the resource is referenced, with direct links to the file in your Git provider
171+
172+
![AI resource detail](images/ai-risk-resource.png)
173+
174+
### Filtering
175+
176+
You can filter the inventory using the sidebar on the left:
177+
178+
- **Providers** — filter by one or more AI vendors
179+
- **Resource types** — filter by resource type (model usage, dependency, API key, endpoint)
180+
- **Repositories** — filter by specific repository names
181+
- **Segments** — filter by repository segments if segmentation is enabled for your organization
182+
183+
You can reset all filters at once using the **Reset filters** button.
25.4 KB
Loading
199 KB
Loading
35.7 KB
Loading
134 KB
Loading
19.7 KB
Loading
34.4 KB
Loading
44.5 KB
Loading
34.7 KB
Loading
-9.74 KB
Binary file not shown.

0 commit comments

Comments
 (0)