You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The dstack-cloud downstream README was merged back into this repo,
rebranding the whole project as a cloud product ("What is dstack-cloud?",
"Deploy on GCP and AWS", dstack-cloud CLI quick start). Restore the
open-framework framing:
- title/tagline/logo back to dstack (the open framework for confidential AI)
- badge and verifier links back to Dstack-TEE/dstack
- quick start uses docker-compose + meta-dstack images instead of the
dstack-cloud CLI; drop the CLI reference section
- keep Supported Platforms table (bare metal TDX first), FAQ, citation
- license stays Apache 2.0
@@ -18,56 +18,20 @@ Original Contributors: Hang Yin, Kevin Wang, Andrew Miller
18
18
19
19
---
20
20
21
-
## What is dstack-cloud?
21
+
## What is dstack?
22
22
23
-
dstack-cloud extends [dstack](https://github.com/Dstack-TEE/dstack) to deploy containers on **GCP Confidential VMs** and **AWS Nitro Enclaves**. It provisions the VM, manages attestation, and handles networking. You get confidential computing on cloud infrastructure without running your own TDX hardware.
23
+
dstack is the open framework for confidential AI — deploy AI applications with cryptographic privacy guarantees.
24
24
25
-
Your containers run with full security infrastructure out of the box: key management, remote attestation, hardened OS, and encrypted storage. Users can cryptographically verify exactly what's running.
25
+
AI providers ask users to trust them with sensitive data. But trust doesn't scale, and trust can't be verified. With dstack, your containers run inside confidential VMs (Intel TDX) with native support for NVIDIA Confidential Computing (H100, Blackwell). Users can cryptographically verify exactly what's running: private AI with your existing Docker workflow.
26
26
27
27
## Supported Platforms
28
28
29
29
| Platform | Status | Attestation |
30
30
|----------|--------|-------------|
31
+
|**Bare metal TDX**| Available | TDX |
31
32
|**[Phala Cloud](https://cloud.phala.network)**| Available | TDX |
32
33
|**GCP Confidential VMs**| Available | TDX + TPM |
33
34
|**AWS Nitro Enclaves**| Available | NSM |
34
-
|**Bare metal TDX**| Available | TDX |
35
-
36
-
## Quick Start
37
-
38
-
**1. Create a project:**
39
-
40
-
```bash
41
-
dstack-cloud new my-app
42
-
cd my-app
43
-
```
44
-
45
-
**2. Edit your docker-compose.yaml:**
46
-
47
-
```yaml
48
-
services:
49
-
vllm:
50
-
image: vllm/vllm-openai:latest
51
-
runtime: nvidia
52
-
command: --model Qwen/Qwen2.5-7B-Instruct
53
-
ports:
54
-
- "8000:8000"
55
-
```
56
-
57
-
**3. Deploy:**
58
-
59
-
```bash
60
-
dstack-cloud deploy
61
-
```
62
-
63
-
**4. Check status:**
64
-
65
-
```bash
66
-
dstack-cloud status
67
-
dstack-cloud logs --follow
68
-
```
69
-
70
-
For the full walkthrough, see the [Quickstart Guide](./docs/quickstart.md).
71
35
72
36
## Features
73
37
@@ -85,74 +49,71 @@ For the full walkthrough, see the [Quickstart Guide](./docs/quickstart.md).
85
49
-**Isolated keys**: Per-app keys derived in TEE. Survives hardware failure. Never exposed to operators.
**Try it now:** Chat with LLMs running in TEE at [chat.redpill.ai](https://chat.redpill.ai). Click the shield icon to verify attestations from Intel TDX and NVIDIA GPUs.
55
+
56
+
**Deploy your own:**
57
+
58
+
```yaml
59
+
# docker-compose.yaml
60
+
services:
61
+
vllm:
62
+
image: vllm/vllm-openai:latest
63
+
runtime: nvidia
64
+
command: --model Qwen/Qwen2.5-7B-Instruct
65
+
ports:
66
+
- "8000:8000"
67
+
```
68
+
69
+
Deploy to any Intel TDX host using a guest OS image from [meta-dstack releases](https://github.com/Dstack-TEE/meta-dstack/releases), or use [Phala Cloud](https://cloud.phala.network) for managed infrastructure.
70
+
71
+
Setting up dstack on your own hardware? See the [full deployment guide →](./docs/deployment.md)
72
+
88
73
## Architecture
89
74
90
75

91
76
92
-
Your container runs inside a Confidential VM (Intel TDX on GCP, Nitro Enclave on AWS). GPU isolation is optional via NVIDIA Confidential Computing. The CPU TEE protects application logic. The GPU TEE protects model weights and inference data.
77
+
Your container runs inside a Confidential VM (Intel TDX) with optional GPU isolation via NVIDIA Confidential Computing. The CPU TEE protects application logic; the GPU TEE protects model weights and inference data.
93
78
94
79
**Core components:**
95
80
96
-
-**Guest Agent**: Runs inside each CVM. Generates attestation quotes so users can verify exactly what's running. Provisions per-app cryptographic keys from KMS. Encrypts local storage. Apps interact via `/var/run/dstack.sock`.
81
+
- **Guest Agent**: Runs inside each CVM. Generates TDX attestation quotes so users can verify exactly what's running. Provisions per-app cryptographic keys from KMS. Encrypts local storage. Apps interact via `/var/run/dstack.sock`.
97
82
98
-
-**KMS**: Runs in its own TEE. Verifies attestation quotes before releasing keys. Enforces authorization policies that operators cannot bypass. Derives deterministic keys bound to each app's attested identity.
83
+
- **KMS**: Runs in its own TEE. Verifies TDX quotes before releasing keys. Enforces authorization policies defined in on-chain smart contracts — operators cannot bypass these checks. Derives deterministic keys bound to each app's attested identity.
99
84
100
-
-**Gateway**: Terminates TLS at the edge. Provisions ACME certificates automatically. Routes traffic to CVMs. Internal communication uses RA-TLS for mutual attestation.
85
+
- **Gateway**: Terminates TLS at the edge and provisions ACME certificates automatically. Routes traffic to CVMs. All internal communication uses RA-TLS for mutual attestation.
101
86
102
-
-**VMM**: Parses docker-compose files directly — no app changes needed. Boots CVMs from a reproducible OS image. Allocates CPU, memory, and confidential GPU resources.
87
+
- **VMM**: Runs on bare-metal TDX hosts. Parses docker-compose files directly — no app changes needed. Boots CVMs from a reproducible OS image. Allocates CPU, memory, and confidential GPU resources.
103
88
104
89
[Full security model →](./docs/security/security-model.md)
105
90
106
-
## CLI Reference
107
-
108
-
```
109
-
dstack-cloud new <name> # Create a new project
110
-
dstack-cloud config-edit # Edit global configuration
111
-
dstack-cloud deploy # Deploy to cloud
112
-
dstack-cloud status # Check deployment status
113
-
dstack-cloud logs [--follow] # View console logs
114
-
dstack-cloud stop # Stop the VM
115
-
dstack-cloud start # Start a stopped VM
116
-
dstack-cloud remove # Remove the VM and cleanup
117
-
dstack-cloud list # List all deployments
118
-
dstack-cloud fw allow <port> # Allow traffic on a port
119
-
dstack-cloud fw deny <port> # Block traffic on a port
120
-
dstack-cloud fw list # List firewall rules
121
-
```
122
-
123
91
## SDKs
124
92
125
-
Apps communicate with the guest agent via HTTP over `/var/run/dstack.sock`. Use the [HTTP API](https://github.com/Dstack-TEE/dstack/blob/master/sdk/curl/api.md) directly with curl, or use a language SDK:
93
+
Apps communicate with the guest agent via HTTP over `/var/run/dstack.sock`. Use the [HTTP API](./sdk/curl/api.md) directly with curl, or use a language SDK:
@@ -169,56 +130,51 @@ Apps communicate with the guest agent via HTTP over `/var/run/dstack.sock`. Use
169
130
<details>
170
131
<summary><strong>Why not use AWS Nitro / Azure Confidential VMs / GCP directly?</strong></summary>
171
132
172
-
You can — but you'll build everything yourself: attestation verification, key management, Docker orchestration, certificate provisioning, and governance. dstack-cloud provides all of this out of the box.
133
+
You can — but you'll build everything yourself: attestation verification, key management, Docker orchestration, certificate provisioning, and governance. dstack provides all of this out of the box.
173
134
174
135
| Approach | Docker native | GPU TEE | Key management | Attestation tooling | Open source |
Cloud providers give you the hardware primitive. dstack-cloud gives you the full stack: reproducible OS images, automatic attestation, per-app key derivation, and TLS certificates. No vendor lock-in.
142
+
Cloud providers give you the hardware primitive. dstack gives you the full stack: reproducible OS images, automatic attestation, per-app key derivation, TLS certificates, and smart contract governance. No vendor lock-in.
182
143
183
144
</details>
184
145
185
146
<details>
186
147
<summary><strong>How is this different from SGX/Gramine?</strong></summary>
187
148
188
-
SGX requires porting applications to enclaves. dstack-cloud uses full-VM isolation (Intel TDX, AWS Nitro) — bring your Docker containers as-is. Plus GPU TEE support that SGX doesn't offer.
149
+
SGX requires porting applications to enclaves. dstack uses full-VM isolation (Intel TDX) — bring your Docker containers as-is. Plus GPU TEE support that SGX doesn't offer.
189
150
190
151
</details>
191
152
192
153
<details>
193
154
<summary><strong>What's the performance overhead?</strong></summary>
194
155
195
-
Minimal. Intel TDX adds ~2-5% overhead for CPU workloads. NVIDIA Confidential Computing has negligible impact on GPU inference. Memory encryption is the main cost, but it's hardware-accelerated on supported CPUs.
156
+
Minimal. Intel TDX adds ~2-5% overhead for CPU workloads. NVIDIA Confidential Computing has negligible impact on GPU inference. The main cost is memory encryption, which is hardware-accelerated on supported CPUs.
196
157
197
158
</details>
198
159
199
160
<details>
200
161
<summary><strong>Is this production-ready?</strong></summary>
201
162
202
-
Yes. dstack powers production AI at [OpenRouter](https://openrouter.ai/provider/phala) and [NEAR AI](https://x.com/ilblackdragon/status/1962920246148268235). It's been [audited by zkSecurity](./docs/security/dstack-audit.pdf). It's a Linux Foundation Confidential Computing Consortium project.
163
+
Yes. dstack powers production AI infrastructure at [OpenRouter](https://openrouter.ai/provider/phala) and [NEAR AI](https://x.com/ilblackdragon/status/1962920246148268235). The framework has been [audited by zkSecurity](./docs/security/dstack-audit.pdf) and is a Linux Foundation Confidential Computing Consortium project.
203
164
204
165
</details>
205
166
206
167
<details>
207
168
<summary><strong>Can I run this on my own hardware?</strong></summary>
208
169
209
-
Yes. dstack-cloud runs on any Intel TDX-capable server. See the [deployment guide](./docs/deployment.md) for self-hosting instructions. You can also use [Phala Cloud](https://cloud.phala.network) for managed infrastructure.
170
+
Yes. dstack runs on any Intel TDX-capable server. See the [deployment guide](./docs/deployment.md) for self-hosting instructions. You can also use [Phala Cloud](https://cloud.phala.network) for managed infrastructure.
210
171
211
172
</details>
212
173
213
174
<details>
214
175
<summary><strong>What TEE hardware is supported?</strong></summary>
0 commit comments