You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/guides/hosting/data-security/presigned-urls.md
+23-4Lines changed: 23 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,9 +7,20 @@ title: Access BYOB using pre-signed URLs
7
7
weight: 2
8
8
---
9
9
10
-
W&B uses pre-signed URLs to simplify access to blob storage from your AI workloads or user browsers. For basic information on pre-signed URLs, refer to [Pre-signed URLs for AWS S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-presigned-url.html), [Signed URLs for Google Cloud Storage](https://cloud.google.com/storage/docs/access-control/signed-urls) and [Shared Access Signature for Azure Blob Storage](https://learn.microsoft.com/en-us/azure/storage/common/storage-sas-overview).
10
+
W&B uses pre-signed URLs to simplify access to blob storage from your AI workloads or user browsers. For basic information on pre-signed URLs, refer to the cloud provider's documentation:
11
+
-[Pre-signed URLs for AWS S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-presigned-url.html)
12
+
-[Signed URLs for Google Cloud Storage](https://cloud.google.com/storage/docs/access-control/signed-urls)
13
+
-[Shared Access Signature for Azure Blob Storage](https://learn.microsoft.com/en-us/azure/storage/common/storage-sas-overview)
11
14
12
-
When needed, AI workloads or user browser clients within your network request pre-signed URLs from the W&B Platform. W&B Platform then access the relevant blob storage to generate the pre-signed URL with required permissions, and returns it back to the client. The client then uses the pre-signed URL to access the blob storage for object upload or retrieval operations. URL expiry time for object downloads is 1 hour, and it is 24 hours for object uploads as some large objects may need more time to upload in chunks.
15
+
How it works:
16
+
1. When needed, AI workloads or user browser clients within your network request pre-signed URLs from W&B.
17
+
1. W&B responds to the request by accessing the blob storage to generate the pre-signed URL with the required permissions.
18
+
1. W&B returns the pre-signed URL to the client.
19
+
1. The client uses the pre-signed URL to read or write to the blob storage.
20
+
21
+
A pre-signed URL expires after:
22
+
-**Reading**: 1 hour
23
+
-**Writing**: 24 hours, to allow more time to upload large objects in chunks.
13
24
14
25
## Team-level access control
15
26
@@ -27,8 +38,16 @@ In case of AWS, one can use [VPC or IP address based network restriction](https:
27
38
28
39
## Audit logs
29
40
30
-
W&B also recommends to use [W&B audit logs]({{< relref "../monitoring-usage/audit-logging.md" >}}) in addition to blob storage specific audit logs. For latter, refer to [AWS S3 access logs](https://docs.aws.amazon.com/AmazonS3/latest/userguide/ServerLogs.html),[Google Cloud Storage audit logs](https://cloud.google.com/storage/docs/audit-logging) and [Monitor Azure blob storage](https://learn.microsoft.com/en-us/azure/storage/blobs/monitor-blob-storage). Admin and security teams can use audit logs to keep track of which user is doing what in the W&B product and take necessary action if they determine that some operations need to be limited for certain users.
41
+
W&B recommends using [W&B audit logs]({{< relref "../monitoring-usage/audit-logging.md" >}}) together with blob storage specific audit logs. For blob storage audit logs, refer to the documentation for each cloud provider:
Admin and security teams can use audit logs to keep track of which user is doing what in the W&B product and take necessary action if they determine that some operations need to be limited for certain users.
31
47
32
48
{{% alert %}}
33
49
Pre-signed URLs are the only supported blob storage access mechanism in W&B. W&B recommends configuring some or all of the above list of security controls depending on your risk appetite.
34
-
{{% /alert %}}
50
+
{{% /alert %}}
51
+
52
+
### Determine the user that requested a pre-signed URL
53
+
When W&B returns a pre-signed URL for AWS or GCP blob storage, the `X-User` header contains the requester's username. The header is not set for Azure blob storage.
0 commit comments