Skip to content

Commit 27f448c

Browse files
author
cuda-python-bot
committed
Deploy doc preview for PR 1097 (621d1d4)
1 parent 8332173 commit 27f448c

64 files changed

Lines changed: 1827 additions & 35 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

docs/pr-preview/pr-1097/cuda-core/latest/_sources/api.rst.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@ CUDA runtime
2727
MemoryResource
2828
DeviceMemoryResource
2929
LegacyPinnedMemoryResource
30+
VirtualMemoryResource
3031

3132
:template: dataclass.rst
3233

@@ -36,6 +37,7 @@ CUDA runtime
3637
GraphDebugPrintOptions
3738
StreamOptions
3839
LaunchConfig
40+
VirtualMemoryResourceOptions
3941

4042

4143
CUDA compilation toolchain

docs/pr-preview/pr-1097/cuda-core/latest/_sources/generated/cuda.core.experimental.DeviceMemoryResource.rst.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,6 @@ cuda.core.experimental.DeviceMemoryResource
2121
.. automethod:: from_registry
2222
.. automethod:: get_allocation_handle
2323
.. automethod:: register
24-
.. automethod:: unregister
2524

2625

2726

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
.. SPDX-FileCopyrightText: Copyright (c) 2024-2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2+
.. SPDX-License-Identifier: Apache-2.0
3+
4+
cuda.core.experimental.VirtualMemoryResource
5+
============================================
6+
7+
.. currentmodule:: cuda.core.experimental
8+
9+
.. autoclass:: VirtualMemoryResource
10+
11+
12+
13+
.. rubric:: Methods
14+
15+
16+
.. automethod:: __init__
17+
.. automethod:: allocate
18+
.. automethod:: deallocate
19+
.. automethod:: modify_allocation
20+
21+
22+
23+
24+
25+
26+
.. rubric:: Attributes
27+
28+
29+
.. autoproperty:: device_id
30+
.. autoproperty:: is_device_accessible
31+
.. autoproperty:: is_host_accessible
32+
33+
Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
cuda.core.experimental.VirtualMemoryResourceOptions
2+
===================================================
3+
4+
.. currentmodule:: cuda.core.experimental
5+
6+
.. autoclass:: VirtualMemoryResourceOptions

docs/pr-preview/pr-1097/cuda-core/latest/_sources/release/0.4.0-notes.rst.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,7 @@ New features
3333
- Stream-ordered memory allocation can now be shared on Linux via :class:`DeviceMemoryResource`.
3434
- Added NVVM IR support to :class:`Program`. NVVM IR is now understood with ``code_type="nvvm"``.
3535
- Added an :attr:`ObjectCode.code_type` attribute for querying the code type.
36+
- Added :class:`VirtualMemoryResource` for low-level virtual memory management on Linux.
3637

3738

3839
New examples

docs/pr-preview/pr-1097/cuda-core/latest/api.html

Lines changed: 15 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -465,12 +465,14 @@
465465
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.MemoryResource.html">cuda.core.experimental.MemoryResource</a></li>
466466
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html">cuda.core.experimental.DeviceMemoryResource</a></li>
467467
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html">cuda.core.experimental.LegacyPinnedMemoryResource</a></li>
468+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResource.html">cuda.core.experimental.VirtualMemoryResource</a></li>
468469
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html">cuda.core.experimental.DeviceMemoryResourceOptions</a></li>
469470
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html">cuda.core.experimental.EventOptions</a></li>
470471
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html">cuda.core.experimental.GraphCompleteOptions</a></li>
471472
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html">cuda.core.experimental.GraphDebugPrintOptions</a></li>
472473
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html">cuda.core.experimental.StreamOptions</a></li>
473474
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html">cuda.core.experimental.LaunchConfig</a></li>
475+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResourceOptions.html">cuda.core.experimental.VirtualMemoryResourceOptions</a></li>
474476
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Program.html">cuda.core.experimental.Program</a></li>
475477
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Linker.html">cuda.core.experimental.Linker</a></li>
476478
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.ObjectCode.html">cuda.core.experimental.ObjectCode</a></li>
@@ -585,27 +587,33 @@ <h2>CUDA runtime<a class="headerlink" href="#cuda-runtime" title="Link to this h
585587
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html#cuda.core.experimental.DeviceMemoryResource" title="cuda.core.experimental.DeviceMemoryResource"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DeviceMemoryResource</span></code></a>(device_id[, options])</p></td>
586588
<td><p>Create a device memory resource managing a stream-ordered memory pool.</p></td>
587589
</tr>
588-
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html#cuda.core.experimental.LegacyPinnedMemoryResource" title="cuda.core.experimental.LegacyPinnedMemoryResource"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LegacyPinnedMemoryResource</span></code></a>()</p></td>
590+
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html#cuda.core.experimental.LegacyPinnedMemoryResource" title="cuda.core.experimental.LegacyPinnedMemoryResource"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LegacyPinnedMemoryResource</span></code></a></p></td>
589591
<td><p>Create a pinned memory resource that uses legacy cuMemAllocHost/cudaMallocHost APIs.</p></td>
590592
</tr>
591-
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html#cuda.core.experimental.DeviceMemoryResourceOptions" title="cuda.core.experimental.DeviceMemoryResourceOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DeviceMemoryResourceOptions</span></code></a>([ipc_enabled, ...])</p></td>
593+
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResource.html#cuda.core.experimental.VirtualMemoryResource" title="cuda.core.experimental.VirtualMemoryResource"><code class="xref py py-obj docutils literal notranslate"><span class="pre">VirtualMemoryResource</span></code></a>(device[, config])</p></td>
594+
<td><p>Create a device memory resource that uses the CUDA VMM APIs to allocate memory.</p></td>
595+
</tr>
596+
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html#cuda.core.experimental.DeviceMemoryResourceOptions" title="cuda.core.experimental.DeviceMemoryResourceOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DeviceMemoryResourceOptions</span></code></a>([ipc_enabled, ...])</p></td>
592597
<td><p>Customizable <a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html#cuda.core.experimental.DeviceMemoryResource" title="cuda.core.experimental._memory.DeviceMemoryResource"><code class="xref py py-obj docutils literal notranslate"><span class="pre">DeviceMemoryResource</span></code></a> options.</p></td>
593598
</tr>
594-
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html#cuda.core.experimental.EventOptions" title="cuda.core.experimental.EventOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EventOptions</span></code></a>([enable_timing, ...])</p></td>
599+
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html#cuda.core.experimental.EventOptions" title="cuda.core.experimental.EventOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">EventOptions</span></code></a>([enable_timing, ...])</p></td>
595600
<td><p>Customizable <a class="reference internal" href="generated/cuda.core.experimental.Event.html#cuda.core.experimental.Event" title="cuda.core.experimental._event.Event"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Event</span></code></a> options.</p></td>
596601
</tr>
597-
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html#cuda.core.experimental.GraphCompleteOptions" title="cuda.core.experimental.GraphCompleteOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">GraphCompleteOptions</span></code></a>([auto_free_on_launch, ...])</p></td>
602+
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html#cuda.core.experimental.GraphCompleteOptions" title="cuda.core.experimental.GraphCompleteOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">GraphCompleteOptions</span></code></a>([auto_free_on_launch, ...])</p></td>
598603
<td><p>Customizable options for <code class="xref py py-obj docutils literal notranslate"><span class="pre">_graph.GraphBuilder.complete()</span></code></p></td>
599604
</tr>
600-
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html#cuda.core.experimental.GraphDebugPrintOptions" title="cuda.core.experimental.GraphDebugPrintOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">GraphDebugPrintOptions</span></code></a>([verbose, ...])</p></td>
605+
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html#cuda.core.experimental.GraphDebugPrintOptions" title="cuda.core.experimental.GraphDebugPrintOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">GraphDebugPrintOptions</span></code></a>([verbose, ...])</p></td>
601606
<td><p>Customizable options for <code class="xref py py-obj docutils literal notranslate"><span class="pre">_graph.GraphBuilder.debug_dot_print()</span></code></p></td>
602607
</tr>
603-
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html#cuda.core.experimental.StreamOptions" title="cuda.core.experimental.StreamOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">StreamOptions</span></code></a>([nonblocking, priority])</p></td>
608+
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html#cuda.core.experimental.StreamOptions" title="cuda.core.experimental.StreamOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">StreamOptions</span></code></a>([nonblocking, priority])</p></td>
604609
<td><p>Customizable <a class="reference internal" href="generated/cuda.core.experimental.Stream.html#cuda.core.experimental.Stream" title="cuda.core.experimental._stream.Stream"><code class="xref py py-obj docutils literal notranslate"><span class="pre">Stream</span></code></a> options.</p></td>
605610
</tr>
606-
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html#cuda.core.experimental.LaunchConfig" title="cuda.core.experimental.LaunchConfig"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LaunchConfig</span></code></a>([grid, cluster, block, ...])</p></td>
611+
<tr class="row-odd"><td><p><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html#cuda.core.experimental.LaunchConfig" title="cuda.core.experimental.LaunchConfig"><code class="xref py py-obj docutils literal notranslate"><span class="pre">LaunchConfig</span></code></a>([grid, cluster, block, ...])</p></td>
607612
<td><p>Customizable launch options.</p></td>
608613
</tr>
614+
<tr class="row-even"><td><p><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResourceOptions.html#cuda.core.experimental.VirtualMemoryResourceOptions" title="cuda.core.experimental.VirtualMemoryResourceOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">VirtualMemoryResourceOptions</span></code></a>(...)</p></td>
615+
<td><p>A configuration object for the VirtualMemoryResource</p></td>
616+
</tr>
609617
</tbody>
610618
</table>
611619
</div>

docs/pr-preview/pr-1097/cuda-core/latest/api_private.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -463,12 +463,14 @@
463463
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.MemoryResource.html">cuda.core.experimental.MemoryResource</a></li>
464464
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html">cuda.core.experimental.DeviceMemoryResource</a></li>
465465
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html">cuda.core.experimental.LegacyPinnedMemoryResource</a></li>
466+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResource.html">cuda.core.experimental.VirtualMemoryResource</a></li>
466467
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html">cuda.core.experimental.DeviceMemoryResourceOptions</a></li>
467468
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html">cuda.core.experimental.EventOptions</a></li>
468469
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html">cuda.core.experimental.GraphCompleteOptions</a></li>
469470
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html">cuda.core.experimental.GraphDebugPrintOptions</a></li>
470471
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html">cuda.core.experimental.StreamOptions</a></li>
471472
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html">cuda.core.experimental.LaunchConfig</a></li>
473+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResourceOptions.html">cuda.core.experimental.VirtualMemoryResourceOptions</a></li>
472474
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Program.html">cuda.core.experimental.Program</a></li>
473475
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Linker.html">cuda.core.experimental.Linker</a></li>
474476
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.ObjectCode.html">cuda.core.experimental.ObjectCode</a></li>

docs/pr-preview/pr-1097/cuda-core/latest/conduct.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -465,12 +465,14 @@
465465
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.MemoryResource.html">cuda.core.experimental.MemoryResource</a></li>
466466
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html">cuda.core.experimental.DeviceMemoryResource</a></li>
467467
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html">cuda.core.experimental.LegacyPinnedMemoryResource</a></li>
468+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResource.html">cuda.core.experimental.VirtualMemoryResource</a></li>
468469
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html">cuda.core.experimental.DeviceMemoryResourceOptions</a></li>
469470
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html">cuda.core.experimental.EventOptions</a></li>
470471
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html">cuda.core.experimental.GraphCompleteOptions</a></li>
471472
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html">cuda.core.experimental.GraphDebugPrintOptions</a></li>
472473
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html">cuda.core.experimental.StreamOptions</a></li>
473474
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html">cuda.core.experimental.LaunchConfig</a></li>
475+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResourceOptions.html">cuda.core.experimental.VirtualMemoryResourceOptions</a></li>
474476
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Program.html">cuda.core.experimental.Program</a></li>
475477
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Linker.html">cuda.core.experimental.Linker</a></li>
476478
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.ObjectCode.html">cuda.core.experimental.ObjectCode</a></li>

docs/pr-preview/pr-1097/cuda-core/latest/contribute.html

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -461,12 +461,14 @@
461461
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.MemoryResource.html">cuda.core.experimental.MemoryResource</a></li>
462462
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResource.html">cuda.core.experimental.DeviceMemoryResource</a></li>
463463
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LegacyPinnedMemoryResource.html">cuda.core.experimental.LegacyPinnedMemoryResource</a></li>
464+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResource.html">cuda.core.experimental.VirtualMemoryResource</a></li>
464465
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.DeviceMemoryResourceOptions.html">cuda.core.experimental.DeviceMemoryResourceOptions</a></li>
465466
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.EventOptions.html">cuda.core.experimental.EventOptions</a></li>
466467
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphCompleteOptions.html">cuda.core.experimental.GraphCompleteOptions</a></li>
467468
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.GraphDebugPrintOptions.html">cuda.core.experimental.GraphDebugPrintOptions</a></li>
468469
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.StreamOptions.html">cuda.core.experimental.StreamOptions</a></li>
469470
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.LaunchConfig.html">cuda.core.experimental.LaunchConfig</a></li>
471+
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.VirtualMemoryResourceOptions.html">cuda.core.experimental.VirtualMemoryResourceOptions</a></li>
470472
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Program.html">cuda.core.experimental.Program</a></li>
471473
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.Linker.html">cuda.core.experimental.Linker</a></li>
472474
<li class="toctree-l2"><a class="reference internal" href="generated/cuda.core.experimental.ObjectCode.html">cuda.core.experimental.ObjectCode</a></li>

0 commit comments

Comments
 (0)