nvidia-container-toolkit does not expose /etc/OpenCL/vendors/nvidia.icd to containers currently. However, if I just copy this file from the host system into the container, then OpenCL works.

Is this the intended behavior for some particular reason? If not, I think it would be good to expose /etc/OpenCL/vendors/nvidia.icd to containers.