Update: The driver version has been updated and the issue has been fixed.
In updating the driver version for Oakley's NVIDIA GPUs the NVML libraries that are used in conjunction with torque, our resource manager, were also updated. Unfortunatelly this update has broken the ability to change the GPUs compute mode from its default exclusive thread mode. Requests to change the GPU mode both through a PBS directive and the
nvidia-smi command will both fail.
We are planning on pushing out a fix by December 2nd. We ask for our users patience in using the GPUs default compute mode, exclusive thread, until then.