are you sure your power supplies are sized right? do you have the enterprise drac? what are your power numbers? Is all the firmware up to date and drivers for the NVidia card?
If you pull the GPU from one node does that one too exhibit the same hang? On the console is the keyboard locked? Can you connect with the legacy windows client to the host, i.e. is this a vSphere issue and not a hardware issue?