Message boards :
Number crunching :
NVidia 436.xx and later drivers can cause very long compute times especially on Arecibo VHAR work units
Message board moderation
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 20 · Next
Author | Message |
---|---|
LumenDan Send message Joined: 4 Jan 01 Posts: 5 Credit: 9,247,086 RAC: 13 |
Observing when a VHAR work unit appears to stall on my machine, I have noticed that the progress will always stop counting at 0.603%. If this is consistent between other computers it may help isolate what the client program is doing when it stops performing as intended. LumenDan |
Stephen Thomas Home - Delhi Send message Joined: 16 Sep 99 Posts: 11 Credit: 507,164,357 RAC: 357 |
I did just installed NVIDIA 441.20 on 3 Windows10 maschines und did run some units. It is looking good. Perhaps the problem is solved? |
Stephen Thomas Home - Delhi Send message Joined: 16 Sep 99 Posts: 11 Credit: 507,164,357 RAC: 357 |
Sorry, sorry, I was too optomistic!! The problem still exist. |
robertmiles Send message Joined: 16 Jan 12 Posts: 213 Credit: 4,117,756 RAC: 6 |
It looks like I've had several tasks go into an endless loop, stopped only by the time limit. https://setiathome.berkeley.edu/result.php?resultid=8226545671 https://setiathome.berkeley.edu/result.php?resultid=8226545679 https://setiathome.berkeley.edu/result.php?resultid=8226545233 https://setiathome.berkeley.edu/result.php?resultid=8226545289 https://setiathome.berkeley.edu/result.php?resultid=8226545586 https://setiathome.berkeley.edu/result.php?resultid=8226545594 https://setiathome.berkeley.edu/result.php?resultid=8226545596 https://setiathome.berkeley.edu/result.php?resultid=8226545599 https://setiathome.berkeley.edu/result.php?resultid=8226545603 https://setiathome.berkeley.edu/result.php?resultid=8226545604 https://setiathome.berkeley.edu/result.php?resultid=8226545609 Those that someone else completed reported Completed, waiting for validation, or two others produce a valid result using some other application version. I'm using the 441.12 driver. I just got a notice that the 441.20 driver is available (released today), and am now downloading it. The last few of these stopped counting progress at 0.603%, except the one now running at 0.605%. How do I tell if any of these were Arecibo VHAR workunits? |
Mr. Kevvy Send message Joined: 15 May 99 Posts: 3797 Credit: 1,114,826,392 RAC: 3,319 |
|
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
The problem has been seen on tasks with Angle Range as low as 1.1. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Ian&Steve C. Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 |
How do I tell if any of these were Arecibo VHAR workunits? yeah all of his quoted tasks are VHAR. I was under the impression that anything >1 was a VHAR. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours |
rcthardcore Send message Joined: 23 Nov 08 Posts: 48 Credit: 1,306,006 RAC: 0 |
Has anybody reported this problem to NVIDIA??? If not, they need to do so immediately. |
Wiggo Send message Joined: 24 Jan 00 Posts: 36341 Credit: 261,360,520 RAC: 489 |
Has anybody reported this problem to NVIDIA??? If not, they need to do so immediately.It has been by several here. Cheers. |
Ian&Steve C. Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 |
Has anybody reported this problem to NVIDIA??? If not, they need to do so immediately. It’s been reported by several people. But it’s low priority for them. Use the older drivers that work. Or use the SAH app that works. Or don’t use Windows 10. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours |
Cameron Send message Joined: 27 Nov 02 Posts: 110 Credit: 5,082,471 RAC: 17 |
Has anybody reported this problem to NVIDIA??? If not, they need to do so immediately.It has been by several here. I believe others here when they say it's been reported to NVIDIA. or that the latest drivers haven't solved the problem. I did try some of the later 436.xx drivers which didn't work. so I'm back to 431.60 checking the release notes for the last couple of drivers. I don't see it as a known open issue so I'm not certain. Nvidia could just try and patch it on the quiet. |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
yeah all of his quoted tasks are VHAR. I was under the impression that anything >1 was a VHAR. Yes, somewhere buried in the attic of this forum is a post that actually defines what range constitutes VLAR and VHAR and a proposal of what should probably be called medium angle range. I didn't have time to go search for it earlier. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Jacob Klein Send message Joined: 15 Apr 11 Posts: 149 Credit: 9,783,406 RAC: 9 |
NVIDIA released 441.20 drivers today. I tested them, and they still have the "SETI OpenCL SoG VHAR on Windows 10" problems: Maxwell: > Tasks crash with error. >ERROR: OpenCL kernel/call 'clEnqueueMapBuffer(gpu_GPUState)' call failed (-36) in file ..\analyzeFuncs.cpp near line 1995. Pascal/Turing: > Tasks run indefinitely with no load on the GPU. 431.60 are the last drivers that work correctly for those specific SETI tasks on Windows 10. NVIDIA is aware, and per NVIDIA, we must continue to be patient for a driver version that includes a fix. |
robertmiles Send message Joined: 16 Jan 12 Posts: 213 Credit: 4,117,756 RAC: 6 |
Another VHAR failed with 441.12 https://setiathome.berkeley.edu/result.php?resultid=8226545610 I installed 441.20 without restarting Windows; the next task ran in a different slot, but had the same problem. Also progress froze at 0.605%. The VHAR that failed with 441.20 https://setiathome.berkeley.edu/result.php?resultid=8226545584 Two things to consider for this type of problem: Allow sorting all tasks or only the error tasks by timestamp of completion. Allow telling the server don't send me any VHAR tasks. I just reinstalled 431.60. Tasks appear to be completing normally, even if VHAR. Could .vhar be inserted the names of VHAR tasks? Also .mar for medium angle range, if that is defined? |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
yeah all of his quoted tasks are VHAR. I was under the impression that anything >1 was a VHAR. OK. Found the post and it was from HAL9000. https://setiathome.berkeley.edu/forum_thread.php?id=79990&postid=1805455 VHARs >1.0 (aka "Shorties") And from Richard's post. https://setiathome.berkeley.edu/forum_thread.php?id=79990&postid=1805543 Technically, VLAR was used to denote AR 0.05 and below, and VHAR for AR 1.1275 and above. When GPUs came along, we extended VLAR to a somewhat arbitrary AR 0.12 Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Ian&Steve C. Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 |
I remember at one time the project servers were setup to NOT send a certain type of task to Nvidia GPUs. I believe it was Arecibo VLARs. I’d assume something like that could be implemented again, only for VHARs this time. Just set it up to not send any to those on SoG and on Windows 10. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours |
juan BFP Send message Joined: 16 Mar 07 Posts: 9786 Credit: 572,710,851 RAC: 3,799 |
I remember at one time the project servers were setup to NOT send a certain type of task to Nvidia GPUs. I believe it was Arecibo VLARs. Could be added not to send any WU to crunch on the 5700 too. |
Penguin Send message Joined: 5 Sep 14 Posts: 13 Credit: 16,544,489 RAC: 360 |
Same problems here, like others, glad I found this thread. Was not sure what the cause was. I will try reverting the drivers now. |
Bruce N. Goren Send message Joined: 1 Jul 99 Posts: 15 Credit: 11,329,118 RAC: 32 |
Yup, my daily credits have dropped by 50% since updating my driver. Can't revert, I need the latest for my main tasks, SETI is just for idle time. Let's hope someone comes up with a fix soon. Thanks for this thread, really had me scratching my head wondering what was broken! |
Bruce N. Goren Send message Joined: 1 Jul 99 Posts: 15 Credit: 11,329,118 RAC: 32 |
I just installed the NVidia Studio Driver version 441.28 . I'll let you know if my SETI performance is restored. |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.