Message boards :
Number crunching :
The Server Issues / Outages Thread - Panic Mode On! (118)
Message board moderation
Previous · 1 . . . 21 · 22 · 23 · 24 · 25 · 26 · 27 . . . 94 · Next
Author | Message |
---|---|
![]() ![]() ![]() Send message Joined: 19 May 99 Posts: 766 Credit: 354,398,348 RAC: 11,693 ![]() ![]() |
|
juan BFP ![]() ![]() ![]() ![]() Send message Joined: 16 Mar 07 Posts: 9786 Credit: 572,710,851 RAC: 3,799 ![]() ![]() |
Yep, every host in scheduler backoff due to "internal server error". Can't report work and caches falling. Nothing here too. Caches holding. Ready to do my part. ![]() |
![]() ![]() ![]() Send message Joined: 1 Apr 13 Posts: 1859 Credit: 268,616,081 RAC: 1,349 ![]() ![]() |
Able to report now, at least. Not giving out work yet, though. ![]() ![]() |
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768 ![]() ![]() |
Hey, with 36 tasks left, I started getting new work. Now to see if it lasts... |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13959 Credit: 208,696,464 RAC: 304 ![]() ![]() |
Got home to find Linux system out of GPU work due to extreme backoffs on downloads. Grant Darwin NT |
Stephen "Heretic" ![]() ![]() ![]() ![]() Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 ![]() ![]() |
I see they added some ... {rest lost due to some error?} . . Yep. I noticed that, most of my workload is now old arecibo work ... Stephen <shrug> |
![]() ![]() Send message Joined: 24 Jan 00 Posts: 38203 Credit: 261,360,520 RAC: 489 ![]() ![]() |
I see they added some old Arecibo files to the splitters in an attempt to slow down the return rate from all the noise bombs.And a lot of them here ATM have been the same. :-( Cheers. |
![]() Send message Joined: 15 Sep 07 Posts: 190 Credit: 28,269,068 RAC: 5 ![]() |
Well here is a few numbers to keep in mind Results out in the field - 7,536,318 Results returned and awaiting validation - 7,240,993 First time this year I have seen the returns past 7 million. Results received in last hour - 195,093 Cheers |
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0 ![]() |
Well here is a few numbers to keep in mind Interesting numbers: ![]() ![]() |
![]() Send message Joined: 28 Nov 02 Posts: 5126 Credit: 276,046,078 RAC: 462 ![]() |
Lots of short tasks.... Tom A proud member of the OFA (Old Farts Association). |
Richard Haselgrove ![]() Send message Joined: 4 Jul 99 Posts: 14690 Credit: 200,643,578 RAC: 874 ![]() ![]() |
Yes, I'm seeing shorties (VHAR) now from 27au10ad. I also saw the noise bombs (overflows) earlier from BLC35. Neither of those are going to help our bad drivers and bad cards. Eric put in a draconian attempt to try and weed those out yesterday: Hopefully final validation mod to reduce bad results from failing GPUs If 1 of 2 is overflow, quorum is increased to 3 If 1 of 3 is overflow, results are validated. If 2 of 2 are overflow, quorum is increased to 3. If 2 of 3 are overflow, quorum is increased to 4 If 3 of 3 are overflow, results are validated. 4 results are always validated.so expect lots of resends, too. |
W-K 666 ![]() Send message Joined: 18 May 99 Posts: 19724 Credit: 40,757,560 RAC: 67 ![]() ![]() |
If 3 of 3 are overflow, results are validated. That is a bug. If first two are ATI graphics cards, which will produce similar bad results, it doesn't matter what the third result is processed on, if it also -9's then the two ATI cards will agree and the correct third result will receive an "invalid". See https://setiathome.berkeley.edu/forum_thread.php?id=84508&postid=2026843#2026843 I expect there to be many of them in this batch of blc35.... tasks |
Richard Haselgrove ![]() Send message Joined: 4 Jul 99 Posts: 14690 Credit: 200,643,578 RAC: 874 ![]() ![]() |
I think we should monitor for a while. If anyone notices this case in the future, please post a link and we can examine. I think the three would still have to be 'weakly similar', so if the early overflow signals were of a completely different type, that could (should?) be flagged as 'invalid'.If 3 of 3 are overflow, results are validated. |
W-K 666 ![]() Send message Joined: 18 May 99 Posts: 19724 Credit: 40,757,560 RAC: 67 ![]() ![]() |
I think we should monitor for a while. If anyone notices this case in the future, please post a link and we can examine. I think the three would still have to be 'weakly similar', so if the early overflow signals were of a completely different type, that could (should?) be flagged as 'invalid'.If 3 of 3 are overflow, results are validated. IIRC in the case quoted the results were, 7 pulses & 23 triplets Vs 30 triplets |
Richard Haselgrove ![]() Send message Joined: 4 Jul 99 Posts: 14690 Credit: 200,643,578 RAC: 874 ![]() ![]() |
IIRC in the case quoted the results were, 7 pulses & 23 triplets Vs 30 tripletsThe change wasn't notified to me (and it was an automatic, real-time notification) until 8 Jan at 22:57 UTC. I think that's after the example in your linked post. I'd like to confirm it with an after-change case, if you don't mind: I'm pestering Eric quite a lot at the moment about the Anonymous Platform bug (and another related problem which came to light this morning). I'll certainly pass on an error report if it comes to light with confirmation, but let's do the research ourselves, to save Eric the distraction. |
Stephen "Heretic" ![]() ![]() ![]() ![]() Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 ![]() ![]() |
If 3 of 3 are overflow, results are validated. . . But if all cards agree the sample is an overflow (noisy) then it does not matter as there is no result going into the database right or wrong. If you are worried about the 1 or 2 credits then what can I say .... . . If the 2 AMD cards are overflows but the third is not then it must be rechecked as it may be a valid result that would be discarded if the AMD cards are accepted. Stephen . . |
![]() ![]() ![]() Send message Joined: 29 Jun 99 Posts: 11451 Credit: 29,581,041 RAC: 66 ![]() ![]() |
RTS = 48,589, this is still a cause for concern |
![]() ![]() ![]() Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 ![]() ![]() |
Uploads are getting sticky and backing off in retries. Takes a couple of manual interventions to move them along. Website is . . .SSSLOOOOWWW . . . . Seti@Home classic workunits:20,676 CPU time:74,226 hours ![]() ![]() A proud member of the OFA (Old Farts Association) |
Boiler Paul Send message Joined: 4 May 00 Posts: 232 Credit: 4,965,771 RAC: 64 ![]() ![]() |
FUBAR |
![]() ![]() ![]() Send message Joined: 29 Jun 99 Posts: 11451 Credit: 29,581,041 RAC: 66 ![]() ![]() |
To add to the general merriment reporting seems to be broken, at least for me. |
©2025 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.