Message boards :
Number crunching :
The Server Issues / Outages Thread - Panic Mode On! (119)
Message board moderation
Previous · 1 . . . 89 · 90 · 91 · 92 · 93 · 94 · 95 . . . 107 · Next
Author | Message |
---|---|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0 ![]() |
Are these the graphs you seek? https://munin.kiska.pw/munin/Munin-Node/Munin-Node/workunits_setiathomev8.html my $validationv8 = $states->{sah_v8_results_awaiting_validation}; my $assimilationv8 = $states->{sah_v8_workunits_waiting_for_assimilation}; my $deletionv8 = $states->{sah_v8_workunits_waiting_for_deletion}; my $waitingv8 = $states->{sah_v8_results_waiting_for_deletion}; my $validationap = $states->{ap_results_awaiting_validation}; my $assimilationap = $states->{ap_workunits_waiting_for_assimilation}; my $deletionap = $states->{ap_workunits_waiting_for_deletion}; my $waitingap = $states->{ap_results_waiting_for_deletion}; |
![]() Send message Joined: 28 Nov 02 Posts: 5126 Credit: 276,046,078 RAC: 462 ![]() |
I have a small number of "completed, inconclusive" when I go look at my Wingperson they usually are coming up with the same result (inconclusive). Given that it was on a Windows/SOG task.... Tom M A proud member of the OFA (Old Farts Association). |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13882 Credit: 208,696,464 RAC: 304 ![]() ![]() |
Flood gates are open again. Just picked up 259 resends, mostly _3 with a lot of _4 mixed in there. Grant Darwin NT |
![]() ![]() Send message Joined: 23 Aug 99 Posts: 962 Credit: 537,293 RAC: 9 ![]() |
No, the labels on some of the graphs are a bit misleading. "Results waiting for db purging" has just passed 1.25 million. If you subtract that value from "Results returned and awaiting validation" the result appears to be the number of Workunits or Tasks that have not reached Quorum. I may have got this wrong, but it seems to be in the right ball park. |
Ian&Steve C. ![]() Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 ![]() ![]() |
I may have got this wrong, but it seems to be in the right ball park. You’ve got it wrong. The results waiting for purging are already out of the waiting for validation queue and have already been assimilated. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours ![]() ![]() |
![]() ![]() Send message Joined: 23 Aug 99 Posts: 962 Credit: 537,293 RAC: 9 ![]() |
I may have got this wrong, but it seems to be in the right ball park. OK, thanks. I know that Workunits, Tasks and Results are not interchangeable, but there should be a way of estimating the Units that have now reached Quorum, even though they still have outstanding Tasks, and the Units that are still awaiting validation. |
Ville Saari ![]() Send message Joined: 30 Nov 00 Posts: 1158 Credit: 49,177,052 RAC: 82,530 ![]() ![]() |
I guess this anomalously high 'Results waiting for db purging' includes validated results that are part of the workunits that are still waiting for some unreturned results. The workunit is still waiting for validation but because some results in it have been validated already, those results are not shown in 'Results returned and awaiting validation' and the only place for them to go is 'Results waiting for db purging'. But they won't be purged before the associated workunit moves to 'Workunits waiting for db purging'. |
![]() ![]() ![]() Send message Joined: 5 Mar 12 Posts: 815 Credit: 2,361,516 RAC: 22 ![]() ![]() |
I looked at the graph site, and I really like this page https://munin.kiska.pw/munin/Munin-Node/Munin-Node/results_setiathome_AP_creation.html as I can see the spikes of forced resends. Most of what I'm currently working on is from the April 19 WU creation spike. I should be done with my WUs tomorrow night unless I snag some resends. any guesses on when the next forced resend happens?? |
![]() Send message Joined: 28 Nov 02 Posts: 5126 Credit: 276,046,078 RAC: 462 ![]() |
It could be daily. I got some yesterday and some more today. Tom M A proud member of the OFA (Old Farts Association). |
Ian&Steve C. ![]() Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 ![]() ![]() |
I guess this anomalously high 'Results waiting for db purging' includes validated results that are part of the workunits that are still waiting for some unreturned results. The workunit is still waiting for validation but because some results in it have been validated already, those results are not shown in 'Results returned and awaiting validation' and the only place for them to go is 'Results waiting for db purging'. But they won't be purged before the associated workunit moves to 'Workunits waiting for db purging'. Since the process is Validation->Assimilation->Deletion->Purging I don’t think the purging category is going to hold anything still waiting for validation. It’s just the stats that are still on the website in that category. Workunit/Files waiting for deletion: The number of files which can be deleted from disk, as the workunit has been assimilated, and there is no more use for it or its constituent results. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours ![]() ![]() |
Ville Saari ![]() Send message Joined: 30 Nov 00 Posts: 1158 Credit: 49,177,052 RAC: 82,530 ![]() ![]() |
It wouldn't be the only place where the SSP labels are misleading.I guess this anomalously high 'Results waiting for db purging' includes validated results that are part of the workunits that are still waiting for some unreturned results.Since the process is Validation->Assimilation->Deletion->Purging I don’t think the purging category is going to hold anything still waiting for validation. It’s just the stats that are still on the website in that category. Back when stuff was running normally, the ratio of results and workunits waiting for purging matched the 2.2 average replication most of the time. But recently when they have sent lot of pre-resends so we have lot of workunits that have their quorum filled but are still waiting for some unreturned results, the results waiting for purging has grown a lot without matching growth in workunits waiting for purging. And it is absolutely impossible for those numbers to represent only those results that are really ready to be purged because the current ratio between results and WUs waiting for purging is about 360! Average replication is higher than normal due to those pre-resends, but it can't be that high because there's a 10 result cap after which the entire WU fails. The process is not simply a linear validation->assimilation->deletion->purging. A workunit can go through validation multiple times. First when the result that filled the quorum was received and then again to resolve inconclusives or to give credit to later returned pre-resends. The already validated results of a workunit that is still waiting to be validated again have to be somewhere and observations are consistent with them ending up in 'Results waiting for db purging'. Even a task that has missed its deadline can be returned in pretty late stage after it has already been expired on the web site, the WU processed by an extra wingman, validated and assimilated and being presumedly waiting for purging for real and it will still return the WU to validators and replaces the error result with a valid. Only when the WU has been purged from the database it is too late to return the expired task. |
![]() ![]() ![]() Send message Joined: 6 Nov 99 Posts: 716 Credit: 8,032,827 RAC: 62 ![]() ![]() |
found a Science United Account with 2.8K hosts and a lot of tasks in progress ... |
Ian&Steve C. ![]() Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 ![]() ![]() |
found a Science United Account with 2.8K hosts and a lot of tasks in progress ... Science United is a collection of thousands of different people that use that platform to crunch BOINC projects instead of manually attaching to projects. no one person is managing all of the computers on that account. https://scienceunited.org/ Seti@Home classic workunits: 29,492 CPU time: 134,419 hours ![]() ![]() |
Ville Saari ![]() Send message Joined: 30 Nov 00 Posts: 1158 Credit: 49,177,052 RAC: 82,530 ![]() ![]() |
It's a dumbed down way to run boinc for the social media generation. One step towards the society depicted in the movie 'Idiocracy'.found a Science United Account with 2.8K hosts and a lot of tasks in progress ...Science United is a collection of thousands of different people that use that platform to crunch BOINC projects instead of manually attaching to projects. no one person is managing all of the computers on that account. |
Ian&Steve C. ![]() Send message Joined: 28 Sep 99 Posts: 4267 Credit: 1,282,604,591 RAC: 6,640 ![]() ![]() |
Pretty much. Seti@Home classic workunits: 29,492 CPU time: 134,419 hours ![]() ![]() |
juan BFP ![]() ![]() ![]() ![]() Send message Joined: 16 Mar 07 Posts: 9786 Credit: 572,710,851 RAC: 3,799 ![]() ![]() |
Pretty much. +1 Sure not for me, i will not give the others control of what my host will crunch or do. On another topic: Who is the one who crash the stats? There are no Free-DC or Boinc Stats anymore? ![]() |
Ville Saari ![]() Send message Joined: 30 Nov 00 Posts: 1158 Credit: 49,177,052 RAC: 82,530 ![]() ![]() |
Who is the one who crash the stats? There are no Free-DC or Boinc Stats anymore?Setiathome hasn't updated the statistic export files in three days: https://setiathome.berkeley.edu/stats/ About the same time the replica database has been down. |
Richard Haselgrove ![]() Send message Joined: 4 Jul 99 Posts: 14686 Credit: 200,643,578 RAC: 874 ![]() ![]() |
On another topic: Who is the one who crash the stats? There are no Free-DC or Boinc Stats anymore?https://setiathome.berkeley.edu/stats/ hasn't been updated since 20 April - that's about when they turned off the replica, isn't it? |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13882 Credit: 208,696,464 RAC: 304 ![]() ![]() |
65 Pendings, 145 Inconclusives.April 22 0:40 UTCApril 22 23:20 Grant Darwin NT |
Stephen "Heretic" ![]() ![]() ![]() ![]() Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 ![]() ![]() |
It's a dumbed down way to run boinc for the social media generation. One step towards the society depicted in the movie 'Idiocracy'.found a Science United Account with 2.8K hosts and a lot of tasks in progress ...Science United is a collection of thousands of different people that use that platform to crunch BOINC projects instead of manually attaching to projects. no one person is managing all of the computers on that account. . . I recommend a Sci-Fi short story called 'The Marching Morons' by C.M.Kornbluth (also nicely subtle in the title 8-}) Stephen :) |
©2025 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.