The last day of S@H

Message boards : Number crunching : The last day of S@H
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 . . . 20 · Next

AuthorMessage
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2046872 - Posted: 25 Apr 2020, 2:57:28 UTC - in response to Message 2046863.  

. . FWIW I have only between 20 and 85 yet to be validated tasks on my rigs, totalling not much more than 200 over the 5 machines. If this is indicative of the other hosts remaining in service then we must be very close to the point where they can pull the pin on all uncompleted tasks in the field and force them to resends. At that point things will be sorted in minutes or hours at most. IF that is what the boffins decide to do.

Stephen

? ?



I don't have any tasks running, I finished all that I had a few hours ago. I have 4 that need another wingman though.
ID: 2046872 · Report as offensive     Reply Quote
Profile TimeLord04
Volunteer tester
Avatar

Send message
Joined: 9 Mar 06
Posts: 21140
Credit: 33,933,039
RAC: 23
United States
Message 2046883 - Posted: 25 Apr 2020, 4:47:54 UTC - in response to Message 2046486.  
Last modified: 25 Apr 2020, 4:48:36 UTC

My last 4 cpu WU are ending in few minutes. After that all gone.
The end of an era. Is a very sad day for me.
R.I.P S@H.


4-24-2020 at 9:45 PM - PDT

[@Juan]

Just got a Report on your Host ID: 8662921 for WU ID: 3925101178.
This Host 'Abandoned' the Unit on March 12th. "Ghosted"??? I know that you NEVER abandon Units, you Crunch them 'til Completed and Returned.

The next guy after you had a Compute Error, and NOW it's been Resent out 3 more times! I hope someone completes this Unit besides my Hackintosh-Andromeda.
(Still waiting for A Wingman to complete this thing to get Validation....) Unit Originally Sent March 11th.


TL
TimeLord04
Have TARDIS, will travel...
Come along K-9!
Join Calm Chaos
ID: 2046883 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2046887 - Posted: 25 Apr 2020, 6:14:18 UTC - in response to Message 2046872.  

. . FWIW I have only between 20 and 85 yet to be validated tasks on my rigs, totalling not much more than 200 over the 5 machines. If this is indicative of the other hosts remaining in service then we must be very close to the point where they can pull the pin on all uncompleted tasks in the field and force them to resends. At that point things will be sorted in minutes or hours at most. IF that is what the boffins decide to do.
Stephen


I don't have any tasks running, I finished all that I had a few hours ago. I have 4 that need another wingman though.


. . Those are NOT running tasks, I have NONE of them and haven't had for ages, except one machine which was getting them for a little while. I am referring to completed tasks waiting for validation in one form or another, ie pending, inconclusive, invalid or error. All waiting for a delinquent wingman who will probably never return them and they will time out. Now is the time to 'expire' them all .... nyah ah aaaahhhh! Sorry I got carried away :)

Stephen

. .
ID: 2046887 · Report as offensive     Reply Quote
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34859
Credit: 261,360,520
RAC: 489
Australia
Message 2046893 - Posted: 25 Apr 2020, 8:15:37 UTC

The last of my CPU tasks have been completed on both rigs.

My 2500K has just 14 pendings and 86 inconclusives left to go while the 3570K has 22 pendings and 78 inconclusives.

Cheers.
ID: 2046893 · Report as offensive     Reply Quote
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 716
Credit: 8,032,827
RAC: 62
France
Message 2046899 - Posted: 25 Apr 2020, 11:14:35 UTC


24-Apr-2020 13:53:05 [SETI@home] Scheduler request completed: got 1 new tasks


a _4 one ^^
ID: 2046899 · Report as offensive     Reply Quote
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2046922 - Posted: 25 Apr 2020, 14:13:24 UTC - in response to Message 2046883.  
Last modified: 25 Apr 2020, 14:59:49 UTC

My last 4 cpu WU are ending in few minutes. After that all gone.
The end of an era. Is a very sad day for me.
R.I.P S@H.


4-24-2020 at 9:45 PM - PDT

[@Juan]

Just got a Report on your Host ID: 8662921 for WU ID: 3925101178.
This Host 'Abandoned' the Unit on March 12th. "Ghosted"??? I know that you NEVER abandon Units, you Crunch them 'til Completed and Returned.

The next guy after you had a Compute Error, and NOW it's been Resent out 3 more times! I hope someone completes this Unit besides my Hackintosh-Andromeda.
(Still waiting for A Wingman to complete this thing to get Validation....) Unit Originally Sent March 11th.


TL

Hi TL
Sorry for that but I still trying to understand what happening in this day. If you go to my host error list you will see in this day a lot of WU where abandoned without any clear reason. All was DL normally, some just a day before, are far from the datelines and i not abort them (if i was aborted they will show as aborted not abandoned). I can't even tell they are ghosts, because they was not, that i`m sure. They was DL normally, stay on the cache for some time and then abandoned maybe by a server side command. Who knows? As you know my host keep crunching normally all the time.
When that happening i even think, ok the servers abort them for one of its mysterious checkings, but never rely discover why. And you could see a similar event happening on Mar 7.
My only clue is since i run with a high cache that could be hit a hidden server limit. Like the one i hit last week when the server said something about it reaches the limit of >60K WU (not remember the exact number) returned in a day!
ID: 2046922 · Report as offensive     Reply Quote
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 716
Credit: 8,032,827
RAC: 62
France
Message 2047064 - Posted: 26 Apr 2020, 10:11:52 UTC

got a few ..


25-Apr-2020 15:50:43 [SETI@home] Scheduler request completed: got 1 new tasks
25-Apr-2020 17:11:21 [SETI@home] Scheduler request completed: got 5 new tasks
26-Apr-2020 04:16:03 [SETI@home] Scheduler request completed: got 2 new tasks

ID: 2047064 · Report as offensive     Reply Quote
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2047085 - Posted: 26 Apr 2020, 14:43:24 UTC

Nothing to be crunched and Validation pending (84) · Validation inconclusive (391) · Valid (7203) only.

So i ask if anyone has a clue of how to see what is the real number of WU who rely needs to be crunched before the end?

This number should be very low at this time maybe in the range of 100 K WU only.
ID: 2047085 · Report as offensive     Reply Quote
Profile Keith T.
Volunteer tester
Avatar

Send message
Joined: 23 Aug 99
Posts: 962
Credit: 537,293
RAC: 9
United Kingdom
Message 2047091 - Posted: 26 Apr 2020, 15:53:15 UTC - in response to Message 2047085.  
Last modified: 26 Apr 2020, 16:09:46 UTC

Nothing to be crunched and Validation pending (84) · Validation inconclusive (391) · Valid (7203) only.

So i ask if anyone has a clue of how to see what is the real number of WU who rely needs to be crunched before the end?

This number should be very low at this time maybe in the range of 100 K WU only.


I have tried to estimate from the average replication of the Tasks In Progress, WU's In Progress.

It's probably something between 0.5 and 0.333 of the "Results out in the field"

I don't know of a better way to estimate, maybe take a sample of 100 WU's with a large spread of dates, to get a better idea of the average replication.

Most Pendings probably have 3 outstanding Tasks, and most Inconclusives probably 2, so that weighting factor might give a better estimate.
ID: 2047091 · Report as offensive     Reply Quote
Profile Keith T.
Volunteer tester
Avatar

Send message
Joined: 23 Aug 99
Posts: 962
Credit: 537,293
RAC: 9
United Kingdom
Message 2047123 - Posted: 26 Apr 2020, 17:35:37 UTC - in response to Message 2047091.  
Last modified: 26 Apr 2020, 17:52:35 UTC

I just realized a major error in my estimation

I forgot to add all the Valid Workunits that are still waiting for 1 or 2 results to be returned before they are purged.

Those are much higher for most hosts than the number of Pending and Inconclusive WU'S

I think Juan's estimate is probably much closer than my earlier guess.

We need a sample of maybe 50 hosts, and look at how many:
In Progress
Pendings
Inconclusives
Valids awaiting 3rd or 4th place tasks to expire or be returned.
Any others, Invalid or Error, probably less than 1%

This would give a better estimate of how many Tasks or Results are actually still needed to complete the last WU's
ID: 2047123 · Report as offensive     Reply Quote
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2047124 - Posted: 26 Apr 2020, 17:52:38 UTC - in response to Message 2047123.  
Last modified: 26 Apr 2020, 18:40:04 UTC

the Valid Workunits that are still waiting for 1 or 2 results to be returned


This returns has no more meaning for the Science DB anymore, since they already has the canonical result.

So from the point of close the Science DB they are not needed anymore, crunching them from that POV is just a waste of crunching & electric power.
ID: 2047124 · Report as offensive     Reply Quote
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14653
Credit: 200,643,578
RAC: 874
United Kingdom
Message 2047137 - Posted: 26 Apr 2020, 18:29:06 UTC
Last modified: 26 Apr 2020, 19:13:51 UTC

My score, if it helps:

In progress (0) · Validation pending (61) · Validation inconclusive (197)
In progress (0) · Validation pending (60) · Validation inconclusive (198)

So I can't help you lot - I'm in your hands!

Edit - somebody's checked in.
ID: 2047137 · Report as offensive     Reply Quote
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34859
Credit: 261,360,520
RAC: 489
Australia
Message 2047140 - Posted: 26 Apr 2020, 18:40:40 UTC

Very similar here.

In progress (0) · Validation pending (19) · Validation inconclusive (116)

Cheers.
ID: 2047140 · Report as offensive     Reply Quote
Profile Keith T.
Volunteer tester
Avatar

Send message
Joined: 23 Aug 99
Posts: 962
Credit: 537,293
RAC: 9
United Kingdom
Message 2047143 - Posted: 26 Apr 2020, 19:25:11 UTC - in response to Message 2047123.  

Here's the Top 10 hosts by RAC
I've just used the first 5 columns.

All 8311	IP 0		VP 77	VI 382	V 7144	
ALL 5112	IP 0		VP 54	VI 195	V 4850
ALL 4230	IP 0		VP 33	VI 187	V 4004
ALL 13508	IP 8127		VP 18	VI 178	V 5159
ALL 7042	IP 0		VP 91	VI 313	V 6627
ALL 8787	IP 0		VP 94	VI 344	V 8091
ALL 40850	IP 37889	VP 20	VI 81	V 2688
ALL 2217	IP 400		VP 6	VI 99	V 1707
ALL 3575	IP 0		VP 46	VI 121	V 3399
ALL 3169	IP 0		VP 58	VI 145	V 2952
ID: 2047143 · Report as offensive     Reply Quote
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2047153 - Posted: 26 Apr 2020, 20:55:09 UTC

current creation rate is .05/sec ... 1 WU every 20 seconds...3 WU per minute.
These would be resends from non-validated WUs . This only happens if there hasn't been a valid match and the normal timeout is happening.
180 resends/hour ... around 4000 resends / day.

Even with the increased timeout between requests there are around 400 requests/second. The odds are NOT in my favor, but still I hang out because change is hard :-).

Big assumptions, but let's go with it for a guess on how many still floating around.

31 days in May + 4 more in April.
35 days * 4000 resends = 140k left out there... let's round it up since some have timeouts in June... 150k unfinished.
ID: 2047153 · Report as offensive     Reply Quote
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 2047168 - Posted: 26 Apr 2020, 21:59:06 UTC

https://munin.kiska.pw/munin/Munin-Node/Munin-Node/results_setiathome_AP_creation.html
Looks like they forced another round of resends. I can see my inconclusives just got a resend.

Sigh. I didn't get any of them.
ID: 2047168 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2047177 - Posted: 26 Apr 2020, 23:22:50 UTC - in response to Message 2047168.  
Last modified: 26 Apr 2020, 23:23:31 UTC

https://munin.kiska.pw/munin/Munin-Node/Munin-Node/results_setiathome_AP_creation.html
Looks like they forced another round of resends. I can see my inconclusives just got a resend.
Sigh. I didn't get any of them.


. . Neither did I but no surprise there. Anyone want to place a bet on whether Wiggo did :)

Stephen

:(
ID: 2047177 · Report as offensive     Reply Quote
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 2047178 - Posted: 26 Apr 2020, 23:28:37 UTC
Last modified: 26 Apr 2020, 23:45:57 UTC

Sun 26 Apr 2020 06:11:39 PM EST | SETI@home | Scheduler request completed: got 1 new tasks

I hit the jackpot and get 1!!! LOL

It's runs for 6 seconds and done. :(

<edit> Definitely i'm lucky today, all CPU:
Sun 26 Apr 2020 06:44:08 PM EST | SETI@home | Scheduler request completed: got 150 new tasks

ID: 2047178 · Report as offensive     Reply Quote
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 2047185 - Posted: 27 Apr 2020, 0:29:28 UTC - in response to Message 2047137.  
Last modified: 27 Apr 2020, 0:58:22 UTC

My score, if it helps:
In progress (0) · Validation pending (61) · Validation inconclusive (197)
In progress (0) · Validation pending (60) · Validation inconclusive (198)
So I can't help you lot - I'm in your hands!
Edit - somebody's checked in.


                               Pend        Inc           Valid           Other

#1                            2              9            225               5

#2                            5(3.6)         9(2.6)       196(1.3)          1(1)

#3                            8             31            633               7

#4                            9             26            1324              6

#5                            6             18            1049              2

Total                        30             93            3427             21


. . The number in brackets is the average of outstanding wingmen per task. (just the one machine and the first page of the Valids)

Stephen

{EDIT}
BULLETIN

. . I just got two (countem 2) resends on this machine (one of the slowest). I must have just snagged the tail end of the resend batch. Nothing on the other 4 of course.

. .
ID: 2047185 · Report as offensive     Reply Quote
Scrooge McDuck
Avatar

Send message
Joined: 26 Nov 99
Posts: 703
Credit: 1,674,173
RAC: 54
Germany
Message 2047187 - Posted: 27 Apr 2020, 0:32:29 UTC

26.04.2020 20:42:13 | SETI@home | Scheduler request completed: got 159 new tasks

Half of those are just noise (>=30 signals), needing super-quorum.
ID: 2047187 · Report as offensive     Reply Quote
Previous · 1 . . . 9 · 10 · 11 · 12 · 13 · 14 · 15 . . . 20 · Next

Message boards : Number crunching : The last day of S@H


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.