Panic Mode On (110) Server Problems?

Message boards : Number crunching : Panic Mode On (110) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 37 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1916975 - Posted: 5 Feb 2018, 0:32:18 UTC

Eric posted in News that the old data conversion did not go well and there won't be any work till tomorrow when they can get more work from GBT.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1916975 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1917026 - Posted: 5 Feb 2018, 8:31:48 UTC

A very fresh new splitter underway 03fe18aa
ID: 1917026 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13370
Credit: 208,696,464
RAC: 304
Australia
Message 1917029 - Posted: 5 Feb 2018, 9:09:44 UTC - in response to Message 1917026.  

A very fresh new splitter underway 03fe18aa

And it's splitting VLARs.
Grant
Darwin NT
ID: 1917029 · Report as offensive
Profile Stargate (SA)
Volunteer tester
Avatar

Send message
Joined: 4 Mar 10
Posts: 1852
Credit: 2,258,721
RAC: 0
Australia
Message 1917031 - Posted: 5 Feb 2018, 9:15:12 UTC

WoW..Blink and miss them :(
ID: 1917031 · Report as offensive
Profile Chris904395093209d Project Donor
Volunteer tester

Send message
Joined: 1 Jan 01
Posts: 112
Credit: 29,923,129
RAC: 6
United States
Message 1917057 - Posted: 5 Feb 2018, 12:29:18 UTC

And now Milky Way has a dbase error. Had to kick in a backup project to the backup project this morning
~Chris

ID: 1917057 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1917082 - Posted: 5 Feb 2018, 14:43:02 UTC

All the cache gone. And still have 149 WU "in progress" must be Ghosts. Anyone knows who i retrieve them?
ID: 1917082 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1917109 - Posted: 5 Feb 2018, 16:15:46 UTC - in response to Message 1917082.  

Ghost recovery protocol. 20 tasks at at time.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1917109 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1917172 - Posted: 5 Feb 2018, 19:54:34 UTC

New work is up from both GBT and AO.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1917172 · Report as offensive
Profile Chris904395093209d Project Donor
Volunteer tester

Send message
Joined: 1 Jan 01
Posts: 112
Credit: 29,923,129
RAC: 6
United States
Message 1917174 - Posted: 5 Feb 2018, 19:58:10 UTC - in response to Message 1917172.  

New work is up from both GBT and AO.


I saw that too. I wish I was at home to jump start SETI again. I kicked in Milky way and WCG on at least 1 PC.
~Chris

ID: 1917174 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1917223 - Posted: 5 Feb 2018, 22:32:59 UTC - in response to Message 1917031.  

WoW..Blink and miss them :(


. . Lots of hungry crunchers out there currently in starvation mode ...

Stephen

:(
ID: 1917223 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1917227 - Posted: 5 Feb 2018, 22:42:23 UTC - in response to Message 1917082.  
Last modified: 5 Feb 2018, 22:44:07 UTC

All the cache gone. And still have 149 WU "in progress" must be Ghosts. Anyone knows who i retrieve them?


. . As follows;

. . Set project to No New Tasks

. . Disable network access and wait for a group of completed tasks to accumulate (enough to give you time to run through this procedure, the faster your upload speed the more you will need)

. . Open windows to file transfer, event log and preferences

. . Re-enable the network access and monitor the uploads in the file transfer and event log windows. When the last file has uploaded and the acknowledgement has appeared in event log, but BEFORE the work has been reported disable the network access again. This timing is critical as is the first step of setting NNT. I have the option to disable network access set in advance so I only need to click OK.

. . Shut down Boinc and wait a short period.

. . Restart BOINC, set manager to allow New Tasks. All the completed tasks should show under the tasks tab as ready to report. Re-enable the network and watch. You should get 20 resent tasks (they will show in event log as a list of resends).

. . For large numbers of ghosts this will have to be repeated until all are recovered.

. . If you have no tasks to upload then I don't know how you can trigger the resends.

Stephen

Hope that helps.
ID: 1917227 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1917231 - Posted: 5 Feb 2018, 23:00:32 UTC - in response to Message 1917227.  

We already hashed it out with Juan. Without any tasks to report (0 tasks in progress), the ghost recovery protocol doesn't work.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1917231 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1917234 - Posted: 5 Feb 2018, 23:31:21 UTC - in response to Message 1917231.  

We already hashed it out with Juan. Without any tasks to report (0 tasks in progress), the ghost recovery protocol doesn't work.


. . Sorry I didn't see that convo. Yes that is a problem when your cache is empty. It would be nice if there were a work around for that.

Stephen

?
ID: 1917234 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 27469
Credit: 261,360,520
RAC: 489
Australia
Message 1917235 - Posted: 5 Feb 2018, 23:36:00 UTC - in response to Message 1917231.  

We already hashed it out with Juan. Without any tasks to report (0 tasks in progress), the ghost recovery protocol doesn't work.

A detach and reattach might as well be in order to release them then if this is still the case.

Cheers.
ID: 1917235 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1917241 - Posted: 6 Feb 2018, 0:01:20 UTC - in response to Message 1917235.  

Yes, that would have been the proper thing to do with no tasks on board. But there is always the possibility of generating a new host ID, which I know that Juan is not going to want. He worked hard for his current #2 position in Top Hosts.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1917241 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1917251 - Posted: 6 Feb 2018, 0:40:53 UTC - in response to Message 1917241.  
Last modified: 6 Feb 2018, 0:42:42 UTC

He worked hard for his current #2 position in Top Hosts.

Yes that is something i proud to be.
Not worry the ghosts will clear eventually, i have the wrong idea that was easy to do the clear manually.
ID: 1917251 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1917259 - Posted: 6 Feb 2018, 1:08:32 UTC - in response to Message 1917251.  
Last modified: 6 Feb 2018, 1:28:40 UTC

Actually, it's much easier than some would indicate. Just before a task finishes hit the Update to set the counter to 5 minutes. As soon as the task finishes and uploads, copy client_state.xml & client_state_prev.xml and paste them to a different directory, such as home. Immediately hit update to report the completed task and Quit BOINC as soon as it reports the task. Then move the files you copied to home back to the BOINC folder overwriting the files there. Start BOINC, the completed task will be reported again triggering the 20 task resend. That's all there is to it. It's best if you have the checkpoint set so the GPU tasks will start from the beginning instead of being resumed at a minute or two. CUDA tasks don't like being resumed partly run. I usually remove the GPU tasks from the Active Tasks list so they definitely restart from the beginning, I don't like Invalids. When tasks are finishing every couple of minutes the process moves along quickly. I've done it hundreds of times, mostly to have the server send the tasks back assigned to a different device...after purposely making them a Ghost.

Of course, you Do have to have room in the cache you want the tasks to go to.
ID: 1917259 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13157
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1917260 - Posted: 6 Feb 2018, 1:11:00 UTC

Thanks for the instructions TBar. I will have to bookmark this post as I can see it is useful for special occasions.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1917260 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13370
Credit: 208,696,464
RAC: 304
Australia
Message 1917296 - Posted: 6 Feb 2018, 5:24:05 UTC

Glad to see not only do we have new work, but it's back to the previous longer GBT WU processing times. That'll help reduce the load on the servers, and make the work last that much longer before it all gets split & crunched.
Grant
Darwin NT
ID: 1917296 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5516
Credit: 528,817,460
RAC: 242
United States
Message 1917297 - Posted: 6 Feb 2018, 5:25:56 UTC - in response to Message 1917296.  
Last modified: 6 Feb 2018, 5:35:32 UTC

Voyager??? or V'ger....


Edited for spelling. Thanks Keith
ID: 1917297 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 37 · Next

Message boards : Number crunching : Panic Mode On (110) Server Problems?


 
©2022 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.