Panic Mode On (110) Server Problems?

Message boards : Number crunching : Panic Mode On (110) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 24 · 25 · 26 · 27 · 28 · 29 · 30 . . . 37 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922312 - Posted: 3 Mar 2018, 4:23:49 UTC - in response to Message 1922306.  

The SSP seems to have recovered its update and now the standard 10 minute delay from UTC. The results pages OTOH are painfully slow. Has been for over a week now. I think it has something to do with the evergrowing results and workunits purging queues getting VERY large. Going over 7 million now. Normal is around the 3 million mark. Grant thinks this is the main problem with the anemic splitter work generation too. Too much I/O contention.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922312 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1922324 - Posted: 3 Mar 2018, 4:41:03 UTC - in response to Message 1922312.  

Hmmmm, the Results pages have started loading again, but, most of the values on the SSP are still showing to be over an hour old. Are there really 225k tasks RTS?
ID: 1922324 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13396
Credit: 208,696,464
RAC: 304
Australia
Message 1922335 - Posted: 3 Mar 2018, 5:02:12 UTC - in response to Message 1922324.  

Hmmmm, the Results pages have started loading again, but, most of the values on the SSP are still showing to be over an hour old. Are there really 225k tasks RTS?

Is the creation rate really 264/s?
RTS now showing 334k on the Haveland graphs.
Grant
Darwin NT
ID: 1922335 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1922337 - Posted: 3 Mar 2018, 5:08:37 UTC - in response to Message 1922335.  
Last modified: 3 Mar 2018, 5:14:04 UTC

Now it's up to 427k RTS. Seems it was stuck for over an hour, and I was getting a few of the dreaded 'Project has no tasks available' messages. Seems to be working now.

Moonshot
ID: 1922337 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922340 - Posted: 3 Mar 2018, 5:18:31 UTC

Something must have unplugged and the creation rate skyrocketed briefly. Just a big spike on the Haveland graph. Now back to its normal range.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922340 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13396
Credit: 208,696,464
RAC: 304
Australia
Message 1922343 - Posted: 3 Mar 2018, 5:41:14 UTC

Anyone else getting any work?
I've picked up 2 WUs in the last 30min, the rest are "Project has no tasks available" messages.
Grant
Darwin NT
ID: 1922343 · Report as offensive
Profile Stargate (SA)
Volunteer tester
Avatar

Send message
Joined: 4 Mar 10
Posts: 1852
Credit: 2,258,721
RAC: 0
Australia
Message 1922344 - Posted: 3 Mar 2018, 5:43:55 UTC

Shock horror I just picked up an AP
ID: 1922344 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13396
Credit: 208,696,464
RAC: 304
Australia
Message 1922346 - Posted: 3 Mar 2018, 6:06:52 UTC - in response to Message 1922344.  

Shock horror I just picked up an AP

And naturally after making my previous post the work started flowing again.
Grant
Darwin NT
ID: 1922346 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13396
Credit: 208,696,464
RAC: 304
Australia
Message 1922353 - Posted: 3 Mar 2018, 6:33:41 UTC - in response to Message 1922346.  

Shock horror I just picked up an AP

And naturally after making my previous post the work started flowing again.

Well, at least for one system.
Grant
Darwin NT
ID: 1922353 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922363 - Posted: 3 Mar 2018, 7:24:12 UTC - in response to Message 1922343.  

Anyone else getting any work?
I've picked up 2 WUs in the last 30min, the rest are "Project has no tasks available" messages.

I'm getting regular work from SETI. It's MilkyWay that I am getting no work is available because the project may be down messages.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922363 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1922491 - Posted: 3 Mar 2018, 18:45:42 UTC - in response to Message 1922231.  

. . We learn best from our mistakes .....
Stephen
<shrug>
BTW, How's that Ryzen working out?


. . It is working very nicely as a paperweight, thanks vey much for asking :)

. . I have to pack the sucker up and take it to a service centre .......... I should get around to that sometime before Christmas I hope :)

Stephen

:(
ID: 1922491 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1922492 - Posted: 3 Mar 2018, 18:46:57 UTC - in response to Message 1922254.  

No, I was referring to when he first started and was trying to disassemble a GPU with standard tools from his trucks toolbox. Stripping screwheads and breaking off posts. I think I posted a link a long time about with the label "How NOT to disassemble a GPU". There are some other videos where it's just painful to watch him mod GPUs. I think he put on an AOI cooler with the piping coming out of the front rather than from the top. He's gotten a lot better since then.
. . We learn best from our mistakes .....

Stephen

<shrug>
BTW, How's that Ryzen working out?


Ha ha. LOL I think Stephen steals the World's Best Procrastinator trophy from me on that account.


. . Hey, a guy has to go with his strengths .........

Stephen

:)
ID: 1922492 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922618 - Posted: 4 Mar 2018, 1:27:42 UTC

Uh-oh. Getting the dreaded "no task are available" messages. That is with 612K tasks in the RTS buffer. Looks like the scheduling server issue with plenty of task available has reared its head again. Time for the Triple Update.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922618 · Report as offensive
Chris Adamek
Volunteer tester

Send message
Joined: 15 May 99
Posts: 251
Credit: 434,772,072
RAC: 236
United States
Message 1922622 - Posted: 4 Mar 2018, 1:39:55 UTC - in response to Message 1922618.  

Same here.=( The little glitches are really adding up lately.=(
ID: 1922622 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13396
Credit: 208,696,464
RAC: 304
Australia
Message 1922624 - Posted: 4 Mar 2018, 1:40:41 UTC - in response to Message 1922618.  

Uh-oh. Getting the dreaded "no task are available" messages. That is with 612K tasks in the RTS buffer. Looks like the scheduling server issue with plenty of task available has reared its head again. Time for the Triple Update.

It's been flakey for at least a couple of hours now.
A couple of times the triple update has done the job, and other times it's made no difference. The Scheduler is just being more random than usual with it's allocations.
Grant
Darwin NT
ID: 1922624 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1922628 - Posted: 4 Mar 2018, 1:48:21 UTC

Nothing here too. And the WU cache on the host is dangerously low.
This will be going to be a long night.
ID: 1922628 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922633 - Posted: 4 Mar 2018, 2:10:21 UTC - in response to Message 1922624.  

I wonder if this is a repeat of the issue a month or so ago when the splitters went hog wild and wouldn't ramp down when the RTS buffer was full and it hurt the database and scheduler.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922633 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1922634 - Posted: 4 Mar 2018, 2:13:01 UTC - in response to Message 1922618.  

Uh-oh. Getting the dreaded "no task are available" messages. That is with 612K tasks in the RTS buffer. Looks like the scheduling server issue with plenty of task available has reared its head again. Time for the Triple Update.


. . Yep, getting that here too.

Stephen

:(
ID: 1922634 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1922635 - Posted: 4 Mar 2018, 2:13:58 UTC

New work is flowing again.
ID: 1922635 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13159
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1922639 - Posted: 4 Mar 2018, 2:36:38 UTC - in response to Message 1922635.  

Agree, the scheduler constipation has been resolved. All the crunchers were able to refill caches on the last request.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1922639 · Report as offensive
Previous · 1 . . . 24 · 25 · 26 · 27 · 28 · 29 · 30 . . . 37 · Next

Message boards : Number crunching : Panic Mode On (110) Server Problems?


 
©2022 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.