Panic Mode On (88) Server Problems?

Message boards : Number crunching : Panic Mode On (88) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 21 · Next

AuthorMessage
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1533701 - Posted: 29 Jun 2014, 17:39:24 UTC - in response to Message 1533586.  

Since about midnight Berkeley time the MB splitters have choked. We need around 25/s to maintain the ready-to-send buffer. They're only producing around 16/s.
Another 16 or so hours & we'll be out of MB work.

The haveland stats show we bottomed out around 160k RTS and are slowly creeping back up.
Looking at the creation rate by month chart. It seems like creation rate and turn around time are related. In that when turn around time increases creation rate falls. That might just be an odd coincidence I suppose.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1533701 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 1533902 - Posted: 30 Jun 2014, 6:59:19 UTC - in response to Message 1533701.  
Last modified: 30 Jun 2014, 6:59:37 UTC

The haveland stats show we bottomed out around 160k RTS and are slowly creeping back up.

Now they're making their way back down again, presently 133,000 & (very slowly) falling.
I think what's stopped us from running out of MB work is the availability of AP at the moment.
Grant
Darwin NT
ID: 1533902 · Report as offensive
Filipe

Send message
Joined: 12 Aug 00
Posts: 218
Credit: 21,281,677
RAC: 20
Portugal
Message 1534147 - Posted: 30 Jun 2014, 19:08:20 UTC
Last modified: 30 Jun 2014, 19:08:31 UTC

Now they're making their way back down again, presently 133,000 & (very slowly) falling.
I think what's stopped us from running out of MB work is the availability of AP at the moment.



MB ready to send is slowly shrinking. Probably some lack of disk space.
ID: 1534147 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1534191 - Posted: 30 Jun 2014, 22:40:22 UTC - in response to Message 1534147.  

Now they're making their way back down again, presently 133,000 & (very slowly) falling.
I think what's stopped us from running out of MB work is the availability of AP at the moment.

MB ready to send is slowly shrinking. Probably some lack of disk space.

I think we have a stuck tape. Put 22mr08aa on tapewatch, and let's see what happens to it after maintenance tomorrow.
ID: 1534191 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1534197 - Posted: 30 Jun 2014, 22:49:58 UTC - in response to Message 1534191.  

Now they're making their way back down again, presently 133,000 & (very slowly) falling.
I think what's stopped us from running out of MB work is the availability of AP at the moment.

MB ready to send is slowly shrinking. Probably some lack of disk space.

I think we have a stuck tape. Put 22mr08aa on tapewatch, and let's see what happens to it after maintenance tomorrow.

You might be onto something Richard. I cannot see any major backlog of work waiting to be validated or administered so that would explain why the ready to send the buffer is so low.
ID: 1534197 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 1534330 - Posted: 1 Jul 2014, 5:50:32 UTC - in response to Message 1534197.  

MB ready-to-send has stopped shrinking, but it hasn't grown either.
Splitters still not pumping the work out.

For reference-
22mr08aa shows 2 channels in progress at present.
02dc08ae shows one in progress.
Neither show any errors, or completed channels.
Grant
Darwin NT
ID: 1534330 · Report as offensive
Profile Oz
Avatar

Send message
Joined: 6 Jun 99
Posts: 233
Credit: 200,655,462
RAC: 212
United States
Message 1534437 - Posted: 1 Jul 2014, 12:37:43 UTC

Ready to send (MB) has dropped below results received in the last hour. Hopefully, this will be addressed in today's maintenance.
Member of the 20 Year Club



ID: 1534437 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1534455 - Posted: 1 Jul 2014, 13:36:21 UTC

There are only 52 more channels of AP to split as well. Backup projects may get to do some work if maintenance doesn't unstick things.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1534455 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1534474 - Posted: 1 Jul 2014, 15:17:17 UTC - in response to Message 1534455.  
Last modified: 1 Jul 2014, 15:18:17 UTC

There are only 52 more channels of AP to split as well. Backup projects may get to do some work if maintenance doesn't unstick things.

Well, hopefully that does the trick.
Eric just had to increase the DB size when AP was not assimilating recently.
About a week ago.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1534474 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1534536 - Posted: 1 Jul 2014, 21:03:34 UTC
Last modified: 1 Jul 2014, 21:04:25 UTC

Tape 22mr08aa was removed during maintenance & creation rate for MB is climbing. Hopefully that troublesome tape didn't bring any friends.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1534536 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1534582 - Posted: 1 Jul 2014, 23:02:48 UTC

So.. some news, of sorts.

I decided to put my spreadsheet project to bed. It's been a long run, and I was planning on stopping it when I got to 5,000 APs, but I guess I forgot to add the recently-finished results of the past 48 hours and I decided that instead of having this section of ~16 consecutive tasks that have no data, I just cut it there and called it done.

So, the results.

All with r557 on an FX-6100, only running on half the cores with the exception of the first dozen or so tasks, hence the maximum CPU time below, with the first task being issued on 2012-03-28.

Tasks: 4830
Average CPU time: 39,652.273s
Median CPU time: 42,876.240s
Average credit/task: 657.74778
Median credit/task: 697.46000
Average blanking: 13.6340%
Median blanking: 2.39000%
Maximum CPU time: 54,824.460
Maximum credit: 1,459.81

Total CPU time: 187,198,383.1s (2,166d 15h 33m 3.1s)
Total credit: 3,105,227.29

<10% blanked: 3,654
100% blanked: 199
30/30 exits: 372


I will continue to look at my task pages, but I won't be logging anything anymore.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1534582 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1534614 - Posted: 2 Jul 2014, 0:11:35 UTC

Now if we can get files 29my13ac and 29no13aa finally finished after 3 weeks of being in their current state would be nice.

Cheers.
ID: 1534614 · Report as offensive
Dave Stegner
Volunteer tester
Avatar

Send message
Joined: 20 Oct 04
Posts: 540
Credit: 65,583,328
RAC: 27
United States
Message 1534745 - Posted: 2 Jul 2014, 7:09:20 UTC

get em while they last. Only 7000 AP's left and 550 channels of MB to do.

Might be a dry spell coming for some.
Dave

ID: 1534745 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1534878 - Posted: 2 Jul 2014, 13:50:10 UTC - in response to Message 1534745.  

get em while they last. Only 7000 AP's left and 550 channels of MB to do.

Might be a dry spell coming for some.

If anything happens with the servers I would not expect anyone to be around to remote in and fix things this weekend. With the holiday on Friday.
Time to sit back and blow things up and not worry about how your computers are doing for those of us in the US I suppose.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1534878 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1534903 - Posted: 2 Jul 2014, 15:17:48 UTC - in response to Message 1534878.  

get em while they last. Only 7000 AP's left and 550 channels of MB to do.

Might be a dry spell coming for some.

If anything happens with the servers I would not expect anyone to be around to remote in and fix things this weekend. With the holiday on Friday.
Time to sit back and blow things up and not worry about how your computers are doing for those of us in the US I suppose.

The kitties shall send their best kitty juju to the servers for the long weekend.
Lots of MB to nibble on after their AP feast.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1534903 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 1535875 - Posted: 4 Jul 2014, 7:25:23 UTC - in response to Message 1534903.  

Looking at the graphs, it appears the AP Assimilators are having issues again.
Grant
Darwin NT
ID: 1535875 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1536199 - Posted: 4 Jul 2014, 22:41:44 UTC - in response to Message 1535875.  

Looking at the graphs, it appears the AP Assimilators are having issues again.

As I post this there are only 2 tasks waiting to be administered so the issue must have been fixed.
ID: 1536199 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 1536213 - Posted: 4 Jul 2014, 22:57:37 UTC - in response to Message 1536199.  

Looking at the graphs, it appears the AP Assimilators are having issues again.

As I post this there are only 2 tasks waiting to be administered so the issue must have been fixed.

Yep.
It took a couple of goes, but it got there in the end.
Grant
Darwin NT
ID: 1536213 · Report as offensive
Profile Oz
Avatar

Send message
Joined: 6 Jun 99
Posts: 233
Credit: 200,655,462
RAC: 212
United States
Message 1538166 - Posted: 9 Jul 2014, 0:17:30 UTC

AP units are being splat, next stop, higher RAC junction...
Member of the 20 Year Club



ID: 1538166 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30639
Credit: 53,134,872
RAC: 32
United States
Message 1538169 - Posted: 9 Jul 2014, 0:31:38 UTC - in response to Message 1538166.  

AP units are being splat, next stop, higher RAC junction...

except it looks like the stats page is locked up
ID: 1538169 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 21 · Next

Message boards : Number crunching : Panic Mode On (88) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.