Panic Mode On (96) Server Problems?

Message boards : Number crunching : Panic Mode On (96) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 23 · Next

AuthorMessage
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1655737 - Posted: 22 Mar 2015, 13:52:22 UTC

Hope the servers can stay glued together until tomorrow when Matt may be back in the lab again.
Forum lag is usually a warning sign.
And the spiky nature of the Cricket graph is another one....that usually means something is getting tied up and work goes out in spurts rather than in a smooth flow.

Kitties cross their little toes for luck.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1655737 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1655755 - Posted: 22 Mar 2015, 14:54:08 UTC - in response to Message 1655754.  

Well, something is really bad. Everything is like moving in molasses. If this continues, some server(s) will crash hard.

The good news is..........
So far the kitties are scratching up enough to maintain full cruncher caches.
So far......
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1655755 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1655791 - Posted: 22 Mar 2015, 18:09:24 UTC - in response to Message 1655737.  

Hope the servers can stay glued together until tomorrow when Matt may be back in the lab again.
Forum lag is usually a warning sign.
And the spiky nature of the Cricket graph is another one....that usually means something is getting tied up and work goes out in spurts rather than in a smooth flow.

Kitties cross their little toes for luck.

The spikes are data going up to the lab per the 8_34 graph. I won't try to guess what those ~20 GB chunks contain.
                                                                   Joe
ID: 1655791 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1655798 - Posted: 22 Mar 2015, 19:05:14 UTC - in response to Message 1655791.  

Hope the servers can stay glued together until tomorrow when Matt may be back in the lab again.
Forum lag is usually a warning sign.
And the spiky nature of the Cricket graph is another one....that usually means something is getting tied up and work goes out in spurts rather than in a smooth flow.

Kitties cross their little toes for luck.

The spikes are data going up to the lab per the 8_34 graph. I won't try to guess what those ~20 GB chunks contain.
                                                                   Joe

Offline archiving perhaps?
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1655798 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1655949 - Posted: 23 Mar 2015, 6:26:03 UTC - in response to Message 1655798.  

The network traffic graphs are certainly interesting at the moment.
Lots of very pronounced spikes in the outbound traffic, and a rather odd looking ripple for the inbound.
Grant
Darwin NT
ID: 1655949 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1656000 - Posted: 23 Mar 2015, 11:20:32 UTC - in response to Message 1655949.  

The network traffic graphs are certainly interesting at the moment.
Lots of very pronounced spikes in the outbound traffic, and a rather odd looking ripple for the inbound.

See Joe's explanation below.
And when that data is going up to the lab, it probably suppresses reporting from us in the field, causing the ripple in the inbound traffic.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1656000 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 1656002 - Posted: 23 Mar 2015, 11:57:03 UTC - in response to Message 1655798.  

Hope the servers can stay glued together until tomorrow when Matt may be back in the lab again.
Forum lag is usually a warning sign.
And the spiky nature of the Cricket graph is another one....that usually means something is getting tied up and work goes out in spurts rather than in a smooth flow.

Kitties cross their little toes for luck.

The spikes are data going up to the lab per the 8_34 graph. I won't try to guess what those ~20 GB chunks contain.
                                                                   Joe

Offline archiving perhaps?


Thomas the Tank Engine on Bluray.
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 1656002 · Report as offensive
Darth Beaver Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Avatar

Send message
Joined: 20 Aug 99
Posts: 6728
Credit: 21,443,075
RAC: 3
Australia
Message 1656023 - Posted: 23 Mar 2015, 13:46:06 UTC - in response to Message 1656002.  

Thomas the Tank Engine on Bluray.


+10 lol , roll on the ground peeing me myself laughing , brillient mate
ID: 1656023 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1656039 - Posted: 23 Mar 2015, 15:02:02 UTC

Rut Ro. Seems the MB splitters have fallen on hard times. The Ready to send has been rapidly declining. I was looking for a blue line...that just appeared, however, we may be out of work before that finishes. Are there any APs in that blue line?
ID: 1656039 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1656065 - Posted: 23 Mar 2015, 17:04:49 UTC - in response to Message 1656039.  

There was one file, 01oc12ad, which was AP splitted in about 30mins. Don't know was it from "Blue Line" :)
"Please keep Your signature under four lines so Internet traffic doesn't go up too much"

- In 1992 when I had my first e-mail address -
ID: 1656065 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1656086 - Posted: 23 Mar 2015, 17:52:50 UTC
Last modified: 23 Mar 2015, 17:53:48 UTC

Now, 17:40:03 UTC, there is new tape, 21se12ab, to be AP splitted. But it is one channel on progress, 13 done...

EDIT: And 17:50:03 UTC, it's done... Weird...
ID: 1656086 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1656089 - Posted: 23 Mar 2015, 18:07:52 UTC - in response to Message 1655798.  

Hope the servers can stay glued together until tomorrow when Matt may be back in the lab again.
Forum lag is usually a warning sign.
And the spiky nature of the Cricket graph is another one....that usually means something is getting tied up and work goes out in spurts rather than in a smooth flow.

Kitties cross their little toes for luck.

The spikes are data going up to the lab per the 8_34 graph. I won't try to guess what those ~20 GB chunks contain.
                                                                   Joe

Offline archiving perhaps?


Or new temporary AP database sends data to lab every now and then???
ID: 1656089 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1656094 - Posted: 23 Mar 2015, 18:13:01 UTC - in response to Message 1656086.  

Apparently those files have already been split for APs. It's a SETI thing. It's fine to resplit and rerun MB files. but it's not OK to rerun AP files...go figure.
What we need is to go back to around '99, before APs were ever thought of, and run those files for the first time using the AP technology. By the time we get up to around the 2010 AP files, we might have some New data to work.

;-)
ID: 1656094 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1656097 - Posted: 23 Mar 2015, 18:15:16 UTC - in response to Message 1656094.  

Apparently those files have already been split for APs. It's a SETI thing. It's fine to resplit and rerun MB files. but it's not OK to rerun AP files...go figure.
What we need is to go back to around '99, before APs were ever thought of, and run those files for the first time using the AP technology. By the time we get up to around the 2010 AP files, we might have some New data to work.

;-)

Hopefully Matt still has some more 2014's up his sleeve, unless we already did all that he had.

Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1656097 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1656103 - Posted: 23 Mar 2015, 18:29:16 UTC - in response to Message 1656094.  
Last modified: 23 Mar 2015, 18:42:12 UTC

Apparently those files have already been split for APs. It's a SETI thing. It's fine to resplit and rerun MB files. but it's not OK to rerun AP files...go figure.
What we need is to go back to around '99, before APs were ever thought of, and run those files for the first time using the AP technology. By the time we get up to around the 2010 AP files, we might have some New data to work.

;-)


That may be correct, now at 18:20:03 UTC 28ja13ag is splitted for AP, let's see what happens to it..-

EDIT: And if I read correctly this message and translated disk name correctly, this one has been processed.

EDIT2: And yes, it's gone.
ID: 1656103 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1656287 - Posted: 24 Mar 2015, 6:38:26 UTC - in response to Message 1656000.  

The network traffic graphs are certainly interesting at the moment.
Lots of very pronounced spikes in the outbound traffic, and a rather odd looking ripple for the inbound.

See Joe's explanation below.
And when that data is going up to the lab, it probably suppresses reporting from us in the field, causing the ripple in the inbound traffic.

Doubtfull IMHO, due to the very short nature of the spikes.
Grant
Darwin NT
ID: 1656287 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1656288 - Posted: 24 Mar 2015, 6:40:13 UTC

Looks like it's just died.
Splitter output zero, WUs awaiting assimilation going through the roof, and Awaiting validation is back on it's way up also.
Grant
Darwin NT
ID: 1656288 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1656315 - Posted: 24 Mar 2015, 8:05:43 UTC - in response to Message 1656288.  

Still no splitter output, Awaiting validation continues to climb, as does WUs awaiting assimilation.
At the present rate of decline for the ready-to-send buffer, we should be out of work in about 2 hours.
Grant
Darwin NT
ID: 1656315 · Report as offensive
Profile Oz
Avatar

Send message
Joined: 6 Jun 99
Posts: 233
Credit: 200,655,462
RAC: 212
United States
Message 1656345 - Posted: 24 Mar 2015, 9:27:23 UTC

No worries, they will fix it during the "outage".
Member of the 20 Year Club



ID: 1656345 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1656347 - Posted: 24 Mar 2015, 9:38:02 UTC - in response to Message 1656345.  
Last modified: 24 Mar 2015, 9:38:43 UTC

We are now out of work.
Results ready-to-send = 1
Current result creation rate <1.
Grant
Darwin NT
ID: 1656347 · Report as offensive
Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 23 · Next

Message boards : Number crunching : Panic Mode On (96) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.