Panic Mode On (84) Server Problems?

Message boards : Number crunching : Panic Mode On (84) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 21 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1381333 - Posted: 15 Jun 2013, 0:05:04 UTC - in response to Message 1381327.  

So what's happening with the upload spikes then? I can't remember I ever saw the blue line any higher than 30Mbit on the old line. So spikes of 220Mbit are weird. :-)

Transfering data to be split from the archives.
Grant
Darwin NT
ID: 1381333 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1381335 - Posted: 15 Jun 2013, 0:07:04 UTC - in response to Message 1381334.  

Both of my machines have a full cache of GPU work.

So have mine, but it won't last when there is no more work available to download.


Splitter status is normal again.

MB creation rate 26.1706/sec
AP creation rate 0.7793/sec

Yep, and even the AP ready-to-send buffer is filling up.
Grant
Darwin NT
ID: 1381335 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1381339 - Posted: 15 Jun 2013, 0:30:28 UTC - in response to Message 1381335.  

Both of my machines have a full cache of GPU work.

So have mine, but it won't last when there is no more work available to download.


Splitter status is normal again.

MB creation rate 26.1706/sec
AP creation rate 0.7793/sec

Yep, and even the AP ready-to-send buffer is filling up.

Yeah I might stop crunching on my Q6600 cores and see how my GTX 660's go doing a few AP's just so Sten can get a few of his AP's validated quicker. :-D

Cheers.
ID: 1381339 · Report as offensive
bill

Send message
Joined: 16 Jun 99
Posts: 861
Credit: 29,352,955
RAC: 0
United States
Message 1381369 - Posted: 15 Jun 2013, 1:54:53 UTC - in response to Message 1381332.  

Grant. I think you're going to worry yourself
into an early grave.
ID: 1381369 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1381371 - Posted: 15 Jun 2013, 2:07:36 UTC - in response to Message 1381369.  

Grant. I think you're going to worry yourself
into an early grave.

Not worry, Panic.
Grant
Darwin NT
ID: 1381371 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1381824 - Posted: 16 Jun 2013, 13:53:02 UTC - in response to Message 1381371.  

Grant. I think you're going to worry yourself
into an early grave.

Not worry, Panic.

Relax. Go do some rock-sitting. Have a Darwin Stubby or three.
ID: 1381824 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1381885 - Posted: 16 Jun 2013, 17:51:58 UTC - in response to Message 1381824.  

Grant. I think you're going to worry yourself
into an early grave.

Not worry, Panic.

Relax. Go do some rock-sitting. Have a Darwin Stubby or three.

More panic time- AP assimilators seem to be having issues. Quite a backlog devloping.
Grant
Darwin NT
ID: 1381885 · Report as offensive
bill

Send message
Joined: 16 Jun 99
Posts: 861
Credit: 29,352,955
RAC: 0
United States
Message 1381952 - Posted: 16 Jun 2013, 20:40:57 UTC - in response to Message 1381885.  

Why are you panicking? You don't even do AP
work units. Perhaps a little Valium to take
the edge off? :)
ID: 1381952 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1382057 - Posted: 17 Jun 2013, 6:39:02 UTC - in response to Message 1381952.  

Why are you panicking?

We've had the project come to a grinding halt in the past because of a lack of disk space, and the AP Assimilator backlog continues to grow.
At the present rate it'll probably take several weeks (at least) before the project grinds to a halt, but it's better to panic early & panic often about such things.

Grant
Darwin NT
ID: 1382057 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1382230 - Posted: 17 Jun 2013, 18:27:23 UTC - in response to Message 1382057.  
Last modified: 17 Jun 2013, 18:28:51 UTC

We've had the project come to a grinding halt in the past because of a lack of disk space, and the AP Assimilator backlog continues to grow.
At the present rate it'll probably take several weeks (at least) before the project grinds to a halt, but it's better to panic early & panic often about such things.


Now SAH Assimilators have backlog, from zero to 20k in couple of hours...

SSP shows all SAH Assimilators are disabled and two out of four AP assimilators are Not Running
ID: 1382230 · Report as offensive
Alinator
Volunteer tester

Send message
Joined: 19 Apr 05
Posts: 4178
Credit: 4,647,982
RAC: 0
United States
Message 1382250 - Posted: 17 Jun 2013, 19:44:35 UTC - in response to Message 1382230.  

We've had the project come to a grinding halt in the past because of a lack of disk space, and the AP Assimilator backlog continues to grow.
At the present rate it'll probably take several weeks (at least) before the project grinds to a halt, but it's better to panic early & panic often about such things.


Now SAH Assimilators have backlog, from zero to 20k in couple of hours...

SSP shows all SAH Assimilators are disabled and two out of four AP assimilators are Not Running


LOL...

So now we should panic when all the signs are the team is on the case? :-D

I'd better reup on my blood pressure medicine and tranqs! ;-)
ID: 1382250 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1382414 - Posted: 18 Jun 2013, 7:30:36 UTC - in response to Message 1382250.  


AP Assimilator backlog continues to grow, and the PFB splitters have gone in to go slower mode. Ready-send-buffer has shrunk down, but the splitters haven't cranked up to fill it back up.
Grant
Darwin NT
ID: 1382414 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1382656 - Posted: 19 Jun 2013, 7:25:52 UTC - in response to Message 1382414.  


Once again the splitters are unable to meet demand.
Grant
Darwin NT
ID: 1382656 · Report as offensive
Filipe

Send message
Joined: 12 Aug 00
Posts: 218
Credit: 21,281,677
RAC: 20
Portugal
Message 1382662 - Posted: 19 Jun 2013, 7:34:47 UTC

It appears that a lot of channels have errors on it, and doesn´t produce suitable work units.
ID: 1382662 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1382747 - Posted: 19 Jun 2013, 16:44:34 UTC - in response to Message 1382656.  

Once again the splitters are unable to meet demand.

Or there's only one splitter splitting, the rest is disabled and not running. No work for the masses. RACs are crashing and burning. Setisticians are fleeing to elsewhere, or shutting down their systems under banners screaming: Crunch green, shut down!

We can also blame Dutch summer. It was hot yesterday, it was semi-hot and humid today, tonight we'll have thunderstorms, tomorrow one more day of warmth and then it's over. Back to 17C and vests and sweaters.

Ha.

:)
ID: 1382747 · Report as offensive
Thomas
Volunteer tester

Send message
Joined: 9 Dec 11
Posts: 1499
Credit: 1,345,576
RAC: 0
France
Message 1382750 - Posted: 19 Jun 2013, 16:49:33 UTC - in response to Message 1382747.  
Last modified: 19 Jun 2013, 16:50:08 UTC

Or there's only one splitter splitting, the rest is disabled and not running. No work for the masses. RACs are crashing and burning. Setisticians are fleeing to elsewhere, or shutting down their systems under banners screaming: Crunch green, shut down!

Sniff, sniff, Ageless :'-(
Give us back our WU's & Credits ! ;)
ID: 1382750 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1382754 - Posted: 19 Jun 2013, 16:59:50 UTC

Hmmmmmmmmm...
And what is that new web page server, murarae1?

P.S.
Eric told me he shall look into the work creation situation.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1382754 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1382775 - Posted: 19 Jun 2013, 17:51:16 UTC


Looks like they're out of data to split, although even when there was data to split & all the splitters were running, not much was being produced.
Should be out of GPU work in an hour or 2.
Grant
Darwin NT
ID: 1382775 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1382777 - Posted: 19 Jun 2013, 17:52:49 UTC - in response to Message 1382775.  


Looks like they're out of data to split, although even when there was data to split & all the splitters were running, not much was being produced.
Should be out of GPU work in an hour or 2.

Help may be on the way...
I just checked the Cricket graph again and it looks like some upload spikes have started. Should mean more datasets on the way to the servers.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1382777 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1382778 - Posted: 19 Jun 2013, 17:55:18 UTC - in response to Message 1382777.  


Looks like they're out of data to split, although even when there was data to split & all the splitters were running, not much was being produced.
Should be out of GPU work in an hour or 2.

Help may be on the way...
I just checked the Cricket graph again and it looks like some upload spikes have started. Should mean more datasets on the way to the servers.

Hopefully once they've got some Data to split, Eric will be albe to sort out why the splitters are so slow at actually splitting it.
Grant
Darwin NT
ID: 1382778 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 21 · Next

Message boards : Number crunching : Panic Mode On (84) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.