Panic Mode On (84) Server Problems?


log in

Advanced search

Message boards : Number crunching : Panic Mode On (84) Server Problems?

Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 22 · Next
Author Message
Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5791
Credit: 58,030,165
RAC: 48,194
Australia
Message 1386767 - Posted: 2 Jul 2013, 8:05:03 UTC - in response to Message 1386619.


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.
____________
Grant
Darwin NT.

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1386788 - Posted: 2 Jul 2013, 10:25:10 UTC - in response to Message 1386767.


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.

I have noticed that myself, and was just as curious as you are. With the way v7 runs, I don't know if we shall really see another true 'shorty storm'. And even if we did have a minor one, the effects on the bandwidth would not have such a marked start and stop.

Only guess would be retrieving some information from the servers back to the lab for archiving purposes? Dunno.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Profile HAL9000
Volunteer tester
Avatar
Send message
Joined: 11 Sep 99
Posts: 4080
Credit: 111,699,144
RAC: 146,833
United States
Message 1386820 - Posted: 2 Jul 2013, 14:19:12 UTC - in response to Message 1386788.


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.

I have noticed that myself, and was just as curious as you are. With the way v7 runs, I don't know if we shall really see another true 'shorty storm'. And even if we did have a minor one, the effects on the bandwidth would not have such a marked start and stop.

Only guess would be retrieving some information from the servers back to the lab for archiving purposes? Dunno.

Looking at my results shorties are taking about 45% as long to run as normal AR tasks. I expect if we get a bunch of 'tapes' that make nothing but shorties we will be able to tell on the b/w graph.
____________
SETI@home classic workunits: 93,865 CPU time: 863,447 hours

Join the BP6/VP6 User Group today!

Sten-Arne
Volunteer tester
Send message
Joined: 1 Nov 08
Posts: 3406
Credit: 19,618,279
RAC: 18,382
Sweden
Message 1386840 - Posted: 2 Jul 2013, 18:36:03 UTC - in response to Message 1382869.

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.
____________

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1386845 - Posted: 2 Jul 2013, 18:43:24 UTC - in response to Message 1386840.

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

rob smithProject donor
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8309
Credit: 55,254,692
RAC: 75,262
United Kingdom
Message 1386854 - Posted: 2 Jul 2013, 19:17:24 UTC

I think Mark's right - as its not causing any delays in the MB production its never reached the top of someone's tuit list.
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

Profile Donald L. JohnsonProject donor
Avatar
Send message
Joined: 5 Aug 02
Posts: 6131
Credit: 675,698
RAC: 1,155
United States
Message 1386893 - Posted: 2 Jul 2013, 21:33:53 UTC - in response to Message 1386845.

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.

No it isn't. No splitter has run on that file since sometime last week. They blocked it somehow, and just have not dismounted it yet.
____________
Donald
Infernal Optimist / Submariner, retired

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1386895 - Posted: 2 Jul 2013, 21:41:25 UTC - in response to Message 1386893.

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.

No it isn't. No splitter has run on that file since sometime last week. They blocked it somehow, and just have not dismounted it yet.

How do you know that if it's stuck, Donald?
I was told by Eric that if a dataset gets stuck, it ties up the splitter working on it. I was later told that Matt had restarted it. But it would appear that it got stuck again. Just curious why you think the splitters are all dancing around it and that it's not still stuck tying up a splitter.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Jean Labrecque
Send message
Joined: 4 Jun 03
Posts: 77
Credit: 11,123,894
RAC: 5,731
Canada
Message 1386936 - Posted: 2 Jul 2013, 23:33:23 UTC

look at the color chart channel in progress so it is not being split at this moment

rob smithProject donor
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8309
Credit: 55,254,692
RAC: 75,262
United Kingdom
Message 1387024 - Posted: 3 Jul 2013, 4:46:33 UTC

While not being split it is tying up a splitter doing nothing.
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1387029 - Posted: 3 Jul 2013, 4:53:23 UTC - in response to Message 1387024.

While not being split it is tying up a splitter doing nothing.

Or IS it at the moment?
Not really sure.
JEAN makes a good point...
We have 6 active splitters, and the SSP shows 6 datasets color coded as 'in progress'. The stuck dataset does not show that.

Although I know everything on the SSP is not always as it appears.
And don't have any idea if one splitter only works on one dataset at a time by itself.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Profile Donald L. JohnsonProject donor
Avatar
Send message
Joined: 5 Aug 02
Posts: 6131
Credit: 675,698
RAC: 1,155
United States
Message 1387054 - Posted: 3 Jul 2013, 6:02:01 UTC - in response to Message 1386936.
Last modified: 3 Jul 2013, 6:04:29 UTC

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And don't have any idea if one splitter only works on one dataset at a time by itself.

I have seen as many as 9 channels "in progress" on MB, so at least some of the splitters can do 2 channels at once.
____________
Donald
Infernal Optimist / Submariner, retired

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1387055 - Posted: 3 Jul 2013, 6:03:32 UTC - in response to Message 1387054.

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And ya just could be correct, my friend.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Sten-Arne
Volunteer tester
Send message
Joined: 1 Nov 08
Posts: 3406
Credit: 19,618,279
RAC: 18,382
Sweden
Message 1387283 - Posted: 3 Jul 2013, 17:28:26 UTC

APs, them APs, where oh where are they? There haven't been any fresh APs being split for days now, and the few resends just isn't enough. I'm getting seriously low on APs now, and since AP is all I run, my computers will be idle soon, if there aren't any AP files added to the splitters very soon...

Panic, serious panic ahead.

____________

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5791
Credit: 58,030,165
RAC: 48,194
Australia
Message 1387298 - Posted: 3 Jul 2013, 18:04:00 UTC - in response to Message 1387283.


I'm thinking with the network bandwidth we have now, and no end in sight for the serverside limits, they could probably tweak the AP/MB ratio of work being split & pump out more AP these days.
____________
Grant
Darwin NT.

msattlerProject donor
Volunteer tester
Avatar
Send message
Joined: 9 Jul 00
Posts: 38922
Credit: 578,710,181
RAC: 515,577
United States
Message 1387301 - Posted: 3 Jul 2013, 18:12:00 UTC - in response to Message 1387298.


I'm thinking with the network bandwidth we have now, and no end in sight for the serverside limits, they could probably tweak the AP/MB ratio of work being split & pump out more AP these days.

If I am not mistaken, each dataset splits into a finite number of MB WUs as well as a finite number of AP WUs.
If the AP work is crunched and returned faster than the MB work is, that simply leaves the MB work remaining that has to be done before more datasets are loaded and split.

I don't think there is any way of making more AP work out of the data than there already is.
____________
*********************************************
Embrace your inner kitty...ya know ya wanna!

I have met a few friends in my life.
Most were cats.

Josef W. SegurProject donor
Volunteer developer
Volunteer tester
Send message
Joined: 30 Oct 99
Posts: 4230
Credit: 1,042,929
RAC: 318
United States
Message 1387411 - Posted: 3 Jul 2013, 21:05:12 UTC - in response to Message 1387054.

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And don't have any idea if one splitter only works on one dataset at a time by itself.

I have seen as many as 9 channels "in progress" on MB, so at least some of the splitters can do 2 channels at once.

I've seen up to 16 or so reported in the count, but manually counting the number of channels marked with the dark green block generally matches the number of splitters with Status = "Running". IOW, the count for "channels in progress:" has sometimes exceeded the other two indications of what's being done. My guess has always been that completion of a channel merely failed to reduce the count under some circumstances.

A splitter process can only work on one channel at a time. Although it has become conventional to call the work "multibeam", WUs have strictly been single beam.
Joe

Speedy
Volunteer tester
Avatar
Send message
Joined: 26 Jun 04
Posts: 660
Credit: 5,618,222
RAC: 7,432
New Zealand
Message 1387436 - Posted: 3 Jul 2013, 22:53:20 UTC - in response to Message 1387283.

APs, them APs, where oh where are they?

They are on tapes that are yet to be loaded into the splitters. We are all processing the MB work units as fast as we can
____________

Live in NZ y not join Smile City?

Lionel
Send message
Joined: 25 Mar 00
Posts: 544
Credit: 224,308,180
RAC: 216,232
Australia
Message 1387461 - Posted: 4 Jul 2013, 0:06:08 UTC - in response to Message 1387283.

APs, them APs, where oh where are they? There haven't been any fresh APs being split for days now, and the few resends just isn't enough. I'm getting seriously low on APs now, and since AP is all I run, my computers will be idle soon, if there aren't any AP files added to the splitters very soon...

Panic, serious panic ahead.


Sten, I'm afraid it looks like you are going to run dry and this may the norm going forward. The new world order appears to be that every one is jumping on AP when they are available in order to bolster their RAC. It's a shame that the credits for v7 MB are so low in comparison otherwise this wouldn't be happening and I can't see a fix for the v7 credit issue coming any time soon.

Good luck though and hope you make it through to the next tape.

Lionel





____________

Jean Labrecque
Send message
Joined: 4 Jun 03
Posts: 77
Credit: 11,123,894
RAC: 5,731
Canada
Message 1387513 - Posted: 4 Jul 2013, 6:18:59 UTC

AT LAST 20jn12ac IS BEING SPLIT NOW ...SO IT SHOULD END THAT PROBLEM UNLESS IT GET STUCK...????????

Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 22 · Next

Message boards : Number crunching : Panic Mode On (84) Server Problems?

Copyright © 2014 University of California