Panic Mode On (84) Server Problems?

Message boards : Number crunching : Panic Mode On (84) Server Problems?

To post messages, you must log in.

Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 22 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 7495
Credit: 91,208,194
RAC: 46,044
Australia
Message 1386767 - Posted: 2 Jul 2013, 8:05:03 UTC - in response to Message 1386619.  


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.
Grant
Darwin NT
ID: 1386767 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1386788 - Posted: 2 Jul 2013, 10:25:10 UTC - in response to Message 1386767.  


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.

I have noticed that myself, and was just as curious as you are. With the way v7 runs, I don't know if we shall really see another true 'shorty storm'. And even if we did have a minor one, the effects on the bandwidth would not have such a marked start and stop.

Only guess would be retrieving some information from the servers back to the lab for archiving purposes? Dunno.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1386788 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6111
Credit: 155,364,645
RAC: 50,231
United States
Message 1386820 - Posted: 2 Jul 2013, 14:19:12 UTC - in response to Message 1386788.  


Been scratching my head lately over the download network traffic. There have been some large surges, and as now some sustained traffic levels, even though there is no AP work going out, no increase in the amount of MB work in progess, nor a decline in the average turn around time.

I have noticed that myself, and was just as curious as you are. With the way v7 runs, I don't know if we shall really see another true 'shorty storm'. And even if we did have a minor one, the effects on the bandwidth would not have such a marked start and stop.

Only guess would be retrieving some information from the servers back to the lab for archiving purposes? Dunno.

Looking at my results shorties are taking about 45% as long to run as normal AR tasks. I expect if we get a bunch of 'tapes' that make nothing but shorties we will be able to tell on the b/w graph.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the BP6/VP6 User Group today!
ID: 1386820 · Report as offensive
Tutankhamon "Communist"
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 6091
Credit: 37,752,485
RAC: 18,096
Sweden
Message 1386840 - Posted: 2 Jul 2013, 18:36:03 UTC - in response to Message 1382869.  

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.
This is a test of the Emergency Moron System. Had there been a real moron in the room, there would've been a small mushroom cloud in the place where the idiot had been standing.
ID: 1386840 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1386845 - Posted: 2 Jul 2013, 18:43:24 UTC - in response to Message 1386840.  

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1386845 · Report as offensive
rob smithProject Donor
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 13338
Credit: 155,043,306
RAC: 118,464
United Kingdom
Message 1386854 - Posted: 2 Jul 2013, 19:17:24 UTC

I think Mark's right - as its not causing any delays in the MB production its never reached the top of someone's tuit list.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1386854 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8205
Credit: 4,371,010
RAC: 5,473
United States
Message 1386893 - Posted: 2 Jul 2013, 21:33:53 UTC - in response to Message 1386845.  

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.

No it isn't. No splitter has run on that file since sometime last week. They blocked it somehow, and just have not dismounted it yet.
Donald
Infernal Optimist / Submariner, retired
ID: 1386893 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1386895 - Posted: 2 Jul 2013, 21:41:25 UTC - in response to Message 1386893.  

I wonder if the creation rate could be related to file 20jn12ac as it has been in its current state for way longer than is usual.

Cheers.


And 12 days later, 20jn12ac is still in the same sorry state. Someone is asleep at the helm.

As far as I know, that stuck dataset holds up 1 MB splitter. And since MB splitting has been keeping up with demand, maybe that's why it's not been dealt with. Although the rational for leaving it in it's stuck state evades me...LOL.

No it isn't. No splitter has run on that file since sometime last week. They blocked it somehow, and just have not dismounted it yet.

How do you know that if it's stuck, Donald?
I was told by Eric that if a dataset gets stuck, it ties up the splitter working on it. I was later told that Matt had restarted it. But it would appear that it got stuck again. Just curious why you think the splitters are all dancing around it and that it's not still stuck tying up a splitter.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1386895 · Report as offensive
Jean Labrecque

Send message
Joined: 4 Jun 03
Posts: 77
Credit: 14,320,137
RAC: 131
Canada
Message 1386936 - Posted: 2 Jul 2013, 23:33:23 UTC

look at the color chart channel in progress so it is not being split at this moment
ID: 1386936 · Report as offensive
rob smithProject Donor
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 13338
Credit: 155,043,306
RAC: 118,464
United Kingdom
Message 1387024 - Posted: 3 Jul 2013, 4:46:33 UTC

While not being split it is tying up a splitter doing nothing.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1387024 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1387029 - Posted: 3 Jul 2013, 4:53:23 UTC - in response to Message 1387024.  

While not being split it is tying up a splitter doing nothing.

Or IS it at the moment?
Not really sure.
JEAN makes a good point...
We have 6 active splitters, and the SSP shows 6 datasets color coded as 'in progress'. The stuck dataset does not show that.

Although I know everything on the SSP is not always as it appears.
And don't have any idea if one splitter only works on one dataset at a time by itself.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1387029 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8205
Credit: 4,371,010
RAC: 5,473
United States
Message 1387054 - Posted: 3 Jul 2013, 6:02:01 UTC - in response to Message 1386936.  
Last modified: 3 Jul 2013, 6:04:29 UTC

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And don't have any idea if one splitter only works on one dataset at a time by itself.

I have seen as many as 9 channels "in progress" on MB, so at least some of the splitters can do 2 channels at once.
Donald
Infernal Optimist / Submariner, retired
ID: 1387054 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1387055 - Posted: 3 Jul 2013, 6:03:32 UTC - in response to Message 1387054.  

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And ya just could be correct, my friend.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1387055 · Report as offensive
Tutankhamon "Communist"
Volunteer tester
Avatar

Send message
Joined: 1 Nov 08
Posts: 6091
Credit: 37,752,485
RAC: 18,096
Sweden
Message 1387283 - Posted: 3 Jul 2013, 17:28:26 UTC

APs, them APs, where oh where are they? There haven't been any fresh APs being split for days now, and the few resends just isn't enough. I'm getting seriously low on APs now, and since AP is all I run, my computers will be idle soon, if there aren't any AP files added to the splitters very soon...

Panic, serious panic ahead.

This is a test of the Emergency Moron System. Had there been a real moron in the room, there would've been a small mushroom cloud in the place where the idiot had been standing.
ID: 1387283 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 7495
Credit: 91,208,194
RAC: 46,044
Australia
Message 1387298 - Posted: 3 Jul 2013, 18:04:00 UTC - in response to Message 1387283.  


I'm thinking with the network bandwidth we have now, and no end in sight for the serverside limits, they could probably tweak the AP/MB ratio of work being split & pump out more AP these days.
Grant
Darwin NT
ID: 1387298 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45964
Credit: 815,514,934
RAC: 123,439
United States
Message 1387301 - Posted: 3 Jul 2013, 18:12:00 UTC - in response to Message 1387298.  


I'm thinking with the network bandwidth we have now, and no end in sight for the serverside limits, they could probably tweak the AP/MB ratio of work being split & pump out more AP these days.

If I am not mistaken, each dataset splits into a finite number of MB WUs as well as a finite number of AP WUs.
If the AP work is crunched and returned faster than the MB work is, that simply leaves the MB work remaining that has to be done before more datasets are loaded and split.

I don't think there is any way of making more AP work out of the data than there already is.
Always remember.....kitties are all Angels with fur.

Have made friends in this life.
Most were cats.
ID: 1387301 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1387411 - Posted: 3 Jul 2013, 21:05:12 UTC - in response to Message 1387054.  

look at the color chart channel in progress so it is not being split at this moment

Exactly. There are no dark green "in progress" bands on that file, and have not been since about Wednesday last week. There was one when it was stuck earlier. That's why I think Eric or Matt "blocked" that file from being split.

And don't have any idea if one splitter only works on one dataset at a time by itself.

I have seen as many as 9 channels "in progress" on MB, so at least some of the splitters can do 2 channels at once.

I've seen up to 16 or so reported in the count, but manually counting the number of channels marked with the dark green block generally matches the number of splitters with Status = "Running". IOW, the count for "channels in progress:" has sometimes exceeded the other two indications of what's being done. My guess has always been that completion of a channel merely failed to reduce the count under some circumstances.

A splitter process can only work on one channel at a time. Although it has become conventional to call the work "multibeam", WUs have strictly been single beam.
                                                                  Joe
ID: 1387411 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 902
Credit: 7,867,960
RAC: 1,907
New Zealand
Message 1387436 - Posted: 3 Jul 2013, 22:53:20 UTC - in response to Message 1387283.  

APs, them APs, where oh where are they?

They are on tapes that are yet to be loaded into the splitters. We are all processing the MB work units as fast as we can
ID: 1387436 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 665
Credit: 351,401,244
RAC: 140,745
Australia
Message 1387461 - Posted: 4 Jul 2013, 0:06:08 UTC - in response to Message 1387283.  

APs, them APs, where oh where are they? There haven't been any fresh APs being split for days now, and the few resends just isn't enough. I'm getting seriously low on APs now, and since AP is all I run, my computers will be idle soon, if there aren't any AP files added to the splitters very soon...

Panic, serious panic ahead.


Sten, I'm afraid it looks like you are going to run dry and this may the norm going forward. The new world order appears to be that every one is jumping on AP when they are available in order to bolster their RAC. It's a shame that the credits for v7 MB are so low in comparison otherwise this wouldn't be happening and I can't see a fix for the v7 credit issue coming any time soon.

Good luck though and hope you make it through to the next tape.

Lionel





ID: 1387461 · Report as offensive
Jean Labrecque

Send message
Joined: 4 Jun 03
Posts: 77
Credit: 14,320,137
RAC: 131
Canada
Message 1387513 - Posted: 4 Jul 2013, 6:18:59 UTC

AT LAST 20jn12ac IS BEING SPLIT NOW ...SO IT SHOULD END THAT PROBLEM UNLESS IT GET STUCK...????????
ID: 1387513 · Report as offensive
Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 22 · Next

Message boards : Number crunching : Panic Mode On (84) Server Problems?


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.