Panic Mode On (81) Server Problems?

Message boards : Number crunching : Panic Mode On (81) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 16 · 17 · 18 · 19 · 20 · 21 · Next

AuthorMessage
Profile Michael W.F. Miles
Avatar

Send message
Joined: 24 Mar 07
Posts: 268
Credit: 34,410,870
RAC: 0
Canada
Message 1339941 - Posted: 21 Feb 2013, 18:54:05 UTC

It would be nice to get some work before they shut down. With the limit of 200 that will give my meager system work for one 12 hour period.
Last night everything was down and now that there is a planned outage nobody gets work. All servers are now down.
Insanity is doing the same thing over and over but expecting different results each time.


Oh, please, oh, please allow us to crunch for you seti

Michael Miles
ID: 1339941 · Report as offensive
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 49660
Credit: 904,445,464
RAC: 189,193
United States
Message 1339945 - Posted: 21 Feb 2013, 19:09:12 UTC - in response to Message 1339921.  

"Why not increase the limits for this special occasion?"

For the same reason they were installed in the first place.

Also it would not make sense to increase it, I'm pretty sure the bandwidth will be maxed out until the planned outage, i.e. they will send out as many WUs as they can either way (and also probaly assign a lot of WUs, which can't be downloaded before they shut down).

Well....
The kitties have already refilled their caches to the current limits since the servers came back up this morning. I am sure if the limits for GPU tasks were lifted or raised, I could download a significant amount of it or all of it before the servers shut down tomorrow afternoon.
I'd love to be given the chance to prove it to you...LOL.
My body may be here, but my mind is in a galaxy far, far away.

Have made friends here.
Most were cats.
ID: 1339945 · Report as offensive
fscheel

Send message
Joined: 13 Apr 12
Posts: 73
Credit: 11,135,641
RAC: 0
United States
Message 1339954 - Posted: 21 Feb 2013, 19:19:40 UTC

I just wish I could upload the tasks I have completed.. not having any sucess.
ID: 1339954 · Report as offensive
bill

Send message
Joined: 16 Jun 99
Posts: 861
Credit: 29,352,955
RAC: 9
United States
Message 1339955 - Posted: 21 Feb 2013, 19:19:54 UTC - in response to Message 1339945.  

"Why not increase the limits for this special occasion?"

For the same reason they were installed in the first place.

Also it would not make sense to increase it, I'm pretty sure the bandwidth will be maxed out until the planned outage, i.e. they will send out as many WUs as they can either way (and also probaly assign a lot of WUs, which can't be downloaded before they shut down).

Well....
The kitties have already refilled their caches to the current limits since the servers came back up this morning. I am sure if the limits for GPU tasks were lifted or raised, I could download a significant amount of it or all of it before the servers shut down tomorrow afternoon.
I'd love to be given the chance to prove it to you...LOL.


And when the downloads ceased entirely and SAH
comes to a grinding halt because the database has
gone belly up again, what then?
ID: 1339955 · Report as offensive
kittyman Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 49660
Credit: 904,445,464
RAC: 189,193
United States
Message 1339956 - Posted: 21 Feb 2013, 19:21:33 UTC - in response to Message 1339955.  

"Why not increase the limits for this special occasion?"

For the same reason they were installed in the first place.

Also it would not make sense to increase it, I'm pretty sure the bandwidth will be maxed out until the planned outage, i.e. they will send out as many WUs as they can either way (and also probaly assign a lot of WUs, which can't be downloaded before they shut down).

Well....
The kitties have already refilled their caches to the current limits since the servers came back up this morning. I am sure if the limits for GPU tasks were lifted or raised, I could download a significant amount of it or all of it before the servers shut down tomorrow afternoon.
I'd love to be given the chance to prove it to you...LOL.


And when the downloads ceased entirely and SAH
comes to a grinding halt because the database has
gone belly up again, what then?

Time to reorganize or get some new DB software that can handle the amount of data in the Seti DB. Rumor has it, they do exist.

My body may be here, but my mind is in a galaxy far, far away.

Have made friends here.
Most were cats.
ID: 1339956 · Report as offensive
Profile Chris S Crowdfunding Project Donor*Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 19 Nov 00
Posts: 40475
Credit: 41,349,854
RAC: 2,013
United Kingdom
Message 1339965 - Posted: 21 Feb 2013, 19:29:38 UTC

Time to reorganize or get some new DB software that can handle the amount of data in the Seti DB. Rumor has it, they do exist.

Matt has informed me in the past that they use the Informix database for the servers, and that the Seti database is only up to about 40% of its capacity after 10 years.
ID: 1339965 · Report as offensive
bill

Send message
Joined: 16 Jun 99
Posts: 861
Credit: 29,352,955
RAC: 9
United States
Message 1339966 - Posted: 21 Feb 2013, 19:30:06 UTC - in response to Message 1339956.  

"Why not increase the limits for this special occasion?"

For the same reason they were installed in the first place.

Also it would not make sense to increase it, I'm pretty sure the bandwidth will be maxed out until the planned outage, i.e. they will send out as many WUs as they can either way (and also probaly assign a lot of WUs, which can't be downloaded before they shut down).

Well....
The kitties have already refilled their caches to the current limits since the servers came back up this morning. I am sure if the limits for GPU tasks were lifted or raised, I could download a significant amount of it or all of it before the servers shut down tomorrow afternoon.
I'd love to be given the chance to prove it to you...LOL.


And when the downloads ceased entirely and SAH
comes to a grinding halt because the database has
gone belly up again, what then?

Time to reorganize or get some new DB software that can handle the amount of data in the Seti DB. Rumor has it, they do exist.



In that case they should just turn all the hardware off until
they have saved up the money it would take to buy and implement
the software. It shouldn't take more than 5 or 6 months.
ID: 1339966 · Report as offensive
fscheel

Send message
Joined: 13 Apr 12
Posts: 73
Credit: 11,135,641
RAC: 0
United States
Message 1339972 - Posted: 21 Feb 2013, 19:36:02 UTC - in response to Message 1339954.  

I just wish I could upload the tasks I have completed.. not having any sucess.


Is there a trick to get them to upload?
ID: 1339972 · Report as offensive
Profile Link
Avatar

Send message
Joined: 18 Sep 03
Posts: 805
Credit: 1,697,204
RAC: 68
Germany
Message 1339980 - Posted: 21 Feb 2013, 19:46:46 UTC - in response to Message 1339945.  

"Why not increase the limits for this special occasion?"

For the same reason they were installed in the first place.

Also it would not make sense to increase it, I'm pretty sure the bandwidth will be maxed out until the planned outage, i.e. they will send out as many WUs as they can either way (and also probaly assign a lot of WUs, which can't be downloaded before they shut down).

Well....
The kitties have already refilled their caches to the current limits since the servers came back up this morning. I am sure if the limits for GPU tasks were lifted or raised, I could download a significant amount of it or all of it before the servers shut down tomorrow afternoon.
I'd love to be given the chance to prove it to you...LOL.

Well, if you get more, somebody else gets less. As long as the bandwidth is saturated, they send out as much as they can, more than that won't be send out whatever the limits are, it will only be assigned. And for the project it does not matter who gets the WUs, so they send out max. 100 or 200 to each machine so everyone can get something.

But maybe it's time to turn on the splitters, otherwise we will indeed not get as much as possible untill the outage.
.
ID: 1339980 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9235
Credit: 55,060,839
RAC: 46,725
United Kingdom
Message 1339982 - Posted: 21 Feb 2013, 19:47:51 UTC - in response to Message 1339972.  

I just wish I could upload the tasks I have completed.. not having any sucess.


Is there a trick to get them to upload?

Abuse of the "retry" button :-)
"Proud to be born and bred in Croydon"
ID: 1339982 · Report as offensive
Kevin Benfield

Send message
Joined: 29 Dec 03
Posts: 39
Credit: 29,475,936
RAC: 9,447
United Kingdom
Message 1339984 - Posted: 21 Feb 2013, 19:52:20 UTC - in response to Message 1339972.  

Would be good to know if there is a trick to get the units to upload and to down load some new ones.

Completely out of seti units sometime earlier today, is this another problem , or someone decide to prepare for the power outage early ?
ID: 1339984 · Report as offensive
Profile Michael W.F. Miles
Avatar

Send message
Joined: 24 Mar 07
Posts: 268
Credit: 34,410,870
RAC: 0
Canada
Message 1340012 - Posted: 21 Feb 2013, 21:05:11 UTC - in response to Message 1339984.  

They always do this now. I have seen this on every single outage that they plan for upgrades. They will stop allowing their volunteers to work for them.
I have been for a while and I have done quite a bit of work and I have never seen outages like this. It used to be they would let us fill right up for a planned outage. Now they shut down 2 days before they plan on it. The servers now showing no splitters are up so no work at all. I have spent my entire morning pressing retry just to get my uploads in and I have still only got 20 uploaded.

I have seen more people quit over these issues. These are people who have invested a lot of money building crunching machines and now they sit dormant. The other project especially medical ones are asking us to crunch for them. These are corporations who make huge money on our ability to crunch huge amounts of data.
We have built the fastest computer on the planet and they want to take advantage of that. The only project that I will support is Seti but it is now becoming more of a pain in the butt just to volunteer for them
ID: 1340012 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9235
Credit: 55,060,839
RAC: 46,725
United Kingdom
Message 1340019 - Posted: 21 Feb 2013, 21:15:33 UTC - in response to Message 1340012.  

They always do this now. I have seen this on every single outage that they plan for upgrades. They will stop allowing their volunteers to work for them.
I have been for a while and I have done quite a bit of work and I have never seen outages like this. It used to be they would let us fill right up for a planned outage. Now they shut down 2 days before they plan on it. The servers now showing no splitters are up so no work at all. I have spent my entire morning pressing retry just to get my uploads in and I have still only got 20 uploaded.

I have seen more people quit over these issues. These are people who have invested a lot of money building crunching machines and now they sit dormant. The other project especially medical ones are asking us to crunch for them. These are corporations who make huge money on our ability to crunch huge amounts of data.
We have built the fastest computer on the planet and they want to take advantage of that. The only project that I will support is Seti but it is now becoming more of a pain in the butt just to volunteer for them

Not sure why you are having problems, my three S@H rigs have uploaded 100+ and have downloaded the max tasks each, granted it took a little button pushing!!
"Proud to be born and bred in Croydon"
ID: 1340019 · Report as offensive
Kevin Benfield

Send message
Joined: 29 Dec 03
Posts: 39
Credit: 29,475,936
RAC: 9,447
United Kingdom
Message 1340023 - Posted: 21 Feb 2013, 21:21:16 UTC - in response to Message 1340019.  

Well , all units now uploaded, but was painfully slow for some reason.

Have managed to just get 107 units, although still downloading at present, keeping fingers crossed for now, don't want to jinx it.

When I run out of Seti units I do units for another project so had some of those running, this may have caused Seti to thing I had enough work, but suspending that project , while trying to request units eventually seemed to do the trick, or just may have chance.
ID: 1340023 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 23,711,557
RAC: 5,841
United States
Message 1340025 - Posted: 21 Feb 2013, 21:24:32 UTC - in response to Message 1340012.  

They always do this now. I have seen this on every single outage that they plan for upgrades. They will stop allowing their volunteers to work for them.
I have been for a while and I have done quite a bit of work and I have never seen outages like this. It used to be they would let us fill right up for a planned outage. Now they shut down 2 days before they plan on it. The servers now showing no splitters are up so no work at all. I have spent my entire morning pressing retry just to get my uploads in and I have still only got 20 uploaded.

They didn't shut down ahead of the outage, they crashed. I see what you're talking about, though. The splitters are all disabled or not running and the ready to send it almost down to nothing. However, I doubt this has anything to do with the coming outage.

I have seen more people quit over these issues. These are people who have invested a lot of money building crunching machines and now they sit dormant. The other project especially medical ones are asking us to crunch for them. These are corporations who make huge money on our ability to crunch huge amounts of data.
We have built the fastest computer on the planet and they want to take advantage of that. The only project that I will support is Seti but it is now becoming more of a pain in the butt just to volunteer for them

A lot of us also do Einstein@home. It's run by another university, not a corporation, and with its smaller number of users and the fact that it has actually found some of what it's looking for, you have a much better chance of being *the one* who finds something (well, one of *the ones*).


David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1340025 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 23,711,557
RAC: 5,841
United States
Message 1340026 - Posted: 21 Feb 2013, 21:29:28 UTC - in response to Message 1339911.  

Well, it looks like we're back from whatever partial outage we had last night.

Anybody get any details of what happened from one of the guys?

Korpela wrote:
Yep, it looks like thinman is down and bruno is hung. Unfortunately
this happened about half an hour after I left work.

That would explain why the blue line stayed down while the green came back.

It also sounds to me like a really good reason to move everything to that other building where someone can kick it.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1340026 · Report as offensive
Profile Fred E.
Volunteer tester

Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 0
United States
Message 1340027 - Posted: 21 Feb 2013, 21:32:30 UTC

I've been wondering if the planned electrical repairs and the server stoppages are related - something in the wiring knocking out the servers? I've seen refrigerators and air conditioners make the lights flicker when they start, especially if they are old and in a house with inadequate wiring. They just did some a/c upgrades and that could have led to a problem.

I'm up to the meager limits and won't withstand the planned outage, so I fully support lifting the limits. I still think they hurt the project by reducing throughput more than they help.

For file transfer problems, try briefly interrupting network communications on the activity menu for 3 to 15 seconds. Downloads will resume from where they were. Uploads will start over but that's no big deal. This usually helps me.
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.
ID: 1340027 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,226,405
RAC: 457
United Kingdom
Message 1340031 - Posted: 21 Feb 2013, 21:38:28 UTC

http://setiathome.berkeley.edu/forum_thread.php?id=70899

...By the way I'm fully aware we are about to temporarily run out of workunits to send. I'm just waiting for a RAID resync to finish (in about 90 minutes) before firing up the splitters again.

- Matt


Claggy
ID: 1340031 · Report as offensive
Profile Michael W.F. Miles
Avatar

Send message
Joined: 24 Mar 07
Posts: 268
Credit: 34,410,870
RAC: 0
Canada
Message 1340068 - Posted: 22 Feb 2013, 2:15:26 UTC

We have been heard
Thanks Matt
ID: 1340068 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1806
Credit: 243,342,975
RAC: 57,937
Australia
Message 1340086 - Posted: 22 Feb 2013, 4:40:31 UTC

From outage to Shorty Storm :(

Why oh why does this always happen ?

Even on a GTX 550 it still takes longer to download a unit than it does to crunch it....

T.A.
ID: 1340086 · Report as offensive
Previous · 1 . . . 16 · 17 · 18 · 19 · 20 · 21 · Next

Message boards : Number crunching : Panic Mode On (81) Server Problems?


 
©2018 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.