Panic Mode On (96) Server Problems?

Message boards : Number crunching : Panic Mode On (96) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 21 · 22 · 23 · 24

AuthorMessage
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 10914
Credit: 29,581,041
RAC: 66
United States
Message 1663258 - Posted: 9 Apr 2015, 22:16:45 UTC - in response to Message 1663245.  

That is a cause to prepare for panic.
ID: 1663258 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1663265 - Posted: 9 Apr 2015, 22:37:00 UTC - in response to Message 1663258.  
Last modified: 9 Apr 2015, 22:56:51 UTC

WOW, I just opened the Kiosk page and ..... It's all YELLOW :D

EDIT: Resume panic, I have no idea where they got that graph info from.
ID: 1663265 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1628
Credit: 24,230,968
RAC: 26
United States
Message 1663300 - Posted: 10 Apr 2015, 0:21:43 UTC - in response to Message 1663111.  

Meanwhile, back on the ranch. Err....the kitty crunching farm....

The kitties are wandering about aimlessly meowing out loud and sniffing about looking for Seti WUs......

My system finished off it's work two days ago and it has to go. All those processed work units and no where to deposit them as Beta is also down.
ID: 1663300 · Report as offensive
Profile Lynn Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 20 Nov 00
Posts: 14059
Credit: 79,603,650
RAC: 123
United States
Message 1663447 - Posted: 10 Apr 2015, 6:28:37 UTC - in response to Message 1663174.  

No work on 4 machines. One full day now. :((((
Why donate to SETI????


They're working hard to sort out the issues, I'm sure. Hardware issues have been a big problem; and that's true for any kind of project. Don't give up hope, Lynn! Every penny helps for upgrades to help correct and even prevent these kinds of things. But, alas! There will always be hiccups along the way. Try to stay positive, it will get better soon :)


Sorry for my outburst. :( Friday will be four days no work.
I will continue to donate. This my friend Akio, Is A Huge Hiccup.
ID: 1663447 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51410
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1663467 - Posted: 10 Apr 2015, 7:29:16 UTC

Well, the kitties are cosmically disappointed, but not terminally depressed. I knew it was bad news the second I walked in the door when I got home from work and felt the chill in the crunching den.

But truth be told, I'd rather see Matt tackle the DB head on with his 'deep cleaning' in the hopes of ridding it of the recent spate of problems rather than to come back up and have the crashes continue every few days ad infinitum.
It's a rather massive database, and it's really no wonder that the process is taking longer than expected or desired.

I think I'll fire up the furnace and burn a few gallons of fuel oil to keep the chill off of the kitties, as, for whatever reasons, I am just not in the mood to crunch any backup project other than Seti right now.

And rather than get in a rude mood over something I cannot do anything about, maybe I'll take a cue from Matt and do a little deep cleaning myself..... literally.
I have some old GTX580s in the crunching fleet that have been throwing a wobbly here and there as temps got a bit warm for a few days this spring. I've been trying to keep them going by spritzing a bit of duster spray in the exhaust ports and the fans, but the only real cure is to shut the rigs down, remove the cards, and take the covers off to get inside at the internal heat sinks.

Guess this is my cue....LOL.
Excuse me if I am hard to understand at times.......I've had a difficult few lives.

ID: 1663467 · Report as offensive
Profile jason_gee
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 24 Nov 06
Posts: 7489
Credit: 91,093,184
RAC: 0
Australia
Message 1663475 - Posted: 10 Apr 2015, 7:49:00 UTC - in response to Message 1663467.  
Last modified: 10 Apr 2015, 7:49:54 UTC

All I know is, If I were an Oracle or IBM Executive, I'd be all over this as a product showcase, and have an emergency response team choppered in to lend a hand and beef up the gear where needed. Money well spent ? I think so :D
"Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions.
ID: 1663475 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51410
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1663485 - Posted: 10 Apr 2015, 8:01:17 UTC - in response to Message 1663475.  
Last modified: 10 Apr 2015, 8:03:31 UTC

All I know is, If I were an Oracle or IBM Executive, I'd be all over this as a product showcase, and have an emergency response team choppered in to lend a hand and beef up the gear where needed. Money well spent ? I think so :D

Ya know, Jason...
I have thought the same myself.
What a feather in one's cap to be able to say that their product powers the largest distributed computing project in the WORLD.

I just wonder if the powers that be have put a bug in the right ears.
Maybe DA should make a few inquiries instead of writing pretty page code.

Seriously...I find it hard to believe that there would not be some serious consideration of support if the correct inquiries were made, being that this is not a commercial enterprise, and they could then use it to leverage paying accounts.

And I would not consider it a problem to see a prominent banner on the home page saying...'Powered by XXXXXX'.
Excuse me if I am hard to understand at times.......I've had a difficult few lives.

ID: 1663485 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 32979
Credit: 79,922,639
RAC: 80
Germany
Message 1663508 - Posted: 10 Apr 2015, 8:37:12 UTC

Doing some einstein on Linux atm. :(
With each crime and every kindness we birth our future.
ID: 1663508 · Report as offensive
Profile Belthazor
Volunteer tester
Avatar

Send message
Joined: 6 Apr 00
Posts: 219
Credit: 10,373,795
RAC: 13
Russia
Message 1663546 - Posted: 10 Apr 2015, 11:01:06 UTC

I am looking at Kiosk. There a lot of WUs are sending out. What the matter, i have nothing for days and i thought no WUs generated at all. What is happens?
ID: 1663546 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1663553 - Posted: 10 Apr 2015, 11:26:22 UTC - in response to Message 1663546.  

The kiosk is showing rending of data.

And I think the rate of outgoing is really really disproportional to what's happening.
ID: 1663553 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9947
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1663573 - Posted: 10 Apr 2015, 12:58:35 UTC - in response to Message 1663546.  

I am looking at Kiosk. There a lot of WUs are sending out. What the matter, i have nothing for days and i thought no WUs generated at all. What is happens?

As an almost totally blank display would possibly not look very impressive. I suspect that it is displaying data from when there was some to display i.e several days ago.
ID: 1663573 · Report as offensive
Victor Wedge
Avatar

Send message
Joined: 3 Apr 04
Posts: 28
Credit: 12,569,503
RAC: 0
Message 1663583 - Posted: 10 Apr 2015, 13:20:11 UTC - in response to Message 1663573.  
Last modified: 10 Apr 2015, 13:24:12 UTC

It looks like they loop a five minute period within the past 24 hours. There was an active period yesterday, during which my WUs were all loaded up. Apparently they caught their loop during that period.

Even prior to that, it wasn't nearly blank. There were tons on incoming (around 15/second), but only a dribble of outgoing (12/minute). It would be cool beans if the kiosk were in real time.

But I again ran out of CUDA WUs about five hours ago. I'm good for a while with my CPU WUs though. I go through the GPU WUs lickety split.
ID: 1663583 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6533
Credit: 196,805,888
RAC: 57
United States
Message 1663584 - Posted: 10 Apr 2015, 13:26:47 UTC - in response to Message 1663573.  

I'm getting a pretty steady trickle of _2 _3 & _4 tasks every few hours.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the BP6/VP6 User Group today!
ID: 1663584 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1663586 - Posted: 10 Apr 2015, 13:31:00 UTC - in response to Message 1663583.  
Last modified: 10 Apr 2015, 13:32:07 UTC

With the kiosk, sure they capture 5 minutes, but it doesn't take 5 minutes to playback (at slow times like now). I just counted a 62s loop.

They just show movement of tasks 1 after the other, but don't show the timing of them going in/out.
ID: 1663586 · Report as offensive
Victor Wedge
Avatar

Send message
Joined: 3 Apr 04
Posts: 28
Credit: 12,569,503
RAC: 0
Message 1663589 - Posted: 10 Apr 2015, 13:34:58 UTC - in response to Message 1663586.  

With the kiosk, sure they capture 5 minutes, but it doesn't take 5 minutes to playback (at slow times like now). I just counted a 62s loop.

They just show movement of tasks 1 after the other, but don't show the timing of them going in/out.

The rates are at the top of the page for Sent, Received, and Application Downloads.
ID: 1663589 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1663596 - Posted: 10 Apr 2015, 14:03:48 UTC

Bummer, Haven't even caught a single resend in more than twelve hours. One box shut down, looks like it'll be two in an hour or so...
ID: 1663596 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1663598 - Posted: 10 Apr 2015, 14:09:37 UTC - in response to Message 1663589.  

With the kiosk, sure they capture 5 minutes, but it doesn't take 5 minutes to playback (at slow times like now). I just counted a 62s loop.

They just show movement of tasks 1 after the other, but don't show the timing of them going in/out.

The rates are at the top of the page for Sent, Received, and Application Downloads.


Yes I know they have stats at the top of the page, but they aren't even close to the real SSP rates. AP has not been above 1 task RTS, MB only 10, so explain the steady stream to me?
ID: 1663598 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14431
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1663612 - Posted: 10 Apr 2015, 14:45:47 UTC - in response to Message 1663598.  

With the kiosk, sure they capture 5 minutes, but it doesn't take 5 minutes to playback (at slow times like now). I just counted a 62s loop.

They just show movement of tasks 1 after the other, but don't show the timing of them going in/out.

The rates are at the top of the page for Sent, Received, and Application Downloads.

Yes I know they have stats at the top of the page, but they aren't even close to the real SSP rates. AP has not been above 1 task RTS, MB only 10, so explain the steady stream to me?

It's one they recorded earlier.
ID: 1663612 · Report as offensive
Victor Wedge
Avatar

Send message
Joined: 3 Apr 04
Posts: 28
Credit: 12,569,503
RAC: 0
Message 1663616 - Posted: 10 Apr 2015, 14:50:04 UTC - in response to Message 1663598.  
Last modified: 10 Apr 2015, 14:52:52 UTC

With the kiosk, sure they capture 5 minutes, but it doesn't take 5 minutes to playback (at slow times like now). I just counted a 62s loop.

They just show movement of tasks 1 after the other, but don't show the timing of them going in/out.

The rates are at the top of the page for Sent, Received, and Application Downloads.


Yes I know they have stats at the top of the page, but they aren't even close to the real SSP rates. AP has not been above 1 task RTS, MB only 10, so explain the steady stream to me?

I can't explain it. I'm still trying to figure it out. So, thanks for your input. I am sure it's more for a pretty display than to represent the current state, like the SETI screen saver. But, why also bother to display rates if they're entirely fictitious?
ID: 1663616 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1663619 - Posted: 10 Apr 2015, 14:59:24 UTC - in response to Message 1663616.  

The rates seemed pretty reasonable when the system was running full, but empty, they are out to lunch.
ID: 1663619 · Report as offensive
Previous · 1 . . . 21 · 22 · 23 · 24

Message boards : Number crunching : Panic Mode On (96) Server Problems?


 
©2022 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.