Panic Mode On (64) Server problems?

Message boards : Number crunching : Panic Mode On (64) Server problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 10 · Next

AuthorMessage
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6651
Credit: 121,090,076
RAC: 0
United States
Message 1183593 - Posted: 7 Jan 2012, 22:10:38 UTC - in response to Message 1183590.  

It's back to normal now. Many of the servers just disapeared.

Steve

Yeah It must be all of that Black Pudding over in Cafe... ;)

That's enough to make me disapear....

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1183593 · Report as offensive
MikeN

Send message
Joined: 24 Jan 11
Posts: 319
Credit: 64,719,409
RAC: 85
United Kingdom
Message 1183596 - Posted: 7 Jan 2012, 22:28:32 UTC - in response to Message 1183588.  

Strangely enough, download seems to work better, at the moment, than upload.



Agree, though my main cruncher can't get any downloads because it has uploads pending. I guess so many others are in the same situation that demand for downloads has decreased, hence the increased download speed. Eventually it should show up on the cricket graph. Hopefully that will free up some bandwidth for more uploads and we can get rid of the backlog, then demand for downloads will increase again and the crickets will max out etc etc etc.


Now all uploads gone through, but having trouble with downloads!! Oh well variety is the spice of life:))
ID: 1183596 · Report as offensive
Jon

Send message
Joined: 12 Aug 09
Posts: 157
Credit: 139,063,241
RAC: 0
United States
Message 1183599 - Posted: 7 Jan 2012, 22:36:17 UTC - in response to Message 1183584.  

Its those damn Astropulses, we're just going to have to put a stop to them. lol

Cheers.



+1
Jon
ID: 1183599 · Report as offensive
Dave Stegner
Volunteer tester
Avatar

Send message
Joined: 20 Oct 04
Posts: 540
Credit: 65,583,328
RAC: 27
United States
Message 1183691 - Posted: 8 Jan 2012, 6:31:28 UTC

Is my math wrong or did the Status page "freeze" a little over 2 hours ago. Last update 04:20 UTC, it is now 06:30 UTC.
Dave

ID: 1183691 · Report as offensive
Dave Stegner
Volunteer tester
Avatar

Send message
Joined: 20 Oct 04
Posts: 540
Credit: 65,583,328
RAC: 27
United States
Message 1183703 - Posted: 8 Jan 2012, 7:55:22 UTC - in response to Message 1183691.  

Based on the Cricket graph dive, the status page is not the only casualty.
Dave

ID: 1183703 · Report as offensive
Blake Bonkofsky
Volunteer tester
Avatar

Send message
Joined: 29 Dec 99
Posts: 617
Credit: 46,383,149
RAC: 0
United States
Message 1183705 - Posted: 8 Jan 2012, 8:06:30 UTC - in response to Message 1183703.  

Validators aren't functioning either, as my credit hasn't changed in hours, although I've uploaded and reported hundreds of results. Something is definitely jammed up somewhere. Luckily I was nearly at full limit when it all went south, although that only leaves me with about a days worth of GPU work on all machines.
ID: 1183705 · Report as offensive
Dave Stegner
Volunteer tester
Avatar

Send message
Joined: 20 Oct 04
Posts: 540
Credit: 65,583,328
RAC: 27
United States
Message 1183708 - Posted: 8 Jan 2012, 8:34:17 UTC

Yea, it looks like pretty much everything is jammed up now.

But look on the bright side, the boards still work.


Dave

ID: 1183708 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1183718 - Posted: 8 Jan 2012, 9:33:21 UTC - in response to Message 1183708.  

Yea, it looks like pretty much everything is jammed up now.

But look on the bright side, the boards still work.


Yes, At least we can gripe about it! :)

I had noticed on the 6th that one of my machines credit was remaining flat. I didn't give it to much thought until the 7th when it was still flat. Then I looked at the stats for several other machines. They were either flat or much lower than average compared to their "normal". However a few machines are doing just fine.

Perhaps there is an issue with the validators, much like the AP validator issue that was (or maybe still is) going on, that is causing a hang up on the server side. Causing some tasks to not get processed as quickly as they would be. However, With the count for "Workunits waiting for validation" rather low this doesn't seems like it is the issue.


SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1183718 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1183738 - Posted: 8 Jan 2012, 10:37:50 UTC - in response to Message 1181251.  

More work please......

Seti Beta my Main Backup Project is out of work, and has been for a few days, don't think the splitters have run since before Christmas :-(

Claggy
ID: 1183738 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13715
Credit: 208,696,464
RAC: 304
Australia
Message 1183741 - Posted: 8 Jan 2012, 10:53:15 UTC - in response to Message 1183738.  


Something's died, network traffic just keeps on falling.
Grant
Darwin NT
ID: 1183741 · Report as offensive
Profile john3760
Avatar

Send message
Joined: 9 Feb 11
Posts: 334
Credit: 3,400,979
RAC: 0
United Kingdom
Message 1183743 - Posted: 8 Jan 2012, 11:00:26 UTC

I have no GPU work and very little CPU work left.

I haven't dowloaded anything since 06:50 GMT.

No tasks available?
ID: 1183743 · Report as offensive
__W__
Avatar

Send message
Joined: 28 Mar 09
Posts: 116
Credit: 5,943,642
RAC: 0
Germany
Message 1183749 - Posted: 8 Jan 2012, 11:27:20 UTC - in response to Message 1183743.  

... and status page is stuck at 8 Jan 2012 | 4:20:12 UTC ...
My cache hits the limits, so no panik here :-) .

__W__
_______________________________________________________________________________
ID: 1183749 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65690
Credit: 55,293,173
RAC: 49
United States
Message 1183751 - Posted: 8 Jan 2012, 11:34:32 UTC

I think the validator has planked itself, as others have mentioned, It's been around 4 hours since My racs been updated.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1183751 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1183752 - Posted: 8 Jan 2012, 11:38:59 UTC - in response to Message 1183743.  

I have no GPU work and very little CPU work left.

I haven't dowloaded anything since 06:50 GMT.

No tasks available?



Server status page has not updated since 4:20 GMT and cricket graph is showing downloads have dropped.

So it looks as if there is no work being sent out.

If you have run out of GPU work so fast check and if need be increase your cache settings to a higher amount. (advanced view - advanced - preferences - network usage - additional work buffer, increase to between 5 and 10 days).

There are server side limits in place so you will not get flooded with work, your machine will only be allowed a maximum of 800 WU's 50 per CPU core and 400 for each GPU card.

This will not help this time but if next time your cache is higher you wont run out so easily when they have a minor problem.



Kevin


ID: 1183752 · Report as offensive
Profile john3760
Avatar

Send message
Joined: 9 Feb 11
Posts: 334
Credit: 3,400,979
RAC: 0
United Kingdom
Message 1183753 - Posted: 8 Jan 2012, 11:51:26 UTC - in response to Message 1183752.  

I have it set for 10 days,but I have just recently changed
the card from a 230 to a 460, and it's still in it's
settling in period.(I hope?)
Sometimes I get nothing for ages then I get 20 or 30.


Since I changed the card I have never built up a large cache.
I rarely get more than 1 page of WUs (41).

Thanks,but I think I will have to just be patient for the next
couple of weeks.

john3760


p.s. I did dump all my cuda WUs when my new card was erroring
all of them,and I realized that I needed FERMI WU's.
possibly that has something to do with it?
ID: 1183753 · Report as offensive
Profile Ronald R CODNEY
Avatar

Send message
Joined: 19 Nov 11
Posts: 87
Credit: 420,920
RAC: 0
United States
Message 1183759 - Posted: 8 Jan 2012, 12:31:58 UTC

Yup. looks like the validators r messed up.
ID: 1183759 · Report as offensive
Kevin Olley

Send message
Joined: 3 Aug 99
Posts: 906
Credit: 261,085,289
RAC: 572
United Kingdom
Message 1183761 - Posted: 8 Jan 2012, 13:01:26 UTC - in response to Message 1183753.  

I have it set for 10 days,but I have just recently changed
the card from a 230 to a 460, and it's still in it's
settling in period.(I hope?)
Sometimes I get nothing for ages then I get 20 or 30.


Since I changed the card I have never built up a large cache.
I rarely get more than 1 page of WUs (41).



It could be the change in cards that is causing this, I see that you are running x41g, you may now need flops in your app_info.xml file.

Are you seeing large alterations in "to completion" times ie: when a CPU task finishes GPU to completion times jump from 20 min to 1+ hrs? if so flops may be a good idea.

I am probably not the ideal person to advise on how to set up flops.


Kevin


ID: 1183761 · Report as offensive
Profile Khangollo
Avatar

Send message
Joined: 1 Aug 00
Posts: 245
Credit: 36,410,524
RAC: 0
Slovenia
Message 1183778 - Posted: 8 Jan 2012, 14:36:02 UTC

*poof* and the green drops dead.

Ouch. Looks like somebody clicked my profile page :(
ID: 1183778 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1183787 - Posted: 8 Jan 2012, 15:33:09 UTC - in response to Message 1183778.  
Last modified: 8 Jan 2012, 15:48:25 UTC

*poof* and the green drops dead.

Ouch. Looks like somebody clicked my profile page :(

Something's gone down in sympathy with the GTX 460 in my home machine. Its fans have stopped working, at just under 9 months old. It's fine as long as I don't try to crunch seti, then, as you say,*poof!* Tomorrow I get to test eBuyer's returns policy (tho' they were very good a couple of years ago when a stick of laptop RAM was DoA).

[Edit] 15:45 -- looks like someone's kicked something...
ID: 1183787 · Report as offensive
Profile Francesco Forti
Avatar

Send message
Joined: 24 May 00
Posts: 334
Credit: 204,421,005
RAC: 15
Switzerland
Message 1183798 - Posted: 8 Jan 2012, 16:25:27 UTC
Last modified: 8 Jan 2012, 16:27:18 UTC

SETI@home server status information is always stopped at [As of 8 Jan 2012 | 4:20:12 UTC] but now Graphs for gigabitethernet2_3 is showing again activity
http://fragment1.berkeley.edu/newcricket/grapher.cgi?target=%2Frouter-interfaces%2Finr-250%2Fgigabitethernet2_3;ranges=d%3Aw%3Am%3Ay;view=Octets

Download is slow as a snail
ID: 1183798 · Report as offensive
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 10 · Next

Message boards : Number crunching : Panic Mode On (64) Server problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.