Panic Mode On (62) Server problems?

Message boards : Number crunching : Panic Mode On (62) Server problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · Next

AuthorMessage
Profile Khangollo
Avatar

Send message
Joined: 1 Aug 00
Posts: 245
Credit: 36,410,524
RAC: 0
Slovenia
Message 1177439 - Posted: 12 Dec 2011, 11:52:51 UTC

I don't think anyone thumped anything. Scheduler is working on/off (mostly off).
Right now, I'm getting nothing but HTTP errors/timeouts.
ID: 1177439 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1177441 - Posted: 12 Dec 2011, 12:16:37 UTC - in response to Message 1177439.  

I'm getting the occasional "can't connect to server" message every now and again but usually most requests get through.

I havn't had any problems uploading and all 3 here are still getting work to download plus for a change I havn't had to resort to a proxy today to get those downloads done.

Cheers.
ID: 1177441 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1177483 - Posted: 12 Dec 2011, 16:01:23 UTC - in response to Message 1176976.  

The kitties are bettin', given Matt's recent news and the way things are hiccupping right now, 'She's gonna crash, Jim.'

My God, Bones, what have I done?

:-)
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1177483 · Report as offensive
Dave

Send message
Joined: 29 Mar 02
Posts: 778
Credit: 25,001,396
RAC: 0
United Kingdom
Message 1177592 - Posted: 12 Dec 2011, 21:41:28 UTC

Midsummer on which planet, Neptune? ;).
ID: 1177592 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1177598 - Posted: 12 Dec 2011, 22:13:41 UTC - in response to Message 1177592.  

Well what a wonderful morning here in my part of Aussieland.

I woke up this morning for the first time in about a week where none of my 3 machines had backlogs of uploads/downloads waiting for me to clear.

Cheers.
ID: 1177598 · Report as offensive
MikeN

Send message
Joined: 24 Jan 11
Posts: 319
Credit: 64,719,409
RAC: 85
United Kingdom
Message 1177695 - Posted: 13 Dec 2011, 8:54:51 UTC - in response to Message 1177598.  

same here, but uploads will not clear. No problem on cricket graph (other than maxed out) but uploading takes longer than running the WUs so upload queue increasing and no new downloads.
ID: 1177695 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13732
Credit: 208,696,464
RAC: 304
Australia
Message 1177696 - Posted: 13 Dec 2011, 8:59:44 UTC - in response to Message 1177695.  


Scarecrow's graphs show 100,000s of results being returned per hour, i just wish some of them were mine.
The upload backlog continues to grow.
Grant
Darwin NT
ID: 1177696 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1177703 - Posted: 13 Dec 2011, 9:29:23 UTC - in response to Message 1177696.  

Yep, the upload server has definitely gone flakey again.

Cheers.
ID: 1177703 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22190
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1177717 - Posted: 13 Dec 2011, 10:11:26 UTC

Yeh, the Upload server is most definitely off its food, poor thing.
Never mind a few hours that nice man Matt will be back in and he will burp you...
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1177717 · Report as offensive
j tramer

Send message
Joined: 6 Oct 03
Posts: 242
Credit: 5,412,368
RAC: 0
Canada
Message 1177846 - Posted: 13 Dec 2011, 23:19:20 UTC

what th f?????????more crap
ID: 1177846 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1177850 - Posted: 13 Dec 2011, 23:28:18 UTC - in response to Message 1177848.  

Well, my6 uploads went through okay but the scheduling server shows as down so I can't report. :( Oh well, it's early, they should get things going again soon.


PROUD MEMBER OF Team Starfire World BOINC
ID: 1177850 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1177853 - Posted: 13 Dec 2011, 23:29:51 UTC

Not that I have a big check, but could the maintenance they do during the outage be done "live" if they had the power? If yes, what would it take?
ID: 1177853 · Report as offensive
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6652
Credit: 121,090,076
RAC: 0
United States
Message 1177855 - Posted: 13 Dec 2011, 23:31:25 UTC - in response to Message 1177853.  

Not that I have a big check, but could the maintenance they do during the outage be done "live" if they had the power? If yes, what would it take?

Not really. Part of it is defragging the database and adding new change sets. Doing that while undergoing thousands of hits would mean certain failure.

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1177855 · Report as offensive
Profile S@NL - XP_Freak

Send message
Joined: 10 Jul 99
Posts: 99
Credit: 6,248,265
RAC: 0
Netherlands
Message 1177862 - Posted: 13 Dec 2011, 23:38:23 UTC
Last modified: 13 Dec 2011, 23:39:36 UTC

I suspect that Higgs boson is responseble for these problems. :)

Goodbye Seti Classic
ID: 1177862 · Report as offensive
Profile SciManStev Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Jun 99
Posts: 6652
Credit: 121,090,076
RAC: 0
United States
Message 1177863 - Posted: 13 Dec 2011, 23:39:23 UTC - in response to Message 1177862.  

I suspect that Higgs bozon is responseble for these problems. :)

It is a quarky little buzzard.....

Steve
Warning, addicted to SETI crunching!
Crunching as a member of GPU Users Group.
GPUUG Website
ID: 1177863 · Report as offensive
Rasputin42
Volunteer tester

Send message
Joined: 25 Jul 08
Posts: 412
Credit: 5,834,661
RAC: 0
United States
Message 1177869 - Posted: 13 Dec 2011, 23:52:51 UTC

Am I wrong, or did you guys not have new servers installed a while ago?
If that is so, i fail to see any improvement.
ID: 1177869 · Report as offensive
Profile ivan
Volunteer tester
Avatar

Send message
Joined: 5 Mar 01
Posts: 783
Credit: 348,560,338
RAC: 223
United Kingdom
Message 1177872 - Posted: 13 Dec 2011, 23:56:55 UTC - in response to Message 1177862.  

I suspect that Higgs boson is responseble for these problems. :)

I won't say a word against it -- it pays my whisky bill! Pleased to see that the ATLAS curves today roughly coincide with the CMS ones I had already seen (as a CMS member). Gives some confidence that we are starting to see results that some people have spent two or even three decades working towards (just one decade for me...).
ID: 1177872 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1177876 - Posted: 14 Dec 2011, 0:00:00 UTC - in response to Message 1177869.  

Am I wrong, or did you guys not have new servers installed a while ago?
If that is so, i fail to see any improvement.

Just about this time last year. Spent basically this whole time trying to figure out how to fine-tune and optimize the values and settings to get maximum throughput out of these servers. Disk I/O is the major bottleneck.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1177876 · Report as offensive
Rasputin42
Volunteer tester

Send message
Joined: 25 Jul 08
Posts: 412
Credit: 5,834,661
RAC: 0
United States
Message 1177882 - Posted: 14 Dec 2011, 0:11:43 UTC

If the disk I/O is the bottleneck, maybe it's time to get some SSDs.
They are not that expensive any more.
ID: 1177882 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1177893 - Posted: 14 Dec 2011, 0:51:21 UTC

Well I think there are some SSDs in use already for the cache or log drive. SSDs are too unreliable for sensitive information (the whole limited write cycle issue). Yeah, it's somewhere around 300,000 writes, but for a database such as this.. 300,000 writes on any given sector won't take very long.

The other bottleneck is the database itself. It needs to have certain settings tweaked to be optimized for the hardware, and it's been a long-going process to tweak one value at a time and see what happens.

If you want more information on this ongoing battle, read through the tech news posts since January 2011. There's a lot of mention of what the issues are and what has been done to try to resolve said issues.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1177893 · Report as offensive
Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · Next

Message boards : Number crunching : Panic Mode On (62) Server problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.