Panic Mode On (80) Server Problems?

Message boards : Number crunching : Panic Mode On (80) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · 22 · 23 . . . 25 · Next

AuthorMessage
Mark Fiske

Send message
Joined: 15 Aug 11
Posts: 713
Credit: 7,392,921
RAC: 0
United States
Message 1331149 - Posted: 25 Jan 2013, 15:21:27 UTC

Don't believe I've seen this one before...anybody else?

1/25/2013 7:18:17 AM | SETI@home | Scheduler request completed: got 0 new tasks
1/25/2013 7:18:17 AM | SETI@home | No tasks sent
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for Astropulse v505
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for SETI@home v7
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for AstroPulse v6
ID: 1331149 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 1331151 - Posted: 25 Jan 2013, 15:24:54 UTC - in response to Message 1331149.  

Don't believe I've seen this one before...anybody else?

1/25/2013 7:18:17 AM | SETI@home | Scheduler request completed: got 0 new tasks
1/25/2013 7:18:17 AM | SETI@home | No tasks sent
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for Astropulse v505
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for SETI@home v7
1/25/2013 7:18:17 AM | SETI@home | No tasks are available for AstroPulse v6


Sure this happens.
Usually the feeder is just empty.



With each crime and every kindness we birth our future.
ID: 1331151 · Report as offensive
Mark Fiske

Send message
Joined: 15 Aug 11
Posts: 713
Credit: 7,392,921
RAC: 0
United States
Message 1331157 - Posted: 25 Jan 2013, 15:36:50 UTC - in response to Message 1331151.  

Figured it to be something like that, just hadn't seen the specificity before...
ID: 1331157 · Report as offensive
BarryAZ

Send message
Joined: 1 Apr 01
Posts: 2580
Credit: 16,982,517
RAC: 0
United States
Message 1331187 - Posted: 25 Jan 2013, 16:55:15 UTC - in response to Message 1331157.  

Seems to me that folks should simply take the hint, suspend processing on SETI and work on other projects until SETI is running moderately healthy once again.

Of course part of this would be some folks migrating and staying elsewhere as it is apparent that given available resources, the project can not reliably feed and take care of its extensive user community.

I've run Seti since the old days -- this April will be my 13th anniversary with the project. Sometimes it is close to my lead CPU centric project (I find running GPU's for SETI simply participates in the most problematic aspect of the project). These days, with the 'on again, off again' functionality here, it has dropped below some other worthy projects -- for me, those include Einstein, Rosetta, World Grid, POEM, and others.

So for now, I'm in 'suspend' mode here. Once the I/O issues are partially fixed, I'll shift to No New Work to clear existing work. After that, well we shall see whether SETI can handle the load it has.

ID: 1331187 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1331309 - Posted: 25 Jan 2013, 22:06:52 UTC - in response to Message 1331187.  


Looks like the Scheduler working was just a passing fad- inbound network traffic has been up & down all night. It's about 50/50 at the moment whether you'll get a response from a Scheduler request or a "Couldn't connect to server" message.
Grant
Darwin NT
ID: 1331309 · Report as offensive
BarryAZ

Send message
Joined: 1 Apr 01
Posts: 2580
Credit: 16,982,517
RAC: 0
United States
Message 1331342 - Posted: 25 Jan 2013, 23:20:27 UTC

Well, it is almost the weekend. Next week is another week.
ID: 1331342 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1331479 - Posted: 26 Jan 2013, 6:35:19 UTC
Last modified: 26 Jan 2013, 6:36:19 UTC

Whoa. Just looked in my message log:

2013-01-26 01:19:16 SETI@home Started download of ap_25my12aa_B1_P1_00000_20130125_31783.wu
2013-01-26 01:26:25 SETI@home Finished download of ap_25my12aa_B1_P1_00000_20130125_31783.wu


429 seconds for an average of 19.1KB/sec.. and it ran from start to finish without stalling, and not using a proxy.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1331479 · Report as offensive
Profile Vipin Palazhi
Avatar

Send message
Joined: 29 Feb 08
Posts: 286
Credit: 167,386,578
RAC: 0
India
Message 1331490 - Posted: 26 Jan 2013, 7:31:00 UTC

Cannot report the completed tasks from this part of the world since the past couple of hours. All requests are timing out on all my rigs.
ID: 1331490 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1331491 - Posted: 26 Jan 2013, 7:54:51 UTC

And actually, upon closer inspection, I have gotten 22 APs in the past ~24 hours, and they have all come through fast, with no errors/time-outs/stalls, and without the use of a proxy.


Scheduler contact on the other hand.. that's a different story.

Dozens of:

2013-01-26 02:45:08 SETI@home Scheduler request failed: Failure when receiving data from the peer
2013-01-26 02:51:31 SETI@home Scheduler request failed: Couldn't connect to server


in the past... ~16 hours. Started acting up around 1630utc according to my logs.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1331491 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1331507 - Posted: 26 Jan 2013, 9:40:18 UTC - in response to Message 1331491.  


Yeah, looks like the Scheduler died again, about 6 hours ago.
The very occasional requst results in work, but it's mostly "Couldn't connect to server" messages. Should be out of work in a few more hours.
Grant
Darwin NT
ID: 1331507 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1331576 - Posted: 26 Jan 2013, 15:00:42 UTC - in response to Message 1331507.  

I dunno, guys. The crickets show no dips in the green since about 2pm PST Friday. The blue line ramped down a bit in the evening, but didn't bottom out. And my active crunchers made contact 3 hours ago for one and 5 minutes ago for the other.

David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1331576 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1331589 - Posted: 26 Jan 2013, 15:44:32 UTC

I can tell you this.....
Comms are screwed.

Look, I have 9 rigs doing nothing but Seti.

Only two of them have managed to make comms requests in the last half hour.

And that means things are seriously mangled, and the sh#t is hitting the fan.
Big cow sh#t.

If I can't get through, nobody else can either.

I don't care anymore. The kitties have all the rigs on auto.....
If they cannot get the Seti kibble they truly want, they no longer get anything.
I hate starving kitties.

I wish for a return to the days when I had a 75,000 WU cache.
I used to be able to continue to crunch for weeks when the servers went down.

The limits have not accomplished much.....current situation proves that.

Give me back my bullets, Eric.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1331589 · Report as offensive
Ron
Volunteer tester

Send message
Joined: 24 Aug 99
Posts: 42
Credit: 34,544,679
RAC: 0
United States
Message 1331600 - Posted: 26 Jan 2013, 16:26:03 UTC
Last modified: 26 Jan 2013, 16:33:14 UTC

I got connected:
GTX690

572 SETI@home 1/26/2013 11:20:19 AM Reporting 103 completed tasks, requesting new tasks for CPU and NVIDIA
573 SETI@home 1/26/2013 11:21:08 AM Computation for task 16dc12aa.21994.18574.5.10.20_1 finished
574 SETI@home 1/26/2013 11:21:08 AM Starting task 16dc12aa.21994.18574.5.10.24_0 using setiathome_enhanced version 610 (cuda_fermi) in slot 21
575 SETI@home 1/26/2013 11:21:10 AM Started upload of 16dc12aa.21994.18574.5.10.20_1_0
576 SETI@home 1/26/2013 11:21:14 AM Finished upload of 16dc12aa.21994.18574.5.10.20_1_0
577 SETI@home 1/26/2013 11:21:34 AM Scheduler request completed: got 0 new tasks
578 SETI@home 1/26/2013 11:21:34 AM No tasks sent
579 SETI@home 1/26/2013 11:21:34 AM No tasks are available for Astropulse v505
580 SETI@home 1/26/2013 11:21:34 AM No tasks are available for SETI@home v7
581 SETI@home 1/26/2013 11:21:34 AM No tasks are available for AstroPulse v6
582 SETI@home 1/26/2013 11:21:34 AM Tasks for AMD/ATI GPU are available, but your preferences are set to not accept them

I was not very satisfying!

And 5 minutes later got 75 tasks that downloaded amazingly fast.
ID: 1331600 · Report as offensive
Profile KWSN Ekky Ekky Ekky
Avatar

Send message
Joined: 25 May 99
Posts: 944
Credit: 52,956,491
RAC: 67
United Kingdom
Message 1331636 - Posted: 26 Jan 2013, 19:06:11 UTC
Last modified: 26 Jan 2013, 19:12:01 UTC

Cricket has plunged off the cliff.
Bits in and bits out at zero :-(

[edit]...and almost immediately all back up again :-)

ID: 1331636 · Report as offensive
Rolf

Send message
Joined: 16 Jun 09
Posts: 114
Credit: 7,817,146
RAC: 0
Switzerland
Message 1331638 - Posted: 26 Jan 2013, 19:11:59 UTC - in response to Message 1331636.  

Cricket has plunged off the cliff.
Bits in and bits out at zero :-(

SETI takes a breath! ;-)
ID: 1331638 · Report as offensive
Tom*

Send message
Joined: 12 Aug 11
Posts: 127
Credit: 20,769,223
RAC: 9
United States
Message 1331645 - Posted: 26 Jan 2013, 19:27:24 UTC
Last modified: 26 Jan 2013, 19:29:43 UTC

I look for those Clifts

It's the only time I can reliably update and retry sucessfully.

Getting my Lost Tasks resent and downloads are as fast as they normally get

when loaded.

Two Ap's present among 18 MB's getting 28 and 22 KBps download speed currently
ID: 1331645 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1331680 - Posted: 26 Jan 2013, 20:54:01 UTC - in response to Message 1331638.  

Cricket has plunged off the cliff.
Bits in and bits out at zero :-(

SETI takes a breath! ;-)

Maybe one of the lab guys did a remote power cycle or something.

One of my boxes got through to report with NNT set, but the other 3 are still getting "couldn't connect to server" errors after 25 seconds. The good news is all my boxes have enough work to get through the weekend...
Donald
Infernal Optimist / Submariner, retired
ID: 1331680 · Report as offensive
Bob Browett
Volunteer tester

Send message
Joined: 27 May 99
Posts: 4
Credit: 2,013,629
RAC: 0
United Kingdom
Message 1331704 - Posted: 26 Jan 2013, 21:22:48 UTC - in response to Message 1331187.  

Good to see I am not the only "old timer" still patiently crunching.
Altho with SETI being a bit squiffy I am afriad I have switched most of my CPU time to World Community Grid for the time being.

I'll be back.

See you...out there

Regards

BobTheBrit
ID: 1331704 · Report as offensive
fscheel

Send message
Joined: 13 Apr 12
Posts: 73
Credit: 11,135,641
RAC: 0
United States
Message 1331705 - Posted: 26 Jan 2013, 21:30:25 UTC

Rampage

784 SETI@home 1/26/2013 3:00:57 PM Didn't resend lost task 17dc12aa.16159.476.7.10.240.vlar_1 (expired)
just got about 50 of these
ID: 1331705 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1331707 - Posted: 26 Jan 2013, 21:41:35 UTC - in response to Message 1331705.  

Rampage

784 SETI@home 1/26/2013 3:00:57 PM Didn't resend lost task 17dc12aa.16159.476.7.10.240.vlar_1 (expired)
just got about 50 of these

With the current server congestion, they were probably VLAR tasks assigned to your CPUs, but became ghosts (assignment message did not get through to your computer, so your BOINCManager did not download them). Next request asked for GPU (or CPU and GPU) work, but the servers will not send or resend VLARs to a GPU (Scheduler feeds the most efficient device, normally the GPU, first), so they were cancelled by the server and reassigned to other crunchers. Not a problem on your end, one of the things that happen when the servers are swamped or otherwise having problems.......
Donald
Infernal Optimist / Submariner, retired
ID: 1331707 · Report as offensive
Previous · 1 . . . 17 · 18 · 19 · 20 · 21 · 22 · 23 . . . 25 · Next

Message boards : Number crunching : Panic Mode On (80) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.