Upload server - disabled ?


log in

Advanced search

Message boards : Number crunching : Upload server - disabled ?

Author Message
Mark Lybeck
Send message
Joined: 9 Aug 99
Posts: 209
Credit: 95,835,197
RAC: 86,655
Finland
Message 1286816 - Posted: 22 Sep 2012, 21:17:14 UTC

I cant get any uploads through although according to SETI server status web page the server is up!

23/09/2012 00:13:47 | | [work_fetch] work fetch start
23/09/2012 00:13:47 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:13:47 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:13:47 | SETI@home | [work_fetch] REC 94201.126 priority -1.021350 (too many uploads)
23/09/2012 00:13:47 | | [work_fetch] CPU: shortfall 132053.89 nidle 0.00 saturated 611667.92 busy 0.00
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | | [work_fetch] NVIDIA: shortfall 56779.12 nidle 0.00 saturated 590748.39 busy 0.00
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:13:47 | | [work_fetch] No project chosen for work fetch
23/09/2012 00:14:01 | | [work_fetch] Request work fetch: application exited
23/09/2012 00:14:01 | SETI@home | Computation for task 29my12ag.1941.8414.9.10.10_1 finished
23/09/2012 00:14:01 | SETI@home | Starting task 30my12aa.3087.5116.5.10.224_1 using setiathome_enhanced version 610 (cuda_fermi) in slot 1
23/09/2012 00:14:03 | | [work_fetch] work fetch start
23/09/2012 00:14:03 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:14:03 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:14:03 | SETI@home | [work_fetch] REC 94201.973 priority -1.021349 (too many uploads)
23/09/2012 00:14:03 | | [work_fetch] CPU: shortfall 131915.78 nidle 0.00 saturated 611680.79 busy 0.00
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | | [work_fetch] NVIDIA: shortfall 56830.17 nidle 0.00 saturated 590706.18 busy 0.00
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:14:03 | | [work_fetch] No project chosen for work fetch
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 29my12ag.23376.11277.7.10.239_1_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 3 hr 38 min 25 sec on upload of 29my12ag.23376.11277.7.10.239_1_0
23/09/2012 00:14:11 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 28jn12ab.28490.64949.9.10.188_0_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 16 min 48 sec on upload of 28jn12ab.28490.64949.9.10.188_0_0
23/09/2012 00:14:11 | SETI@home | Started upload of 28jn12ab.28490.64949.9.10.218_0_0
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 05jl12ab.2890.2112.13.10.92_0_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 10 min 59 sec on upload of 05jl12ab.2890.2112.13.10.92_0_0
23/09/2012 00:14:11 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.67_0_0
23/09/2012 00:14:14 | | Project communication failed: attempting access to reference site
23/09/2012 00:14:17 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 9 min 36 sec on upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 28jn12ab.28490.64949.9.10.218_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 21 min 1 sec on upload of 28jn12ab.28490.64949.9.10.218_0_0
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 05jl12ab.2890.9474.13.10.67_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 2 min 45 sec on upload of 05jl12ab.2890.9474.13.10.67_0_0
23/09/2012 00:14:34 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.119_0_0
23/09/2012 00:14:34 | SETI@home | Started upload of 29my12ag.1941.8414.9.10.10_1_0
23/09/2012 00:14:37 | | Project communication failed: attempting access to reference site
23/09/2012 00:14:39 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:14:56 | SETI@home | Finished upload of 05jl12aa.30962.16836.12.10.66_1_0
23/09/2012 00:14:56 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.47_0_0
23/09/2012 00:14:56 | SETI@home | Started upload of 05jl12aa.30680.16836.11.10.192_0_0
23/09/2012 00:14:56 | SETI@home | Temporarily failed upload of 05jl12ab.2890.9474.13.10.119_0_0: connect() failed
23/09/2012 00:14:56 | SETI@home | Backing off 3 min 25 sec on upload of 05jl12ab.2890.9474.13.10.119_0_0
23/09/2012 00:14:58 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.239.vlar_0_0
23/09/2012 00:14:58 | SETI@home | Temporarily failed upload of 29my12ag.1941.8414.9.10.10_1_0: connect() failed
23/09/2012 00:14:58 | SETI@home | Backing off 3 min 1 sec on upload of 29my12ag.1941.8414.9.10.10_1_0
23/09/2012 00:15:00 | | Project communication failed: attempting access to reference site
23/09/2012 00:15:00 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.251.vlar_0_0
23/09/2012 00:15:01 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:15:06 | | [work_fetch] work fetch start
23/09/2012 00:15:06 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:15:06 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:15:06 | SETI@home | [work_fetch] REC 94203.754 priority -1.021350 (too many uploads)
23/09/2012 00:15:06 | | [work_fetch] CPU: shortfall 131802.45 nidle 0.00 saturated 611737.94 busy 0.00
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | | [work_fetch] NVIDIA: shortfall 56869.91 nidle 0.00 saturated 590661.25 busy 0.00
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:15:06 | | [work_fetch] No project chosen for work fetch

____________

rob smith
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8135
Credit: 52,670,691
RAC: 74,842
United Kingdom
Message 1286819 - Posted: 22 Sep 2012, 21:23:17 UTC

Up for a few micro-seconds just now...
I suspect the server side scheduler is borked again - uploads, downloads and reporting are all very miss, miss, miss and hit just now.
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

rjbrowning
Send message
Joined: 20 Dec 99
Posts: 1
Credit: 6,057,057
RAC: 697
United States
Message 1286866 - Posted: 23 Sep 2012, 0:11:19 UTC

Same here. No results going back. And, it also seems that I'm not getting any new data to crunch, too. I've totally exhausted all my cuda jobs.

Something must be broke.
____________

KB7RZF
Volunteer tester
Avatar
Send message
Joined: 15 Aug 99
Posts: 9463
Credit: 3,034,733
RAC: 2,010
United States
Message 1286910 - Posted: 23 Sep 2012, 3:14:19 UTC

Takes a bunch of button clicking to get things to go, but they do go, though very slowly. LOL
____________

Profile Donald L. Johnson
Avatar
Send message
Joined: 5 Aug 02
Posts: 6009
Credit: 633,597
RAC: 1,004
United States
Message 1286959 - Posted: 23 Sep 2012, 6:26:58 UTC - in response to Message 1286819.

Up for a few micro-seconds just now...
I suspect the server side scheduler is borked again - uploads, downloads and reporting are all very miss, miss, miss and hit just now.

Actually, this is the usual effect of a "shorty storm" - so many of the faster crunchers burn through them and try to upload and report faster than they can get new work assigned and downloaded.

I run relatively "slow" crunchers, and I'm having trouble uploading and reporting. But eventually, they all get through (sometimes with the help of the "manual update" button).

As usual with this project, patience is not just a virtue, it is a requirement.
____________
Donald
Infernal Optimist / Submariner, retired

Mark Lybeck
Send message
Joined: 9 Aug 99
Posts: 209
Credit: 95,835,197
RAC: 86,655
Finland
Message 1289612 - Posted: 30 Sep 2012, 6:19:34 UTC

Hello,

Now on Saturday the upload becomes again congested. After the weekly maintenance there is no problem with the upload. There seems to be a patten here that always on weekend the upload becomes congested and remains so until the next maintenance break.
____________

Profile Mr. Kevvy
Volunteer tester
Avatar
Send message
Joined: 15 May 99
Posts: 678
Credit: 69,922,541
RAC: 77,300
Canada
Message 1289883 - Posted: 30 Sep 2012, 23:47:14 UTC
Last modified: 30 Sep 2012, 23:49:32 UTC

Seems to be fixed... all my hundreds of queued uploads went through and most of the downloads are working (albeit slowly but the server is getting hammered due to the completed uploads.)

Kudos to whoever went in and fixed this on a weekend (if anyone.) :^)
____________
“Never doubt that a small group of thoughtful, committed citizens can change the world; indeed, it's the only thing that ever has.”
--- Margaret Mead

Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 26 May 99
Posts: 6819
Credit: 24,584,703
RAC: 26,805
United Kingdom
Message 1289897 - Posted: 1 Oct 2012, 1:33:50 UTC - in response to Message 1289883.
Last modified: 1 Oct 2012, 1:35:28 UTC

Seems to be fixed... all my hundreds of queued uploads went through and most of the downloads are working (albeit slowly but the server is getting hammered due to the completed uploads.)

Kudos to whoever went in and fixed this on a weekend (if anyone.) :^)

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.
____________


Today is life, the only life we're sure of. Make the most of today.

Grant (SSSF)
Send message
Joined: 19 Aug 99
Posts: 5695
Credit: 56,356,048
RAC: 48,903
Australia
Message 1289910 - Posted: 1 Oct 2012, 2:39:08 UTC - in response to Message 1289897.

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.

I suspect someone must have gone in & done something, because the last time the upload server choked it don't start working again till after the weekly outage.

____________
Grant
Darwin NT.

rob smith
Volunteer tester
Send message
Joined: 7 Mar 03
Posts: 8135
Credit: 52,670,691
RAC: 74,842
United Kingdom
Message 1289950 - Posted: 1 Oct 2012, 5:33:31 UTC

Something certainly "wasn't right" this time round. despite everyone trying to get uploads (and for that matter downloads) the thin blue line fell to the bottom and stuck there for most of Saturday and Sunday (UK times). When it picked up there was quite a surge in it, now settling down to its usual level - I reckon there was a visit from a tyre kicker sometime Sunday evening (UK time) along with the end of the Astropulse production.
____________
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?

Profile Harri Liljeroos
Avatar
Send message
Joined: 29 May 99
Posts: 46
Credit: 18,404,670
RAC: 10,938
Finland
Message 1289963 - Posted: 1 Oct 2012, 6:53:23 UTC - in response to Message 1289950.

Something certainly "wasn't right" this time round. despite everyone trying to get uploads (and for that matter downloads) the thin blue line fell to the bottom and stuck there for most of Saturday and Sunday (UK times). When it picked up there was quite a surge in it, now settling down to its usual level - I reckon there was a visit from a tyre kicker sometime Sunday evening (UK time) along with the end of the Astropulse production.


If you look closely to the graph, you'll see that it has automatic scaling and the bottom is now 10 Mbit/s. So it was still receiving quite a lot of data even in worst situation.
____________

Profile Fred E.
Volunteer tester
Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,136,255
RAC: 2,975
United States
Message 1289971 - Posted: 1 Oct 2012, 7:57:05 UTC
Last modified: 1 Oct 2012, 7:59:57 UTC

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.

I suspect someone must have gone in & done something, because the last time the upload server choked it don't start working again till after the weekly outage.


They added the ability to power cycle Bruno from a remote location last year, and I assume they still have it set up that way:

[url]http://setiathome.berkeley.edu/forum_thread.php?id=64612&postid=1120616
[/url]
and
http://setiathome.berkeley.edu/forum_thread.php?id=64436&postid=1115236

Regardless of how, thanks for the intervention!
____________
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.

Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar
Send message
Joined: 26 May 99
Posts: 6819
Credit: 24,584,703
RAC: 26,805
United Kingdom
Message 1289972 - Posted: 1 Oct 2012, 8:07:59 UTC
Last modified: 1 Oct 2012, 8:10:29 UTC

Perhaps the program just "failed" or "ran out of work"

This is the description for "Not Running"

Program failed or ran out of work

Different from "Disabled"

Program has been disabled by staff (for debugging/maintenance)
____________


Today is life, the only life we're sure of. Make the most of today.

Profile Mike
Volunteer tester
Avatar
Send message
Joined: 17 Feb 01
Posts: 23368
Credit: 31,799,725
RAC: 24,283
Germany
Message 1289991 - Posted: 1 Oct 2012, 9:34:58 UTC

I had no problems uploading.
So it was running.

____________

Message boards : Number crunching : Upload server - disabled ?

Copyright © 2014 University of California