Upload server - disabled ?

Message boards : Number crunching : Upload server - disabled ?
Message board moderation

To post messages, you must log in.

AuthorMessage
Mark Lybeck

Send message
Joined: 9 Aug 99
Posts: 245
Credit: 216,677,290
RAC: 173
Finland
Message 1286816 - Posted: 22 Sep 2012, 21:17:14 UTC

I cant get any uploads through although according to SETI server status web page the server is up!

23/09/2012 00:13:47 | | [work_fetch] work fetch start
23/09/2012 00:13:47 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:13:47 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:13:47 | SETI@home | [work_fetch] REC 94201.126 priority -1.021350 (too many uploads)
23/09/2012 00:13:47 | | [work_fetch] CPU: shortfall 132053.89 nidle 0.00 saturated 611667.92 busy 0.00
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | | [work_fetch] NVIDIA: shortfall 56779.12 nidle 0.00 saturated 590748.39 busy 0.00
23/09/2012 00:13:47 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:13:47 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:13:47 | | [work_fetch] No project chosen for work fetch
23/09/2012 00:14:01 | | [work_fetch] Request work fetch: application exited
23/09/2012 00:14:01 | SETI@home | Computation for task 29my12ag.1941.8414.9.10.10_1 finished
23/09/2012 00:14:01 | SETI@home | Starting task 30my12aa.3087.5116.5.10.224_1 using setiathome_enhanced version 610 (cuda_fermi) in slot 1
23/09/2012 00:14:03 | | [work_fetch] work fetch start
23/09/2012 00:14:03 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:14:03 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:14:03 | SETI@home | [work_fetch] REC 94201.973 priority -1.021349 (too many uploads)
23/09/2012 00:14:03 | | [work_fetch] CPU: shortfall 131915.78 nidle 0.00 saturated 611680.79 busy 0.00
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | | [work_fetch] NVIDIA: shortfall 56830.17 nidle 0.00 saturated 590706.18 busy 0.00
23/09/2012 00:14:03 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:14:03 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:14:03 | | [work_fetch] No project chosen for work fetch
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 29my12ag.23376.11277.7.10.239_1_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 3 hr 38 min 25 sec on upload of 29my12ag.23376.11277.7.10.239_1_0
23/09/2012 00:14:11 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 28jn12ab.28490.64949.9.10.188_0_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 16 min 48 sec on upload of 28jn12ab.28490.64949.9.10.188_0_0
23/09/2012 00:14:11 | SETI@home | Started upload of 28jn12ab.28490.64949.9.10.218_0_0
23/09/2012 00:14:11 | SETI@home | Temporarily failed upload of 05jl12ab.2890.2112.13.10.92_0_0: connect() failed
23/09/2012 00:14:11 | SETI@home | Backing off 10 min 59 sec on upload of 05jl12ab.2890.2112.13.10.92_0_0
23/09/2012 00:14:11 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.67_0_0
23/09/2012 00:14:14 | | Project communication failed: attempting access to reference site
23/09/2012 00:14:17 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 9 min 36 sec on upload of 28jn12ab.28490.48998.9.10.227.vlar_0_0
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 28jn12ab.28490.64949.9.10.218_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 21 min 1 sec on upload of 28jn12ab.28490.64949.9.10.218_0_0
23/09/2012 00:14:34 | SETI@home | Temporarily failed upload of 05jl12ab.2890.9474.13.10.67_0_0: connect() failed
23/09/2012 00:14:34 | SETI@home | Backing off 2 min 45 sec on upload of 05jl12ab.2890.9474.13.10.67_0_0
23/09/2012 00:14:34 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.119_0_0
23/09/2012 00:14:34 | SETI@home | Started upload of 29my12ag.1941.8414.9.10.10_1_0
23/09/2012 00:14:37 | | Project communication failed: attempting access to reference site
23/09/2012 00:14:39 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:14:56 | SETI@home | Finished upload of 05jl12aa.30962.16836.12.10.66_1_0
23/09/2012 00:14:56 | SETI@home | Started upload of 05jl12ab.2890.9474.13.10.47_0_0
23/09/2012 00:14:56 | SETI@home | Started upload of 05jl12aa.30680.16836.11.10.192_0_0
23/09/2012 00:14:56 | SETI@home | Temporarily failed upload of 05jl12ab.2890.9474.13.10.119_0_0: connect() failed
23/09/2012 00:14:56 | SETI@home | Backing off 3 min 25 sec on upload of 05jl12ab.2890.9474.13.10.119_0_0
23/09/2012 00:14:58 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.239.vlar_0_0
23/09/2012 00:14:58 | SETI@home | Temporarily failed upload of 29my12ag.1941.8414.9.10.10_1_0: connect() failed
23/09/2012 00:14:58 | SETI@home | Backing off 3 min 1 sec on upload of 29my12ag.1941.8414.9.10.10_1_0
23/09/2012 00:15:00 | | Project communication failed: attempting access to reference site
23/09/2012 00:15:00 | SETI@home | Started upload of 28jn12ab.28490.48998.9.10.251.vlar_0_0
23/09/2012 00:15:01 | | Internet access OK - project servers may be temporarily down.
23/09/2012 00:15:06 | | [work_fetch] work fetch start
23/09/2012 00:15:06 | | [work_fetch] ------- start work fetch state -------
23/09/2012 00:15:06 | | [work_fetch] target work buffer: 604800.00 + 43200.00 sec
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] REC 0.000 priority -0.000000 (no new tasks)
23/09/2012 00:15:06 | SETI@home | [work_fetch] REC 94203.754 priority -1.021350 (too many uploads)
23/09/2012 00:15:06 | | [work_fetch] CPU: shortfall 131802.45 nidle 0.00 saturated 611737.94 busy 0.00
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | SETI@home | [work_fetch] CPU: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | | [work_fetch] NVIDIA: shortfall 56869.91 nidle 0.00 saturated 590661.25 busy 0.00
23/09/2012 00:15:06 | Milkyway@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | SETI@home | [work_fetch] NVIDIA: fetch share 0.000 rsc backoff (dt 0.00, inc 0.00)
23/09/2012 00:15:06 | | [work_fetch] ------- end work fetch state -------
23/09/2012 00:15:06 | | [work_fetch] No project chosen for work fetch

ID: 1286816 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22190
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1286819 - Posted: 22 Sep 2012, 21:23:17 UTC

Up for a few micro-seconds just now...
I suspect the server side scheduler is borked again - uploads, downloads and reporting are all very miss, miss, miss and hit just now.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1286819 · Report as offensive
rjbrowning

Send message
Joined: 20 Dec 99
Posts: 1
Credit: 7,142,217
RAC: 0
United States
Message 1286866 - Posted: 23 Sep 2012, 0:11:19 UTC

Same here. No results going back. And, it also seems that I'm not getting any new data to crunch, too. I've totally exhausted all my cuda jobs.

Something must be broke.
ID: 1286866 · Report as offensive
KB7RZF
Volunteer tester
Avatar

Send message
Joined: 15 Aug 99
Posts: 9549
Credit: 3,308,926
RAC: 2
United States
Message 1286910 - Posted: 23 Sep 2012, 3:14:19 UTC

Takes a bunch of button clicking to get things to go, but they do go, though very slowly. LOL
ID: 1286910 · Report as offensive
Profile Donald L. Johnson
Avatar

Send message
Joined: 5 Aug 02
Posts: 8240
Credit: 14,654,533
RAC: 20
United States
Message 1286959 - Posted: 23 Sep 2012, 6:26:58 UTC - in response to Message 1286819.  

Up for a few micro-seconds just now...
I suspect the server side scheduler is borked again - uploads, downloads and reporting are all very miss, miss, miss and hit just now.

Actually, this is the usual effect of a "shorty storm" - so many of the faster crunchers burn through them and try to upload and report faster than they can get new work assigned and downloaded.

I run relatively "slow" crunchers, and I'm having trouble uploading and reporting. But eventually, they all get through (sometimes with the help of the "manual update" button).

As usual with this project, patience is not just a virtue, it is a requirement.
Donald
Infernal Optimist / Submariner, retired
ID: 1286959 · Report as offensive
Mark Lybeck

Send message
Joined: 9 Aug 99
Posts: 245
Credit: 216,677,290
RAC: 173
Finland
Message 1289612 - Posted: 30 Sep 2012, 6:19:34 UTC

Hello,

Now on Saturday the upload becomes again congested. After the weekly maintenance there is no problem with the upload. There seems to be a patten here that always on weekend the upload becomes congested and remains so until the next maintenance break.
ID: 1289612 · Report as offensive
Profile Mr. Kevvy Crowdfunding Project Donor*Special Project $250 donor
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 15 May 99
Posts: 3776
Credit: 1,114,826,392
RAC: 3,319
Canada
Message 1289883 - Posted: 30 Sep 2012, 23:47:14 UTC
Last modified: 30 Sep 2012, 23:49:32 UTC

Seems to be fixed... all my hundreds of queued uploads went through and most of the downloads are working (albeit slowly but the server is getting hammered due to the completed uploads.)

Kudos to whoever went in and fixed this on a weekend (if anyone.) :^)
ID: 1289883 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1289897 - Posted: 1 Oct 2012, 1:33:50 UTC - in response to Message 1289883.  
Last modified: 1 Oct 2012, 1:35:28 UTC

Seems to be fixed... all my hundreds of queued uploads went through and most of the downloads are working (albeit slowly but the server is getting hammered due to the completed uploads.)

Kudos to whoever went in and fixed this on a weekend (if anyone.) :^)

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.
ID: 1289897 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13732
Credit: 208,696,464
RAC: 304
Australia
Message 1289910 - Posted: 1 Oct 2012, 2:39:08 UTC - in response to Message 1289897.  

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.

I suspect someone must have gone in & done something, because the last time the upload server choked it don't start working again till after the weekly outage.

Grant
Darwin NT
ID: 1289910 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22190
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1289950 - Posted: 1 Oct 2012, 5:33:31 UTC

Something certainly "wasn't right" this time round. despite everyone trying to get uploads (and for that matter downloads) the thin blue line fell to the bottom and stuck there for most of Saturday and Sunday (UK times). When it picked up there was quite a surge in it, now settling down to its usual level - I reckon there was a visit from a tyre kicker sometime Sunday evening (UK time) along with the end of the Astropulse production.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1289950 · Report as offensive
Harri Liljeroos
Avatar

Send message
Joined: 29 May 99
Posts: 4071
Credit: 85,281,665
RAC: 126
Finland
Message 1289963 - Posted: 1 Oct 2012, 6:53:23 UTC - in response to Message 1289950.  

Something certainly "wasn't right" this time round. despite everyone trying to get uploads (and for that matter downloads) the thin blue line fell to the bottom and stuck there for most of Saturday and Sunday (UK times). When it picked up there was quite a surge in it, now settling down to its usual level - I reckon there was a visit from a tyre kicker sometime Sunday evening (UK time) along with the end of the Astropulse production.


If you look closely to the graph, you'll see that it has automatic scaling and the bottom is now 10 Mbit/s. So it was still receiving quite a lot of data even in worst situation.
ID: 1289963 · Report as offensive
Profile Fred E.
Volunteer tester

Send message
Joined: 22 Jul 99
Posts: 768
Credit: 24,140,697
RAC: 0
United States
Message 1289971 - Posted: 1 Oct 2012, 7:57:05 UTC
Last modified: 1 Oct 2012, 7:59:57 UTC

I doubt any one went in and did anything, however the astopulse splitters are no longer splitting. Therefore we can all start to upload and download again.

I suspect someone must have gone in & done something, because the last time the upload server choked it don't start working again till after the weekly outage.


They added the ability to power cycle Bruno from a remote location last year, and I assume they still have it set up that way:

[url]http://setiathome.berkeley.edu/forum_thread.php?id=64612&postid=1120616
[/url]
and
http://setiathome.berkeley.edu/forum_thread.php?id=64436&postid=1115236

Regardless of how, thanks for the intervention!
Another Fred
Support SETI@home when you search the Web with GoodSearch or shop online with GoodShop.
ID: 1289971 · Report as offensive
Profile Bernie Vine
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 26 May 99
Posts: 9954
Credit: 103,452,613
RAC: 328
United Kingdom
Message 1289972 - Posted: 1 Oct 2012, 8:07:59 UTC
Last modified: 1 Oct 2012, 8:10:29 UTC

Perhaps the program just "failed" or "ran out of work"

This is the description for "Not Running"

Program failed or ran out of work

Different from "Disabled"

Program has been disabled by staff (for debugging/maintenance)
ID: 1289972 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34257
Credit: 79,922,639
RAC: 80
Germany
Message 1289991 - Posted: 1 Oct 2012, 9:34:58 UTC

I had no problems uploading.
So it was running.



With each crime and every kindness we birth our future.
ID: 1289991 · Report as offensive

Message boards : Number crunching : Upload server - disabled ?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.