!!!!!!UPLOADS!!!!!WORKING!!!!!!!!!

Author	Message
Daniel Schaalma Volunteer tester Send message Joined: 28 May 99 Posts: 297 Credit: 16,953,703 RAC: 0	Message 212489 - Posted: 13 Dec 2005, 4:46:42 UTC My entire backlog of nearly 4,000 results has been COMPLETELY uploaded! Hats off to Matt! This calls for a BEER to celebrate!!! ;) Regards, Daniel. ID: 212489 ·

Hexadecibill Send message Joined: 14 Mar 01 Posts: 5 Credit: 454,358 RAC: 0	Message 212491 - Posted: 13 Dec 2005, 4:52:31 UTC YAY!! Upload Upload Chug Chug Chug! That was the longest week ever... I second that beer idea. Thanks to everyone that got everything up and running again!! ID: 212491 ·

Team MotoFlux Send message Joined: 31 Jan 02 Posts: 4 Credit: 1,765,151 RAC: 0	Message 212510 - Posted: 13 Dec 2005, 5:29:31 UTC 12/13/2005 10:54:08 AM\|SETI@home\|Finished upload of 25ja04ab.17413.5328.215900.74_2_0 12/13/2005 10:54:08 AM\|SETI@home\|Throughput 18016 bytes/sec 12/13/2005 10:54:08 AM\|SETI@home\|Started upload of 30oc03ab.23657.2800.1034670.72_1_0 12/13/2005 10:54:09 AM\|SETI@home\|Finished upload of 30oc03ab.23657.2800.1034670.71_3_0 12/13/2005 10:54:09 AM\|SETI@home\|Throughput 14806 bytes/sec 12/13/2005 10:54:10 AM\|SETI@home\|Started upload of 25ja04ab.17413.5378.915908.196_2_0 12/13/2005 10:54:11 AM\|\|request_reschedule_cpus: project op 12/13/2005 10:54:11 AM\|SETI@home\|Sending scheduler request to http://setiboinc.ssl.berkeley.edu/sah_cgi/cgi 12/13/2005 10:54:11 AM\|SETI@home\|Requesting 0 seconds of work, returning 10 results 12/13/2005 10:54:19 AM\|SETI@home\|Finished upload of 30oc03ab.23657.2800.1034670.72_1_0 12/13/2005 10:54:19 AM\|SETI@home\|Throughput 16342 bytes/sec 12/13/2005 10:54:19 AM\|SETI@home\|Finished upload of 25ja04ab.17413.5378.915908.196_2_0 12/13/2005 10:54:19 AM\|SETI@home\|Throughput 13784 bytes/sec 12/13/2005 10:54:20 AM\|SETI@home\|Started upload of 25ja04ab.17413.5328.215900.64_1_0 12/13/2005 10:54:20 AM\|SETI@home\|Started upload of 25ja04ab.17413.5328.215900.72_3_0 12/13/2005 10:54:29 AM\|SETI@home\|Finished upload of 25ja04ab.17413.5328.215900.64_1_0 12/13/2005 10:54:29 AM\|SETI@home\|Throughput 21206 bytes/sec 12/13/2005 10:54:30 AM\|SETI@home\|Started upload of 30oc03ab.23657.2800.1034670.77_0_0 12/13/2005 10:54:30 AM\|SETI@home\|Finished upload of 25ja04ab.17413.5328.215900.72_3_0 12/13/2005 10:54:30 AM\|SETI@home\|Throughput 16331 bytes/sec 12/13/2005 10:54:31 AM\|SETI@home\|Started upload of 30oc03ab.23657.2800.1034670.73_0_0 12/13/2005 10:54:35 AM\|SETI@home\|Scheduler request to http://setiboinc.ssl.berkeley.edu/sah_cgi/cgi succeeded 12/13/2005 10:54:45 AM\|SETI@home\|Finished upload of 30oc03ab.23657.2800.1034670.77_0_0 12/13/2005 10:54:45 AM\|SETI@home\|Throughput 12629 bytes/sec 12/13/2005 10:54:46 AM\|SETI@home\|Started upload of 15oc03aa.1719.24818.965896.120_3_0 12/13/2005 10:54:47 AM\|SETI@home\|Finished upload of 30oc03ab.23657.2800.1034670.73_0_0 12/13/2005 10:54:47 AM\|SETI@home\|Throughput 10483 bytes/sec 12/13/2005 10:54:48 AM\|SETI@home\|Started upload of 15ap04aa.22158.27185.242304.42_0_0 12/13/2005 10:54:57 AM\|SETI@home\|Finished upload of 15oc03aa.1719.24818.965896.120_3_0 12/13/2005 10:54:57 AM\|SETI@home\|Throughput 11699 bytes/sec 12/13/2005 10:54:57 AM\|SETI@home\|Started upload of 15ap04aa.22158.28690.261062.8_2_0 12/13/2005 10:55:05 AM\|SETI@home\|Finished upload of 15ap04aa.22158.27185.242304.42_0_0 12/13/2005 10:55:05 AM\|SETI@home\|Throughput 9220 bytes/sec 12/13/2005 10:55:05 AM\|SETI@home\|Started upload of 15oc03aa.1719.30594.642322.254_2_0 12/13/2005 10:55:14 AM\|SETI@home\|Finished upload of 15ap04aa.22158.28690.261062.8_2_0 12/13/2005 10:55:14 AM\|SETI@home\|Throughput 33331 bytes/sec 12/13/2005 10:55:14 AM\|SETI@home\|Started upload of 30oc03ab.23657.2800.1034670.75_1_0 12/13/2005 10:55:16 AM\|SETI@home\|Finished upload of 15oc03aa.1719.30594.642322.254_2_0 12/13/2005 10:55:16 AM\|SETI@home\|Throughput 5760 bytes/sec 12/13/2005 10:55:17 AM\|SETI@home\|Started upload of 15oc03aa.1719.24097.748562.224_0_0 12/13/2005 10:55:24 AM\|SETI@home\|Finished upload of 30oc03ab.23657.2800.1034670.75_1_0 12/13/2005 10:55:24 AM\|SETI@home\|Throughput 19271 bytes/sec 12/13/2005 10:55:25 AM\|SETI@home\|Started upload of 15ap04aa.22158.15922.984656.143_2_0 12/13/2005 10:55:26 AM\|SETI@home\|Finished upload of 15oc03aa.1719.24097.748562.224_0_0 12/13/2005 10:55:26 AM\|SETI@home\|Throughput 9582 bytes/sec 12/13/2005 10:55:26 AM\|SETI@home\|Started upload of 15ap04aa.22158.16417.692336.243_3_0 12/13/2005 10:55:33 AM\|SETI@home\|Finished upload of 15ap04aa.22158.15922.984656.143_2_0 12/13/2005 10:55:33 AM\|SETI@home\|Throughput 15672 bytes/sec 12/13/2005 10:55:34 AM\|SETI@home\|Started upload of 15ap04aa.22158.5280.547170.158_2_0 12/13/2005 10:55:35 AM\|SETI@home\|Finished upload of 15ap04aa.22158.16417.692336.243_3_0 12/13/2005 10:55:35 AM\|SETI@home\|Throughput 14110 bytes/sec 12/13/2005 10:55:36 AM\|SETI@home\|Started upload of 20mr05aa.6043.22258.934666.165_0_0 12/13/2005 10:55:43 AM\|SETI@home\|Finished upload of 15ap04aa.22158.5280.547170.158_2_0 12/13/2005 10:55:43 AM\|SETI@home\|Throughput 28115 bytes/sec 12/13/2005 10:55:44 AM\|SETI@home\|Started upload of 13au01aa.6597.5825.953400.222_3_0 12/13/2005 10:55:47 AM\|SETI@home\|Finished upload of 20mr05aa.6043.22258.934666.165_0_0 12/13/2005 10:55:47 AM\|SETI@home\|Throughput 21594 bytes/sec 12/13/2005 10:55:48 AM\|SETI@home\|Started upload of 15oc03aa.1719.12865.229830.33_2_0 12/13/2005 10:55:54 AM\|SETI@home\|Finished upload of 13au01aa.6597.5825.953400.222_3_0 12/13/2005 10:55:54 AM\|SETI@home\|Throughput 14910 bytes/sec 12/13/2005 10:55:59 AM\|SETI@home\|Finished upload of 15oc03aa.1719.12865.229830.33_2_0 12/13/2005 10:55:59 AM\|SETI@home\|Throughput 7977 bytes/sec 12/13/2005 10:56:19 AM\|SETI@home\|Started upload of 15oc03aa.1719.11330.423578.65_2_0 12/13/2005 10:56:20 AM\|SETI@home\|Started upload of 21mr05aa.11076.31521.479830.60_4_0 12/13/2005 10:56:34 AM\|SETI@home\|Finished upload of 15oc03aa.1719.11330.423578.65_2_0 12/13/2005 10:56:34 AM\|SETI@home\|Throughput 13072 bytes/sec 12/13/2005 10:56:35 AM\|SETI@home\|Started upload of 13au01aa.6597.4913.997154.57_0_0 12/13/2005 10:56:36 AM\|SETI@home\|Finished upload of 21mr05aa.11076.31521.479830.60_4_0 12/13/2005 10:56:36 AM\|SETI@home\|Throughput 10241 bytes/sec 12/13/2005 10:56:37 AM\|SETI@home\|Started upload of 15ap04aa.22158.2753.292318.215_0_0 12/13/2005 10:56:47 AM\|SETI@home\|Finished upload of 13au01aa.6597.4913.997154.57_0_0 12/13/2005 10:56:47 AM\|SETI@home\|Throughput 12462 bytes/sec 12/13/2005 10:56:47 AM\|SETI@home\|Started upload of 15oc03aa.1719.10945.1003414.35_0_0 12/13/2005 10:56:52 AM\|SETI@home\|Finished upload of 15ap04aa.22158.2753.292318.215_0_0 12/13/2005 10:56:52 AM\|SETI@home\|Throughput 10411 bytes/sec 12/13/2005 10:56:52 AM\|SETI@home\|Started upload of 13au01aa.6597.5104.715898.85_3_0 12/13/2005 10:56:59 AM\|SETI@home\|Finished upload of 15oc03aa.1719.10945.1003414.35_0_0 12/13/2005 10:56:59 AM\|SETI@home\|Throughput 12486 bytes/sec 12/13/2005 10:56:59 AM\|SETI@home\|Started upload of 15oc03aa.1719.11041.336072.8_3_0 12/13/2005 10:57:02 AM\|SETI@home\|Finished upload of 13au01aa.6597.5104.715898.85_3_0 12/13/2005 10:57:02 AM\|SETI@home\|Throughput 11582 bytes/sec 12/13/2005 10:57:02 AM\|SETI@home\|Started upload of 21mr05ab.11361.23698.392322.87_3_0 12/13/2005 10:57:10 AM\|SETI@home\|Finished upload of 15oc03aa.1719.11041.336072.8_3_0 12/13/2005 10:57:10 AM\|SETI@home\|Throughput 22360 bytes/sec 12/13/2005 10:57:10 AM\|SETI@home\|Started upload of 20mr05aa.6043.14450.742326.47_0_0 12/13/2005 10:57:15 AM\|SETI@home\|Finished upload of 21mr05ab.11361.23698.392322.87_3_0 12/13/2005 10:57:15 AM\|SETI@home\|Throughput 7040 bytes/sec 12/13/2005 10:57:20 AM\|SETI@home\|Finished upload of 20mr05aa.6043.14450.742326.47_0_0 12/13/2005 10:57:20 AM\|SETI@home\|Throughput 18195 bytes/sec Yeppie. ID: 212510 ·

Jack Gulley Send message Joined: 4 Mar 03 Posts: 423 Credit: 526,566 RAC: 0	Message 212517 - Posted: 13 Dec 2005, 5:36:14 UTC I think they must have fixed a few performance problems that have been there all along that they did not realize they had. Uploads are going much better than expected. By looking at the shape of the Cogent "Average bits in" curve and its stepped decay rate, it suggests well over half of the outstanding uploads must have been completed already in only five hours. The data rate has already dropped to half of the peak transfer rate, with mostly results with longer back-offs coming in. The Status page numbers do not reflect that many being in, most likely because the transitioner is about 5 hours behind. From posts here, it sounds like those with results still in their transfer queue started with a very large number and/or had a lot hung ready to report waiting for the scheduler to catch up. Might be time to go ahead and hit the Retry on any result with a large back-off timeout. If it goes quickly and does not get backed off again, then the backlog is about cleared. Now we all want "DATA" to crunch. Best to wait until the transitioners are not so far behind. ID: 212517 ·

StokeyBob Send message Joined: 31 Aug 03 Posts: 848 Credit: 2,218,691 RAC: 0	Message 212555 - Posted: 13 Dec 2005, 6:18:22 UTC The work units go through like grapes through a goose when things are running right. ID: 212555 ·

Jack Gulley Send message Joined: 4 Mar 03 Posts: 423 Credit: 526,566 RAC: 0	Message 212564 - Posted: 13 Dec 2005, 6:44:59 UTC Yep. According to Matt's Technical note, the whole problem all along has been excessive overhead on the server trying to start each upload. The fix gets rid of most of the software overhead. Under heavy load they were only getting a few results uploaded per second. But under light load, they could do up to 35 per second. But with the "fix" they suddenly can do 90 result uploads per second under heavy load. That suggests there might still be some problems there to iron out later. Be interesting to see if they take the time to tweak what they have and get it up to handling 100 result uploads per second, which that hardware should be able to do. Makes for a snappy uploader that can handle a lot of growth, and no need for additional old hardware from Seti Classic. What bothers me is that I remember reading several months back during the last big upload outage, a description of this overhead problem by someone who had worked with those servers, and their suggestion on how to fix it. Exactly what they wound up doing. ID: 212564 ·

Mike Smith Send message Joined: 1 Aug 01 Posts: 8 Credit: 12,469 RAC: 0	Message 212579 - Posted: 13 Dec 2005, 7:26:20 UTC Yep all is coming back. Already onto the third unit since it came on. and the outbox at this end has been cleared. just has to catch up with all of the credits to each of us ID: 212579 ·

Francesco Forti Send message Joined: 24 May 00 Posts: 334 Credit: 204,421,005 RAC: 15	Message 212581 - Posted: 13 Dec 2005, 7:29:51 UTC so .....happy end ... as in all american story !!!! :) :) :) :) :) :) :) :) :) :) :) :) :) :) :) :) :) zero results tu upload ... and some PC is getting new work and is cruncing again. As far as normal scheduling is stablished, I will attach some new host (now attach is rejected). Bye, Francesco ID: 212581 ·

Zap de Ridder Volunteer tester Send message Joined: 9 Jan 00 Posts: 227 Credit: 1,468,844 RAC: 1	Message 212651 - Posted: 13 Dec 2005, 10:03:12 UTC Last modified: 13 Dec 2005, 10:04:29 UTC Message 210865 - Posted 11 Dec 2005 23:27:05 UTC [Edit this post] ..................................................... Wel it's not hard to forsee the future, lots of cheering about getting the credits in vast amounts when everything is resolved. Till then. Well cheering started already . LOL ID: 212651 ·

Daniel Schaalma Volunteer tester Send message Joined: 28 May 99 Posts: 297 Credit: 16,953,703 RAC: 0	Message 212677 - Posted: 13 Dec 2005, 10:51:27 UTC Let this be a lesson to all the naysayers. For those of us who have been here for a long time, we have found that just when it seems to be SETI BOINC's darkest hour, someone impliments a brilliant idea, and all is well again. Based upon experience with prior outages of this nature, as the one back in August, I thought it would have taken much longer to clear the backlog. But with the FastCGI idea, a WEEKS worth of pending result uploads were cleared in just a few HOURS. I always find it amazing as to what these people can accomplish with their tiny budget and just a handful of staff (only NINE people, and most of them part-time). My congrats to the Seti staff for a job WELL DONE! Take care, and happy crunching to all :) Regards, Daniel. ID: 212677 ·

Astro Volunteer tester Send message Joined: 16 Apr 02 Posts: 8026 Credit: 600,015 RAC: 0	Message 212698 - Posted: 13 Dec 2005, 11:25:48 UTC - in response to Message 212564. That suggests there might still be some problems there to iron out later. Be interesting to see if they take the time to tweak what they have and get it up to handling 100 result uploads per second, which that hardware should be able to do. Jack, the goal is to do 1 mil WUs a day(that's 4 M results), so they only need capacity for 46 uploads a second to handle that. I.E that's the most arecibo collects in a day. Unless someone corrects me here, I'm typing this before my first coffee. so I might be wrong ID: 212698 ·

Saimek Send message Joined: 25 Jan 00 Posts: 121 Credit: 454,423 RAC: 0	Message 212702 - Posted: 13 Dec 2005, 11:31:23 UTC All my result uploaded, got new work.. not much but i'm not complaining =) ID: 212702 ·

Sir Ulli Volunteer tester Send message Joined: 21 Oct 99 Posts: 2246 Credit: 6,136,250 RAC: 0	Message 212719 - Posted: 13 Dec 2005, 11:55:58 UTC - in response to Message 212677. Let this be a lesson to all the naysayers. For those of us who have been here for a long time, we have found that just when it seems to be SETI BOINC's darkest hour, someone impliments a brilliant idea, and all is well again. Based upon experience with prior outages of this nature, as the one back in August, I thought it would have taken much longer to clear the backlog. But with the FastCGI idea, a WEEKS worth of pending result uploads were cleared in just a few HOURS. I always find it amazing as to what these people can accomplish with their tiny budget and just a handful of staff (only NINE people, and most of them part-time). My congrats to the Seti staff for a job WELL DONE! Take care, and happy crunching to all :) Regards, Daniel. Well said Daniel btw all results uploaded, and get also a few new.. Greetings from Germany NRW Ulli ID: 212719 ·

Paul Hayslett Send message Joined: 3 Aug 00 Posts: 15 Credit: 14,207,862 RAC: 0	Message 212742 - Posted: 13 Dec 2005, 12:19:54 UTC Yeeeeeehaaaaaaahhhhh!!!!!!! A great big huge thank you to all who worked so hard on this!! ID: 212742 ·

hockeytown Send message Joined: 28 Sep 05 Posts: 160 Credit: 246,806 RAC: 0	Message 212782 - Posted: 13 Dec 2005, 13:11:32 UTC Last modified: 13 Dec 2005, 13:14:06 UTC thats cool all my uploads went in last night i just had 25 are so but its looking good thanks for the ones who worked hard to get it back and up and running may it go for sometime now latttttter hockeytown BLOOD BOUNCES ON ICE ID: 212782 ·

hemloche Send message Joined: 14 Oct 03 Posts: 26 Credit: 925,639 RAC: 0	Message 212810 - Posted: 13 Dec 2005, 13:43:53 UTC <insert WILHELM SCREAM HERE> OMGWTFBBQ!!!!!11!!!!!1!!!! my back log is cleared and a way we go1!!!@@@!#!!! Victoria Concordia Crescit ID: 212810 ·

Ingleside Volunteer developer Send message Joined: 4 Feb 03 Posts: 1546 Credit: 15,832,022 RAC: 13	Message 212847 - Posted: 13 Dec 2005, 14:27:19 UTC - in response to Message 212698. Jack, the goal is to do 1 mil WUs a day(that's 4 M results), so they only need capacity for 46 uploads a second to handle that. I.E that's the most arecibo collects in a day. Unless someone corrects me here, I'm typing this before my first coffee. so I might be wrong According to the Status-page, 1 block = 1.7 seconds, 48 blocks = 256 wu, and SETI@Home/BOINC generates 4 results/wu. Doing the math, it means Arecibo can max record 271k wu/day, this is roughly 1M results/day. This again means 12.55 results/second. With upload-server handling 90 results/second, it means upload-capasity is 7x. Of course, this is with Validator and Assimilator turned off, when these services is turned back on the capasity will very likely drop again... ID: 212847 ·

xiaket Send message Joined: 13 Oct 05 Posts: 3 Credit: 909,647 RAC: 0	Message 212862 - Posted: 13 Dec 2005, 14:37:39 UTC Well, i tried rosetta for the last few days. i'm happy to know that everything is getting back to normal now. Greetings from China, to anyone who fixed the problem. ^_^ ID: 212862 ·

Larry W. Heard Send message Joined: 13 Jan 05 Posts: 15 Credit: 8,208 RAC: 0	Message 212872 - Posted: 13 Dec 2005, 14:45:58 UTC THANK YOU, THANK YOU very much.... to whom was able to fix the upload/download problems for SETI.. Great job folks... ID: 212872 ·

upi Send message Joined: 31 May 02 Posts: 6 Credit: 652,414 RAC: 1	Message 212876 - Posted: 13 Dec 2005, 14:49:30 UTC Got four up and two down in! looks good. I hope that will still be OK when the validators are switched on again. Greetings from Germany, Berlin! Uwe ID: 212876 ·

©2025 University of California

SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.