Fast One (May 16 2007)

Message boards : Technical News : Fast One (May 16 2007)
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 . . . 14 · Next

AuthorMessage
Profile TomUrich
Avatar

Send message
Joined: 10 Feb 07
Posts: 1
Credit: 30,658
RAC: 0
Germany
Message 569397 - Posted: 17 May 2007, 13:08:07 UTC - in response to Message 569009.  

Quick note as I gotta catch a bus..

Gotta go..

- Matt


Thanks, Matt. I've got results stuck in the Transfer Queue for over a week now and they stay at about 1.80% completed (??) What's up with that?

- Tom
ID: 569397 · Report as offensive
Profile Raymond Auricchio

Send message
Joined: 11 Sep 99
Posts: 1
Credit: 73,650
RAC: 0
United States
Message 569401 - Posted: 17 May 2007, 13:09:26 UTC - in response to Message 569009.  

Quick note as I gotta catch a bus..

Wow - what a mess. I think we're in the middle of our biggest outage recovery to date, and it's breaking everything. The good news is we're coming into some newer hardware which we'll get on line to help somehow.

See Eric's thread in the Staff Blog. He's been working overtime getting a new frankenstein machine together to act as another upload/download server and reduce the load on bruno. The scheduling server (galileo) has been choking - I just now moved all that over to bruno as well. So we may retire galileo soon, too. Jeff has been going nuts trying to track down errors in validator/assimilator code so we can get those on line as well. And our old friend "slow feeder query" is back, probably just being aggravated by the heavy load.

Gotta go..

- Matt

mat please send this to jeff just a little before day light saveings time is when things started going down hill with work units and creddits also when the new server came on line i had a 2nd system i put on line i had down loded pleanty of work units but the new bonic on 2nd system needed 6 files to run
that took days to get copying and copyright this one was in seti projects and 3 outhers libffw3f.
but i bet you all ready know that sorry for bugging you just wanted to let you know happy hunting
ID: 569401 · Report as offensive
Brian Silvers

Send message
Joined: 11 Jun 99
Posts: 1681
Credit: 492,052
RAC: 0
United States
Message 569431 - Posted: 17 May 2007, 13:33:00 UTC - in response to Message 569367.  


There is "exponential backoff" built into the Boinc manager that is designed to avoid giving a Boinc project a DDoS from its own clients. Perhaps that feature needs to be looked at again...


I have had some PMs with someone and what they thought of sounds good, but with the open-sourceness, it could be hacked. Of course, those that would hack it would be significantly smaller in number to those who didn't...so it would likely work just fine.

Also, I mentioned PacketShaper to Eric yesterday. He said he would ask Matt and Jeff... That's over in the blog (the "tuna fish" post)...
ID: 569431 · Report as offensive
Profile Peter Söderlund
Avatar

Send message
Joined: 31 May 99
Posts: 33
Credit: 1,744,426
RAC: 0
Sweden
Message 569436 - Posted: 17 May 2007, 13:39:04 UTC

Hi.

I dont know is anybody else have the same problem that I have!

When I goes to seti@home from the Boinc manager, I don't got the recent Web pages. The pages that opens is from the 13:th may???
ID: 569436 · Report as offensive
Michael Connolly

Send message
Joined: 18 May 99
Posts: 1
Credit: 1,436,122
RAC: 32
United Kingdom
Message 569438 - Posted: 17 May 2007, 13:42:29 UTC - in response to Message 569367.  

There is "exponential backoff" built into the Boinc manager that is designed to avoid giving a Boinc project a DDoS from its own clients. Perhaps that feature needs to be looked at again...

I've noticed this in the past, but since I started half an hour ago it's all been one minute backoffs like this:

17/05/2007 15:36:17|SETI@home|Scheduler request failed: couldn't connect to server
17/05/2007 15:36:17|SETI@home|Deferring scheduler requests for 1 minutes and 0 seconds
17/05/2007 15:37:17|SETI@home|Sending scheduler request to http://setiboinc.ssl.berkeley.edu/sah_cgi/cgi
17/05/2007 15:37:17|SETI@home|Reason: To report completed tasks
17/05/2007 15:37:17|SETI@home|Reporting 1 tasks

ID: 569438 · Report as offensive
Profile Mephist0
Volunteer tester

Send message
Joined: 4 Dec 99
Posts: 12
Credit: 1,401,540
RAC: 0
Sweden
Message 569464 - Posted: 17 May 2007, 14:08:46 UTC - in response to Message 569397.  

Quick note as I gotta catch a bus..

Gotta go..

- Matt


Thanks, Matt. I've got results stuck in the Transfer Queue for over a week now and they stay at about 1.80% completed (??) What's up with that?

- Tom


Just be patient.. It's because all traffic load... This morning (4 hours ago) everything was looking better, i got 3 new WU and done WU were reported to SETI.. But now something seemed to have happend again.. So just be patient... :)
ID: 569464 · Report as offensive
Profile Dr.Okun_@_SETI.USA
Volunteer tester

Send message
Joined: 15 Dec 06
Posts: 7
Credit: 149,128
RAC: 0
United States
Message 569470 - Posted: 17 May 2007, 14:19:22 UTC

Perhaps they should consider tabling astropulse and use that portion of the budget to purchase more servers.
ID: 569470 · Report as offensive
Profile Fuzzy Hollynoodles
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 9659
Credit: 251,998
RAC: 0
Message 569484 - Posted: 17 May 2007, 14:33:38 UTC - in response to Message 569470.  
Last modified: 17 May 2007, 14:33:54 UTC

Perhaps they should consider tabling astropulse and use that portion of the budget to purchase more servers.


I don't know much about the grant system over there, but AstroPulse is funded in part by the NSF through grant AST-0307956 (See at the bottom on the page). I don't think those who grant the grants would be happy if the receiving scientist transfer the money to other projects?


I think money and hardware donations to this project is the way of helping out with the problems.

So please donate. For money donations please click the links in my sig. Thank you.


"I'm trying to maintain a shred of dignity in this world." - Me

ID: 569484 · Report as offensive
Profile Demiurg
Volunteer tester
Avatar

Send message
Joined: 2 Jul 02
Posts: 883
Credit: 28,286
RAC: 0
Sweden
Message 569496 - Posted: 17 May 2007, 14:42:14 UTC - in response to Message 569484.  
Last modified: 17 May 2007, 14:48:15 UTC

Perhaps they should consider tabling astropulse and use that portion of the budget to purchase more servers.


I don't know much about the grant system over there, but AstroPulse is funded in part by the NSF through grant AST-0307956 (See at the bottom on the page). I don't think those who grant the grants would be happy if the receiving scientist transfer the money to other projects?


I think money and hardware donations to this project is the way of helping out with the problems.

So please donate. For money donations please click the links in my sig. Thank you.



Good morning Fuzzy!

I never meant that they should transfer funds between projects. But that grant is in part helping with the infrastructure of the project.

So keap on clicking below:-) Or ontop of me on the beautiful Sig of Fuzzy!
It is SEXY to DONATE!
Skype = demiurg2
ID: 569496 · Report as offensive
Profile Dr.Okun_@_SETI.USA
Volunteer tester

Send message
Joined: 15 Dec 06
Posts: 7
Credit: 149,128
RAC: 0
United States
Message 569498 - Posted: 17 May 2007, 14:42:28 UTC

Project/Task
Subtotal
Total

SETI@home I


$65,700

Offline Data Analysis & RFI Rejection
$22,000



Candidate Identification
37,500



Followup Observations of Best Candidates
6,200



SETI@home II


149,200

New Client Application Software Development
98,800



Candidate Identification & Data Analysis Software
50,400



Astropulse ¹


92,700

Client application/data analysis software development
45,000



Equipment: Database and server hardware
19,400



Candidate identification and followup observations
28,300



Operations


230,400

Internet connection and bandwidth charges
59,700



Database administration and support
48,500



Systems administration and support
62,800



Server maintainence and preformance monitoring
20,900



Web site development
25,200



Upgrade to failure tolerant server configuration
13,300





Total
538,000


Astropulse
The current SETI@home application looks for signals that are narrow in frequency, but have long duration. That's one way that an extraterrestrial civilization can send a signal that stands up above the radio background noise. Another possibility is that they could put a lot of power into a short duration pulsed signal that has a wide bandwidth. As such a pulse travels through intestellar space, interactions with interstellar matter slow down low frequencies relative to high frequencies in a process called dispersion. This dispersion spreads the pulse out over time. If we know how much dispersion a pulse has experienced, we can correct for this effect. For an extraterrestrial signal we won't know how much interstellar matter the signal interacted with on its journey, therefore we have to try every possible dispersion measure. That takes a lot of computing time.

Astropulse is a SETI@home application that uses coherent dedispersion to search for pulsed signals. In addition to extraterrestrial signals we might see signs of evaporating black holes or discover new pulsars. You can read more about Astropulse here .

Both Astropulse AND current seti@home use the same servers, perhaps they both benefit if not having to go down due to equipment failure. I am sure the NSF assumed the computers were functional when they funded the project and that they would need upgrading at some point. Has anyone attempted to gain new funding from the NSF for server upgrades?
ID: 569498 · Report as offensive
Profile Demiurg
Volunteer tester
Avatar

Send message
Joined: 2 Jul 02
Posts: 883
Credit: 28,286
RAC: 0
Sweden
Message 569503 - Posted: 17 May 2007, 14:47:22 UTC - in response to Message 569498.  

Total
538,000


Astropulse
The current SETI@home application looks for signals that are narrow in frequency, but have long duration. That's one way that an extraterrestrial civilization can send a signal that stands up above the radio background noise. Another possibility is that they could put a lot of power into a short duration pulsed signal that has a wide bandwidth. As such a pulse travels through intestellar space, interactions with interstellar matter slow down low frequencies relative to high frequencies in a process called dispersion. This dispersion spreads the pulse out over time. If we know how much dispersion a pulse has experienced, we can correct for this effect. For an extraterrestrial signal we won't know how much interstellar matter the signal interacted with on its journey, therefore we have to try every possible dispersion measure. That takes a lot of computing time.

Astropulse is a SETI@home application that uses coherent dedispersion to search for pulsed signals. In addition to extraterrestrial signals we might see signs of evaporating black holes or discover new pulsars. You can read more about Astropulse here .

Both Astropulse AND current seti@home use the same servers, perhaps they both benefit if not having to go down due to equipment failure. I am sure the NSF assumed the computers were functional when they funded the project and that they would need upgrading at some point. Has anyone attempted to gain new funding from the NSF for server upgrades?


I was talking about grants this morning with some american collegues working while I was down in CERN. In europe it takes about half a year to get a grant and if I understod correctly an NSF-grant takes way longer. SO I guess they might go for a renewed grant in the end but...

For the time being do this:-)
Tickle my link you little naughties!
It is SEXY to DONATE!
Skype = demiurg2
ID: 569503 · Report as offensive
bress

Send message
Joined: 7 Apr 01
Posts: 3
Credit: 191,118
RAC: 0
Germany
Message 569524 - Posted: 17 May 2007, 15:05:35 UTC - in response to Message 569342.  

Looks as though everything is back to normal, uploading and downloading no problems here. Well done chaps.


unfortunately different from what i experience here...

seems like yesterday evening one of my machines was able to upload two WUs, but none was able to download new work. additionally, the "uploaded" work seems to have disappeared, at least i can't find any clue in my stats...

so i just can hope, the WUs are at least somewhere in the system and that last week's work hasn't been for nothing...


keeping my fingers crossed for the guys doing a damn good job solving this avalanche of problems...
ID: 569524 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 569545 - Posted: 17 May 2007, 15:25:26 UTC - in response to Message 569397.  

Quick note as I gotta catch a bus..

Gotta go..

- Matt


Thanks, Matt. I've got results stuck in the Transfer Queue for over a week now and they stay at about 1.80% completed (??) What's up with that?

- Tom

Upload transfers start with a POST of about 283 bytes telling the server which result is being sent, if the upload server says OK then the actual result file is POSTed. The 1.80% probably indicates that initial part was sent and your BOINC core client is for some unknown reason still waiting for the upload server to reply. That should time out in a few minutes, but I've seen a few other posts indicating it sometimes doesn't.

I suggest temporarily changing to "No network activity" to clear those stuck transfers, then back to the normal setting.
                                                              Joe
ID: 569545 · Report as offensive
Profile Fuzzy Hollynoodles
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 9659
Credit: 251,998
RAC: 0
Message 569549 - Posted: 17 May 2007, 15:29:54 UTC - in response to Message 569498.  
Last modified: 17 May 2007, 15:36:00 UTC

...

Both Astropulse AND current seti@home use the same servers, perhaps they both benefit if not having to go down due to equipment failure. I am sure the NSF assumed the computers were functional when they funded the project and that they would need upgrading at some point. Has anyone attempted to gain new funding from the NSF for server upgrades?


Yes, and the scientist Eric Korpela is managing both, Astropulse is solely his baby though.

I know for sure that they have applied for grants, with no luck. Seti@Home hasn't got any grants for year, where BOINC is relatively well funded.

Back in January I posted this on several teamboards:

From here

Eric Korpela, Forum moderator, Project administrator,Project developer,Project scientist, explains:


Whoa.... Been reading the thread. I wasn't aware that Seti was in such dire straits. I guess I assumed that most of Seti was backed by Universities and grants.


First we need to make the distinction between SETI@home and SETI. SETI is not an organization, SETI is a field of study. There is no centralized organization running SETI efforts. You may have heard of the SETI Institute. They are not SETI. In fact, most of the people working there have never done any SETI related work.

SETI@home is one SETI project run by the UC Berkeley SETI group. In terms of scientific staff, the Berkeley SETI group is me and Dan Werthimer. Matt Lebofsky and Jeff Cobb form the remainder of the staff. David Anderson is running the BOINC program and advises SETI@home. We have a systems adminsitrator that that is leaving on tuesday because (even if we had ample money) the pay rates for systems administrators at the University don't come close to matching private industry. And we aren't allowed to pay more than the University will let us. (Actually is the state that prevents us from giving raises. Even though we aren't funded through taxes, the University considers us to be part of the overall budget)


That's it, really. 5 people. Less than 3 FTEs.

SETI@home is entirely funded by donations. Most of these donations come from people who also run SETI@home. Universities don't really "back" anybody. Faculty at Univerisities and expected to bring in their own funding. If Dan and I don't bring in money, we don't get paid, but we still keep our jobs (without pay). Matt and Jeff get a pink slip. In exchange for a cut of that funding, the universities provide offices and keep the lights on.

The NSF and NASA currently do not fund any SETI observing programs. At least none that I am aware of. Nor does any other government agency. We submit grant applications to the NSF Galactic Astronomy program, but we are unlikely to get funding. The sorry truth is that the $500,000 per year needed to keep SETI@home running is very large fraction the entire annual NSF Galactic Astronomy budget. The proposals are reviewed by other Astronomers, none of whom work on SETI. They naturally would prefer that the funding remain in the areas of astronomy in which they work. These are also predominantly astronomers who are Professors who get paid by the University for "teaching" in during the school year. (Even though the bulk of astronomy professors rarely teach). Therefore they frown upon paying "senior personnel" with the money they control. And because of earmarks that happened last year, the NSF Astronomy budget is getting squeezed.

Previously SETI@home was funded by corporate donations and matching funds a state program run by the UC Office of the President. SETI@home does not currently have any corporate donors that provide financial donations. Therefore we are entirely dependent on donation which predominantly come from people who run SETI@home.

Regarding to potential of finding wealthy sponsors. We, unfortunately, are forbidden from contacting most wealthy individuals directly unless we have a current relationship with them (i.e. they run SETI@home) or if they contact us. This policy is set by the U.C. Office of the President because the U.C. President prefers to direct such funding toward projects he wants funded. (i.e. a new business school, a new building for biological sciences, whatever else the president wants as his legacy). Funding SETI@home won't get the U.C. President a statue on Sproul plaza. Many wealthy donors to the University also want a lasting (concrete) legacy. Funding projects rather than buildings doesn't really cause letters to appear in granite cornerstones.


I was under the assumption that it was managed by people skilled in the area of management.




Dan and I have many, many years of experience in project management. The other half of my time, I'm an ultraviolet astronomer that manages the development of instruments for space missions. Being a skilled project manager doesn't help when you can't afford to pay people. You can't hire people until you have enough money to pay then. The University is pretty strict about that.


Why donate to a project when the core business or mission isn't being looked after. On the other hand, there is a need to introduce something new to entice more funding which in turn will provide the needs to return to the original mission.
Am I seeing this correctly so far in basic terms?



I think you are seeing it pretty well. Unfortunately with a staff of 3 FTEs we end up chasing fires a lot of the time rather than doing new things, and without money we can't hire more staff. Server outages are bad press, so keeping them running is high on the priority list (and is certainly part of the core mission). We will have some new things to announce this year, but how many and when is a question I can't yet answer.
--
Eric


_______________________________________________________________



I mailed Dr. Anderson and asked him for a statement to post here as a comment to this, and he was so kind to answer me.

Dr. David Anderson said:

To Eric's excellent post, I would only add:

1) SETI@home's scientific progress is limited by money,
and it has made slow progress in the last several years.
To each BOINC participant:
carefully examine the list of volunteer computing projects,
and decide which of them is doing the most good.
(This is a personal decision - it depends on your beliefs and values).
By promoting the idea of "cross-project" credit totals,
we have tried to eliminate the incentive to stick
with one project indefinitely.

And also, in response to some of the posts:

2) Buying items from the SETI@home store brings a small
amount of money to SETI@home, but it is much more cost-effective
to contribute directly.

-- David


________________________________________________________


Thank you David for taking the time for this. It's very much appreciated.




For your info, the questions about items bought in the Seti store was brought up on the BOINC Synergy forum, which I linked to him to see, so he addressed this also.


I hope this answers your questions.


"I'm trying to maintain a shred of dignity in this world." - Me

ID: 569549 · Report as offensive
Profile Demiurg
Volunteer tester
Avatar

Send message
Joined: 2 Jul 02
Posts: 883
Credit: 28,286
RAC: 0
Sweden
Message 569556 - Posted: 17 May 2007, 15:39:48 UTC

And I think it is really sad...

Carl
It is SEXY to DONATE!
Skype = demiurg2
ID: 569556 · Report as offensive
Profile Fuzzy Hollynoodles
Volunteer tester
Avatar

Send message
Joined: 3 Apr 99
Posts: 9659
Credit: 251,998
RAC: 0
Message 569565 - Posted: 17 May 2007, 15:55:06 UTC

I just got a message telling that there is a proposal deadline at the end of this month and again in the end of June. So while they are working very hard on solving the problems here, they also need to take time off to write the proposals for grants.

So, for the staff here:




"I'm trying to maintain a shred of dignity in this world." - Me

ID: 569565 · Report as offensive
Profile Dingo
Volunteer tester
Avatar

Send message
Joined: 28 Jun 99
Posts: 104
Credit: 16,364,896
RAC: 1
Australia
Message 569566 - Posted: 17 May 2007, 15:57:47 UTC - in response to Message 569565.  

Thanks for the update, and the hard work....

Proud Founder and member of



Have a look at my WebCam
ID: 569566 · Report as offensive
zombie67 [MM]
Volunteer tester
Avatar

Send message
Joined: 22 Apr 04
Posts: 758
Credit: 27,771,894
RAC: 0
United States
Message 569594 - Posted: 17 May 2007, 16:16:24 UTC - in response to Message 569342.  

Looks as though everything is back to normal, uploading and downloading no problems here. Well done chaps.

Wait... You got WUs to *download*? I haven't received anything but "internal error" or "out of work".

I assumed that downloads were turned off for the time being.
Dublin, California
Team: SETI.USA
ID: 569594 · Report as offensive
Profile ofp1

Send message
Joined: 5 Jan 01
Posts: 5
Credit: 59,369,927
RAC: 0
Venezuela
Message 569602 - Posted: 17 May 2007, 16:20:33 UTC - in response to Message 569009.  

Quick note as I gotta catch a bus..

Gotta go..

- Matt

Thanks for your dedication just do what you have to do to solve the problems ...

Some of my machines have downloaded Wu's and are crunching, many results have uploaded but are in the pending credit list
ID: 569602 · Report as offensive
bress

Send message
Joined: 7 Apr 01
Posts: 3
Credit: 191,118
RAC: 0
Germany
Message 569634 - Posted: 17 May 2007, 16:43:27 UTC - in response to Message 569524.  

Looks as though everything is back to normal, uploading and downloading no problems here. Well done chaps.


unfortunately different from what i experience here...

seems like yesterday evening one of my machines was able to upload two WUs, but none was able to download new work. additionally, the "uploaded" work seems to have disappeared, at least i can't find any clue in my stats...

so i just can hope, the WUs are at least somewhere in the system and that last week's work hasn't been for nothing...


keeping my fingers crossed for the guys doing a damn good job solving this avalanche of problems...



okay guys, forget about the thing with "disappeared" WUs... haven't been doing anything with S@H for a long time, didn't see the "credit pending" in my stats...

O;-)
ID: 569634 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 . . . 14 · Next

Message boards : Technical News : Fast One (May 16 2007)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.