Triple Shot Cappuccino Day (Jan 10 2008)

Message boards : Technical News : Triple Shot Cappuccino Day (Jan 10 2008)
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · Next

AuthorMessage
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 699241 - Posted: 11 Jan 2008, 16:20:19 UTC


. . . just came back up 'blazingly fast' - must be the Triple Shot Cappuccino's ;)


BOINC Wiki . . .

Science Status Page . . .
ID: 699241 · Report as offensive
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 699268 - Posted: 11 Jan 2008, 18:08:22 UTC

Ok, now that the web page is fixed, so why aren't the assimulators driving their queue to zero faster?
ID: 699268 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 699274 - Posted: 11 Jan 2008, 18:25:02 UTC - in response to Message 699228.  

Speaking of reassigning tasks:

Matt, could you be so kind and trash this wu? It's been causing trouble for me and all others who have been crunching it...

TIA

It's already reached "Too many errors" status so won't be sent out again. The only host still working on it is running BOINC 5.2.13, which doesn't support server aborts, so there's nothing for Matt to do.
                                                                Joe
ID: 699274 · Report as offensive
Wasabi Peanut
Avatar

Send message
Joined: 14 Jul 99
Posts: 62
Credit: 32,646,911
RAC: 0
Switzerland
Message 699283 - Posted: 11 Jan 2008, 18:51:26 UTC - in response to Message 699274.  

It's already reached "Too many errors" status so won't be sent out again. The only host still working on it is running BOINC 5.2.13, which doesn't support server aborts, so there's nothing for Matt to do.
                                                                Joe

Thanks, Joe, for pointing this out. I was actually thinking that boinc should take care of such situations by itself. Relieving.
ID: 699283 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 699313 - Posted: 11 Jan 2008, 19:36:13 UTC - in response to Message 699229.  

Since disk space and db performance is a hot issue on this thread and the right people are here, would someone review for me why I have so many validated wu's remaining when I review my computers each morning?


That would be the assimilation process getting behind... That was the discussion about the optimized application which turned into possibly a bad host... The WUs have to be assimilated before they can be deleted/purged, and so if they're not assimilated, they can't be deleted/purged... ;-)


Thanks. Is there a target value for the number waiting to be assimulated, or is it that they don't have enough assimulator processes launched to catch up and force the average number toward zero.

According to the good old Scarecrow graphs, the assimilator queue has been steadily reducing since about 06:00 UTC today. It should carry on down to an effective zero (no lower bound), but clearly not very quickly. Maybe Matt will have to build some more copies, and find a server to run them on, if/when he gets the Cisco bottleneck sorted out and they recruit all the extra volunteers they're looking for.
ID: 699313 · Report as offensive
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 699340 - Posted: 11 Jan 2008, 21:00:57 UTC

Thanks. I guess that it comes down to have enough assimulators running and there is no desire to keep validated results hanging around.

Is there a succinct description of what causes the purge queues to be so large? Purge means to me that the buggers are waiting to be deleted, and so I get that confused with the assimulators, I guess.
ID: 699340 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 699368 - Posted: 11 Jan 2008, 22:07:31 UTC - in response to Message 699340.  
Last modified: 11 Jan 2008, 22:08:14 UTC

Thanks. I guess that it comes down to have enough assimulators running and there is no desire to keep validated results hanging around.

Is there a succinct description of what causes the purge queues to be so large? Purge means to me that the buggers are waiting to be deleted, and so I get that confused with the assimulators, I guess.

The purge queues are deliberately set at 1 day elapsed time, so that people like you and me get a chance to look at our results before they disappear for good. If the assimilation delay is zero (as it normally is), then the purge queue gives an idea of the 24-hour turnover - 900,000 results, or 450,000 WUs, on average: more during a shorty storm.
ID: 699368 · Report as offensive
John Twohy
Volunteer tester

Send message
Joined: 21 Dec 07
Posts: 9
Credit: 2,058,932
RAC: 0
United States
Message 699405 - Posted: 11 Jan 2008, 23:46:52 UTC

Oh it looks like I had two work units but kicked out do to this
NOTE: The number of results detected exceeds the storage space allocated.

so I update my client drive space to 75gig's
ID: 699405 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 699408 - Posted: 12 Jan 2008, 0:00:54 UTC - in response to Message 699405.  

Oh it looks like I had two work units but kicked out do to this
NOTE: The number of results detected exceeds the storage space allocated.

so I update my client drive space to 75gig's

NO, the "storage space" referred to in that message is not disk space.

You probably also saw the line
SETI@Home Informational message -9 result_overflow

on the line above.

The programmers allowed for a maximum of 30 data points (Spike, Pulse, Triplet, Gaussian) in any one result - any more than that, and the program doesn't bother to waste any more time on it: it ends early, and moves on to the next one.

You'll probably see that your 'wingman' also finished early, with the same message. Occasionally, however, one host finds 31 pulses - it's only ever pulses - and finishes early, while a different host runs the normal time and finds far fewer. That's a known (but rare and unusual) bug that the programmers are trying to track down - don't worry about it, it's not your fault.
ID: 699408 · Report as offensive
Profile Michael Sinatra

Send message
Joined: 23 Jul 07
Posts: 11
Credit: 5,173
RAC: 0
United States
Message 699419 - Posted: 12 Jan 2008, 0:52:44 UTC - in response to Message 698985.  


Just between you and me... In addition to the outbound traffic squeezing through our maxed-out router, I am now sneaking our an additional 5-10% over the campus net. This is thanks to the simple/useful "pound" load balancing utility. The campus net can definitely handle this tiny increase. In fact I might bump up the percentage. But don't tell anybody. Mwha ha ha. [edit: I brought that percentage back down to 0% an hour later - we'll keep this extra power in our back pocket for now.]


And who do you think is reading these forums?
ID: 699419 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 699448 - Posted: 12 Jan 2008, 2:32:05 UTC - in response to Message 699419.  


Just between you and me... In addition to the outbound traffic squeezing through our maxed-out router, I am now sneaking our an additional 5-10% over the campus net. This is thanks to the simple/useful "pound" load balancing utility. The campus net can definitely handle this tiny increase. In fact I might bump up the percentage. But don't tell anybody. Mwha ha ha. [edit: I brought that percentage back down to 0% an hour later - we'll keep this extra power in our back pocket for now.]


And who do you think is reading these forums?


Well... you and me. ;-)
ID: 699448 · Report as offensive
Brian Silvers

Send message
Joined: 11 Jun 99
Posts: 1681
Credit: 492,052
RAC: 0
United States
Message 699450 - Posted: 12 Jan 2008, 2:35:13 UTC - in response to Message 699448.  


Just between you and me... In addition to the outbound traffic squeezing through our maxed-out router, I am now sneaking our an additional 5-10% over the campus net. This is thanks to the simple/useful "pound" load balancing utility. The campus net can definitely handle this tiny increase. In fact I might bump up the percentage. But don't tell anybody. Mwha ha ha. [edit: I brought that percentage back down to 0% an hour later - we'll keep this extra power in our back pocket for now.]


And who do you think is reading these forums?


Well... you and me. ;-)


Me too...

:gets out old AOL 3.5" floppy disk:
ID: 699450 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 699453 - Posted: 12 Jan 2008, 2:48:42 UTC - in response to Message 699340.  

Thanks. I guess that it comes down to have enough assimulators running and there is no desire to keep validated results hanging around.

Is there a succinct description of what causes the purge queues to be so large? Purge means to me that the buggers are waiting to be deleted, and so I get that confused with the assimulators, I guess.

Remember that some of this is a balancing act: when you "speed up" the assimilators, that means less resources for splitters, schedulers, validators, etc.

One might decide to let the validator queue grow in order to split more work and keep feeding the hungry crunchers.
ID: 699453 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 699481 - Posted: 12 Jan 2008, 4:44:24 UTC

Oh, come on now.......
I have read the forums, and everybody knows that Seti has unlimited server and bandwidth resources available....they are just taunting us....LOL...LOL...LOL...
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 699481 · Report as offensive
John Twohy
Volunteer tester

Send message
Joined: 21 Dec 07
Posts: 9
Credit: 2,058,932
RAC: 0
United States
Message 699488 - Posted: 12 Jan 2008, 5:04:29 UTC

Darn you mean that all misunderstaning of this that and the other thing, was all because someone didn't prof read the code program? oh well just onther excuse to build and expand the gamer computer, I do see when my chip gets a little on the hot side, is when those little nice fine pen like frequency levels in the lower levels graphics get to be wider and over bound. right or is that part of the program too?
ID: 699488 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 699595 - Posted: 12 Jan 2008, 17:21:38 UTC - in response to Message 699419.  

Wow. Busy thread. Some responses.

The assimilator queues are lagging due to simultaneous index builds on the science database - so some I/O contention. No problems. They'll push through eventually.

I'm surprised you answered at midnight your time...


Well, computer geek by day, musician by night. My schedule is quite erratic and I check in whenever I can but make no 24/7 guarantees.

And who do you think is reading these forums?


The cheekiness was for entertainment - I know we're being watched. Anyway my "fix" was really to see how much we needed to push beyond our current cap (or if we even could). I thought it was going to be like 1-2 Mbits that would get lost in the noise. Nope - more like 6-10. That's why I shut it off.

- Matt


-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 699595 · Report as offensive
Profile Clyde C. Phillips, III

Send message
Joined: 2 Aug 00
Posts: 1851
Credit: 5,955,047
RAC: 0
United States
Message 699629 - Posted: 12 Jan 2008, 19:55:12 UTC

I don't waste money on cappuccinos. Caffeine tablets do the job and cost only about 1/50 as much.
ID: 699629 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 699718 - Posted: 13 Jan 2008, 6:50:13 UTC - in response to Message 699488.  

Darn you mean that all misunderstaning of this that and the other thing, was all because someone didn't prof read the code program? oh well just onther excuse to build and expand the gamer computer, I do see when my chip gets a little on the hot side, is when those little nice fine pen like frequency levels in the lower levels graphics get to be wider and over bound. right or is that part of the program too?

No, this is a design decision.

It was decided that any result with more than 30 Spikes, Pulses, Triplets, and/or Gaussians was probably hearing a terrestrial signal source, and as such would show an unusually high number of signs of intelligence -- that we already know about.

... assuming of course that mankind is intelligent, which is another debate.
ID: 699718 · Report as offensive
Profile Uioped1
Volunteer tester
Avatar

Send message
Joined: 17 Sep 03
Posts: 50
Credit: 1,179,926
RAC: 0
United States
Message 700034 - Posted: 14 Jan 2008, 17:33:38 UTC

Are the SQL queries that Mat referenced in the source tree? If they are, can someone point them out to me? (maybe I missed them because they're embedded in code...) A quick scan of the svn web interface didn't turn up anything obvious.

Thanks!
ID: 700034 · Report as offensive
Profile John Neale
Volunteer tester
Avatar

Send message
Joined: 16 Mar 00
Posts: 634
Credit: 7,246,513
RAC: 9
South Africa
Message 700080 - Posted: 14 Jan 2008, 20:57:21 UTC - in response to Message 699408.  

Occasionally, however, one host finds 31 pulses - it's only ever pulses - and finishes early, while a different host runs the normal time and finds far fewer. That's a known (but rare and unusual) bug that the programmers are trying to track down - don't worry about it, it's not your fault.


Here's an example of one of the "rare and unusual" workunits.

Thus far, my rig has returned no pulses, but two others (here and here) have each returned 31 pulses.

I post this in the hope that it might assist the programmers in tracking down the bug.
ID: 700080 · Report as offensive
Previous · 1 · 2 · 3 · Next

Message boards : Technical News : Triple Shot Cappuccino Day (Jan 10 2008)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.