Message boards :
Technical News :
Well Well (Oct 29 2009)
Message board moderation
Author | Message |
---|---|
Matt Lebofsky Send message Joined: 1 Mar 99 Posts: 1444 Credit: 957,058 RAC: 0 |
As predicted the data well temporarily ran dry overnight, but I'm trying my best to keep up with demand today (and set it up for over the weekend). Weird thing today - I've been noticing intermittent problems connecting to the science database to make the most trivial queries. We thought this, and the assimilator queue backing up, were probably due to Bob's recent configuration changes to the informix database engine perhaps not helping so much. But then I noticed one of assimilators was inserting thousands and thousands of signals as fast as it possibly could from a single result file... since 7:40am yesterday morning! This is not normal. Result files usually contain a handful of signals, maybe a few dozen tops. If they reach 30K in size they are automatically "cut off" and sent back to us. I tracked down the result file with all the signals - it was 1.6 gigabytes in size! Not sure how this happened, nor how it passed validation (though I have my theories), but it sure contained a lot of signals repeated over and over and over again. I moved that out of the way and hopefully that'll improve performance in general around here. - Matt -- BOINC/SETI@home network/web/science/development person -- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude |
Dirk Sadowski Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
You remember the movie 'Contact'? Hey, maybe we got now an instructions for to make a machine for to visit extraterrestrial intelligence? ;-D BTW. Thanks for the daily TNews. |
52 Aces Send message Joined: 7 Jan 02 Posts: 497 Credit: 14,261,068 RAC: 67 |
Someone !AND! their wingman sent back a 1.6 gig result file? wow. (Not that you can fit 1.6 gig into either a 366k WU or 8meg AP, at least not without a loop bug) |
Dirk Sadowski Send message Joined: 6 Apr 07 Posts: 7105 Credit: 147,663,825 RAC: 5 |
|
Josef W. Segur Send message Joined: 30 Oct 99 Posts: 4504 Credit: 1,414,761 RAC: 0 |
Someone !AND! their wingman sent back a 1.6 gig result file? wow. The way the data is analyzed involves going through it many times at different chirp rates and FFT lengths, or dedispersions for AP, so it is definitely possible a task could generate billions of signals. But as Matt noted the signals were duplicates, and that also explains why the result could validate against a normal result since the validator simply checks whether there's a matching signal in the wingmate result. IOW, the validator doesn't do sanity checks, simply signal comparison. How that many duplicates were generated without the overflow limit of 31 for MB or 60 for AP being tripped remains a puzzle, as is the failure of BOINC to refuse to upload the file since it exceeded both the 64 KB Enhanced size limit and the 640 KB AP size limit. It almost seems like the file system looped while writing a signal to the outfile, rather than any problem with BOINC or the S@H application. Joe |
ML1 Send message Joined: 25 Nov 01 Posts: 21249 Credit: 7,508,002 RAC: 20 |
Someone !AND! their wingman sent back a 1.6 gig result file? wow. ... I very much doubt that. Much more likely is that locally a s@h backend spasm magically made the 1.6GB 'appear'. Time to run a fsck?... Regards, Martin See new freedom: Mageia Linux Take a look for yourself: Linux Format The Future is what We all make IT (GPLv3) |
DJStarfox Send message Joined: 23 May 01 Posts: 1066 Credit: 1,226,053 RAC: 2 |
That would be really funny if the instructions for a machine to visit ET were in that WU. Do you have a link to this WU in question? Yes, time to run fsck as a preventative measure. |
Jim Herod Send message Joined: 23 Apr 99 Posts: 21 Credit: 12,409,544 RAC: 4 |
Change that 1.6GB file's extension to .pdf and see if Acrobat Reader will open it. Should be about the right size for a set of blueprints. |
zpm Send message Joined: 25 Apr 08 Posts: 284 Credit: 1,659,024 RAC: 0 |
Change that 1.6GB file's extension to .pdf and see if Acrobat Reader will open it. Should be about the right size for a set of blueprints. or make it a powerpoint. instructions to the Enterprise-E... LOL! I recommend Secunia PSI: http://secunia.com/vulnerability_scanning/personal/ Go Georgia Tech. |
CryptokiD Send message Joined: 2 Dec 00 Posts: 150 Credit: 3,216,632 RAC: 0 |
thanks for the update matt. i am glad i decided to queue up a few thousand workunits. i had a feeling we would be running out before halloween. is there going to be much work units left? im kind of wondering how long it's going to be that we are super low on seti work. thanks ! |
Chris Send message Joined: 7 Oct 09 Posts: 1 Credit: 21,269 RAC: 0 |
Matt- This is not the result of a pattern is it? |
multiplex81 Send message Joined: 21 Oct 09 Posts: 1 Credit: 126,470 RAC: 0 |
Change that 1.6GB file's extension to .pdf and see if Acrobat Reader will open it. Should be about the right size for a set of blueprints. Just had to say... lol :D Cheers :) |
Erik Send message Joined: 27 Oct 09 Posts: 1 Credit: 90,143 RAC: 0 |
Hi everyone, I know this might be the wrong place for my query. But I have been wondering. A couple of days ago I installed BOINC and got a few packages of data to analyze. But the last few days e.g. friday, saturday and sunday. I cant get any more data. It says that the project has no jobs available. Is SETI@home ending?? cheers Erik |
1mp0£173 Send message Joined: 3 Apr 99 Posts: 8423 Credit: 356,897 RAC: 0 |
Is SETI@home ending?? No, it is not ending. Most projects, including SETI@Home, do not promise that they will always have enough work. It's a combination of maintenance being done at the telescope and the fact that it takes longer than they'd like to radar-blank some of the old recordings. It's sunday afternoon in Berkeley. I suspect they'll be working hard on this tomorrow (if they haven't had machines blanking radar all weekend). |
Julie Send message Joined: 28 Oct 09 Posts: 34060 Credit: 18,883,157 RAC: 18 |
|
Cosmic_Ocean Send message Joined: 23 Dec 00 Posts: 3027 Credit: 13,516,867 RAC: 13 |
I ran empty for 2 days!! Now I got someting from Astropulse. Really glad, thought SETI forgot about me:( Some would argue that this sort of thing happens more frequently in the relative "recent past" than before. There have been some work availability issues over the past 6-12 months where there are either dry spells or the bandwidth is fully saturated and therefore, hardly anyone gets new work. The current issue is that the telescope shut down for the entire month of October for maintenance, and the recorded data from September did not last the entire duration. There is some old data in off-site storage, but it needed a new piece of in-house software for it to be pre-processed and then split into WUs. I believe the pre-processing software is not able to go anywhere near real-time, and takes ~5 times longer to pre-process than it takes to split into WUs, so new tasks do come along every couple of hours, but it's a slow process. Linux laptop: record uptime: 1511d 20h 19m (ended due to the power brick giving-up) |
Julie Send message Joined: 28 Oct 09 Posts: 34060 Credit: 18,883,157 RAC: 18 |
I ran empty for 2 days!! Now I got someting from Astropulse. Really glad, thought SETI forgot about me:( Thankx, that was some useful information:) |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.