Message boards :
Number crunching :
OK.. The date is right, but seems I need a decoder ring...
Message board moderation
Author | Message |
---|---|
EclipseHA Send message Joined: 28 Jul 99 Posts: 1018 Credit: 530,719 RAC: 0 |
Today's news: August 10, 2004 We have started the copy of the download directory to the Snap Appliance 18000. ----------------------------------------------------- 0) "download" means different things in the processing of a WU, depending on prespective - both client and server "downloads" seem to happen in the BOINC terminology. 1) is that the raw WU's yet to be processed (download to a client), or the completed WU's which clients uploaded (download to the server)? If they are the raw WU's, does this mean that there won't be any available WU's to crunch during the process? If they are the cooked WU's, does that mean the validator could be running soon? 2) Is this an hour or day process? - what did this really tell us? Seems not much more than if your spouse says "I'm going shopping" :) We all understand that the spouse is going to be gone, based on this, but for how long, or what will be brought home is a complete mystery! |
slavko.sk Send message Joined: 27 Jun 00 Posts: 346 Credit: 417,028 RAC: 0 |
I'm not 100% sure but from my point of view and I'm watching this, download directory is from our point of view. Server doesn't do anything from or to your client, it only serves (it is from its name comes) client reqiests. So I would assign download directory to directory from which I will able to download new WU. Regarding the time, they don't know how long it will take, last time they wrote that it will take a day and it took more the 2 days, if I remember right. It is the same when my wife goes shopping, I don't know how long it will take and how much money she will spend. Whole life is a mystery. What I see from that message is that they finished tests of new filesystme which should help and they started release to public, to new powerfull server. But you are right, that message was at least hard to translate to our team page for our local news, so I did not put it there ;o))) And at the end ... this is also a Mystery, isn't ;o))) |
Toby Send message Joined: 26 Oct 00 Posts: 1005 Credit: 6,366,949 RAC: 0 |
I can't be 100% sure either since a critical news update (August 4) seems to have been deleted or maybe just lost between the 'current news' and 'older news' pages. But if I remember correctly, they have talked about the 'download directory' several times. In that August 4th post they explained it quite well I believe. The directory they were having problems with is the one that holds the results after we upload them. So I guess 'download' as seen from their end. Put a couple million files in a directory on your hard drive and see how it performs :) They switched to a hierarchical directory structure to solve this on the 6th and now it seems they are moving that directory tree to the SnapAppliance. I'm betting they will get that whole thing going no later than Friday during the day. If we are lucky some time on Thursday. Anyone care to wager? :) ------------------------------------------- - A member of The Knights Who Say NI! Possibly the best stats site in the universe: http://boinc-kwsn.no-ip.info |
Pascal, K G Send message Joined: 3 Apr 99 Posts: 2343 Credit: 150,491 RAC: 0 |
> Today's news: > > August 10, 2004 > We have started the copy of the download directory to the Snap Appliance > 18000. > > ----------------------------------------------------- > 0) "download" means different things in the processing of a WU, depending on > prespective - both client and server "downloads" seem to happen in the BOINC > terminology. > > 1) is that the raw WU's yet to be processed (download to a client), or the > completed WU's which clients uploaded (download to the server)? > > If they are the raw WU's, does this mean that there won't be any available > WU's to crunch during the process? > > If they are the cooked WU's, does that mean the validator could be running > soon? > > 2) Is this an hour or day process? > > - what did this really tell us? Seems not much more than if your spouse says > "I'm going shopping" :) We all understand that the spouse is going to be > gone, based on this, but for how long, or what will be brought home is a > complete mystery! > > > > I just paid myself 10 bucks, because I knew you would still be the same old Woody.... Give you some info you just want more and more and more and none of it is up to your standards.... You must be a lonely man......... This 'SPACE' for Rent. M7 |
KWSN - MajorKong Send message Joined: 5 Jan 00 Posts: 2892 Credit: 1,499,890 RAC: 0 |
Do we HAVE to keep feeding this Troll (Mr. AZWoody)?? Let him rave on (by himself) that people may know him mad. ------------ KWSN-MajorKong KWSN Forum Admin (retired) http://www.kwsnforum.com BOINC Beta tester |
Rom Walton (BOINC) Send message Joined: 28 Apr 00 Posts: 579 Credit: 130,733 RAC: 0 |
The download directory is where all the workunits and applications are stored for client download via apache. There is approximately 250GBs of data is the download directory. In total we'll have to copy around 350GBs of data to the snap device. The upload/download directories are being put on there own 2TB volume, and the databases are being put on there own 2TB volume. ----- Rom BOINC Development Team, U.C. Berkeley [url=http://www.boinc.dk/index.php?page=user_statistics&project=sah&userid=85465]<img border="0" height="70"> |
slavko.sk Send message Joined: 27 Jun 00 Posts: 346 Credit: 417,028 RAC: 0 |
Again nice explanation, thanks. I put a link to your posts in my Favorites ;o))) > The download directory is where all the workunits and applications are stored > for client download via apache. > > There is approximately 250GBs of data is the download directory. > > In total we'll have to copy around 350GBs of data to the snap device. The > upload/download directories are being put on there own 2TB volume, and the > databases are being put on there own 2TB volume. > > ----- Rom > BOINC Development Team, U.C. Berkeley Try WAP user info http://slavko.sk/wap/seti |
ric Send message Joined: 16 Jun 03 Posts: 482 Credit: 666,047 RAC: 0 |
attn Rom, understanding the largeness of this actualy running task. wishing all the best for this process, it's nice to keep us "online". All our hopes, our awaits are with you and the Snap Appliance 18000. It look's like your'r having a long night... thanks for this. ric |
Byron Leigh Hatch @ team Carl Sagan Send message Joined: 5 Jul 99 Posts: 4548 Credit: 35,667,570 RAC: 4 |
|
Kirsten Send message Joined: 7 Jul 00 Posts: 190 Credit: 566,047 RAC: 0 |
> I can't be 100% sure either since a critical news update (August 4) seems to > have been deleted or maybe just lost between the 'current news' and 'older FYI: August 4, 2004 We discoverd that the sheer number of files in the upload directory was killing NFS performance for the file_upload_handler. We started with a new empty upload directory and the file_upload_handler performed much better. The rate of connection drops on the upload server dropped to zero (most of the time). Of course we need to get all those older results back into play somehow. We are preparing our new SnapAppliance 18000 to host the database. We need to fit it into the power load in our already fairly full data closet, configure the DB volume, run some tests, and then copy over the DB files. We will post the progress as we go. Greetings from Kirsten, Copenhagen, DK |
Petit Soleil Send message Joined: 17 Feb 03 Posts: 1497 Credit: 70,934 RAC: 0 |
> In total we'll have to copy around 350GBs of data to the snap device. If it can be of any help I can send you a copy of LapLink 5 if you want... |
sholzy Send message Joined: 4 Jul 01 Posts: 38 Credit: 7,918 RAC: 0 |
> > In total we'll have to copy around 350GBs of data to the snap device. > > If it can be of any help I can send you a copy of LapLink 5 if you want... > As long as they don't do the copying by floppy it shouldn't take too long. ;-) <a> [/url] |
ric Send message Joined: 16 Jun 03 Posts: 482 Credit: 666,047 RAC: 0 |
> > If it can be of any help I can send you a copy of LapLink 5 if you > want... in english LOL ? but please over rs232 > > As long as they don't do the copying by floppy it shouldn't take too long. ;- he floppies are fast, imagine they would print out and re-type in... ;-)) you have a fast pc, one on the fastest sure. how much do you believe, can do one fast pc, transfering, from 1 diskdrive to an other diskdrive, both local attached devices? perhaps can do about 20-30 GB in 1 hour, if he is really quick... but this huge diskcopy (precisely the contens of a "large" folder/directory) is copied from one "system" to an other "system", this over a network, imagine the load! your "pc" would be busy a really long time... also at leat more important, after the "copy" everything has to be checked, verified, and re-checked, it's just the way it run's on this high level, the Snap Appliance 18000 it's the beast, a crucher's dream, I would I have one here, but can't offer the space nor power suply... it's important to give the needed time for those people, to enshure data security and making fine tuning. ric |
Petit Soleil Send message Joined: 17 Feb 03 Posts: 1497 Credit: 70,934 RAC: 0 |
> > > In total we'll have to copy around 350GBs of data to the snap > device. > > > > If it can be of any help I can send you a copy of LapLink 5 if you > want... > > > > As long as they don't do the copying by floppy it shouldn't take too long. ;-) Commodore 64 audio tape recorder... |
ric Send message Joined: 16 Jun 03 Posts: 482 Credit: 666,047 RAC: 0 |
he there! help, I'm giving up, enough is enough if you out there, want to build up the holy Snap Appliance 18000 over laplink5, with a dataset, the commodore audio tape, it's time to make a break, shame on you! I will tell this all to your mothers goodby, going outside this is tomuch for me. leaving and going in to the familly garden, giving the plants water, they are more recpectfully. hope being able to forget this nightmare of audio tape on... brrr. deaply shamed to have spoken to you ric |
sholzy Send message Joined: 4 Jul 01 Posts: 38 Credit: 7,918 RAC: 0 |
> > > > In total we'll have to copy around 350GBs of data to the snap > > device. > > > > > > If it can be of any help I can send you a copy of LapLink 5 if you > > want... > > > > > > > As long as they don't do the copying by floppy it shouldn't take too > long. ;-) > > Commodore 64 audio tape recorder... > hehe! Much more precise would be punch cards! <a> [/url] |
Petit Soleil Send message Joined: 17 Feb 03 Posts: 1497 Credit: 70,934 RAC: 0 |
> hehe! Much more precise would be punch cards! It's not a good idea. We would loose to much time explaining them how it works. They probably never seen that before... |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.