Today's news:

August 10, 2004
We have started the copy of the download directory to the Snap Appliance 18000.

-----------------------------------------------------
0) "download" means different things in the processing of a WU, depending on prespective - both client and server "downloads" seem to happen in the BOINC terminology.

1) is that the raw WU's yet to be processed (download to a client), or the completed WU's which clients uploaded (download to the server)?

If they are the raw WU's, does this mean that there won't be any available WU's to crunch during the process?

If they are the cooked WU's, does that mean the validator could be running soon?

2) Is this an hour or day process?

- what did this really tell us? Seems not much more than if your spouse says "I'm going shopping" :) We all understand that the spouse is going to be gone, based on this, but for how long, or what will be brought home is a complete mystery!

I'm not 100% sure but from my point of view and I'm watching this, download directory is from our point of view. Server doesn't do anything from or to your client, it only serves (it is from its name comes) client reqiests.
So I would assign download directory to directory from which I will able to download new WU.
Regarding the time, they don't know how long it will take, last time they wrote that it will take a day and it took more the 2 days, if I remember right. It is the same when my wife goes shopping, I don't know how long it will take and how much money she will spend.
Whole life is a mystery.
What I see from that message is that they finished tests of new filesystme which should help and they started release to public, to new powerfull server.
But you are right, that message was at least hard to translate to our team page for our local news, so I did not put it there ;o)))
And at the end ... this is also a Mystery, isn't ;o)))

I can't be 100% sure either since a critical news update (August 4) seems to have been deleted or maybe just lost between the 'current news' and 'older news' pages. But if I remember correctly, they have talked about the 'download directory' several times. In that August 4th post they explained it quite well I believe. The directory they were having problems with is the one that holds the results after we upload them. So I guess 'download' as seen from their end. Put a couple million files in a directory on your hard drive and see how it performs :) They switched to a hierarchical directory structure to solve this on the 6th and now it seems they are moving that directory tree to the SnapAppliance. I'm betting they will get that whole thing going no later than Friday during the day. If we are lucky some time on Thursday. Anyone care to wager? :)



-------------------------------------------
- A member of The Knights Who Say NI!
Possibly the best stats site in the universe:
http://boinc-kwsn.no-ip.info

> Today's news:
>
> August 10, 2004
> We have started the copy of the download directory to the Snap Appliance
> 18000.
>
> -----------------------------------------------------
> 0) "download" means different things in the processing of a WU, depending on
> prespective - both client and server "downloads" seem to happen in the BOINC
> terminology.
>
> 1) is that the raw WU's yet to be processed (download to a client), or the
> completed WU's which clients uploaded (download to the server)?
>
> If they are the raw WU's, does this mean that there won't be any available
> WU's to crunch during the process?
>
> If they are the cooked WU's, does that mean the validator could be running
> soon?
>
> 2) Is this an hour or day process?
>
> - what did this really tell us? Seems not much more than if your spouse says
> "I'm going shopping" :) We all understand that the spouse is going to be
> gone, based on this, but for how long, or what will be brought home is a
> complete mystery!
>
>
>
>


I just paid myself 10 bucks, because I knew you would still be the same old Woody.... Give you some info you just want more and more and more and none of it is up to your standards.... You must be a lonely man.........

This 'SPACE' for Rent.

M7

Do we HAVE to keep feeding this Troll (Mr. AZWoody)??

Let him rave on (by himself) that people may know him mad.
------------
KWSN-MajorKong
KWSN Forum Admin (retired)
http://www.kwsnforum.com

BOINC Beta tester

The download directory is where all the workunits and applications are stored for client download via apache.

There is approximately 250GBs of data is the download directory.

In total we'll have to copy around 350GBs of data to the snap device. The upload/download directories are being put on there own 2TB volume, and the databases are being put on there own 2TB volume.

----- Rom
BOINC Development Team, U.C. Berkeley
[url=http://www.boinc.dk/index.php?page=user_statistics&project=sah&userid=85465]<img border="0" height="70">

Again nice explanation, thanks. I put a link to your posts in my Favorites ;o)))

> The download directory is where all the workunits and applications are stored
> for client download via apache.
>
> There is approximately 250GBs of data is the download directory.
>
> In total we'll have to copy around 350GBs of data to the snap device. The
> upload/download directories are being put on there own 2TB volume, and the
> databases are being put on there own 2TB volume.
>
> ----- Rom
> BOINC Development Team, U.C. Berkeley



Try WAP user info http://slavko.sk/wap/seti

attn Rom,

understanding the largeness of this actualy running task.

wishing all the best for this process, it's nice to keep us "online".

All our hopes, our awaits are with you and the Snap Appliance 18000.

It look's like your'r having a long night...


thanks for this.

ric

> I can't be 100% sure either since a critical news update (August 4) seems to
> have been deleted or maybe just lost between the 'current news' and 'older
FYI:

August 4, 2004
We discoverd that the sheer number of files in the upload directory was killing NFS performance for the file_upload_handler. We started with a new empty upload directory and the file_upload_handler performed much better. The rate of connection drops on the upload server dropped to zero (most of the time). Of course we need to get all those older results back into play somehow. We are preparing our new SnapAppliance 18000 to host the database. We need to fit it into the power load in our already fairly full data closet, configure the DB volume, run some tests, and then copy over the DB files. We will post the progress as we go.

Greetings from Kirsten, Copenhagen, DK

> In total we'll have to copy around 350GBs of data to the snap device.

If it can be of any help I can send you a copy of LapLink 5 if you want...

> > In total we'll have to copy around 350GBs of data to the snap device.
>
> If it can be of any help I can send you a copy of LapLink 5 if you want...
>

As long as they don't do the copying by floppy it shouldn't take too long. ;-)

<a> [/url]

> > If it can be of any help I can send you a copy of LapLink 5 if you
> want...
in english LOL ? but please over rs232
>
> As long as they don't do the copying by floppy it shouldn't take too long. ;-

he floppies are fast, imagine they would print out and re-type in...
;-))


you have a fast pc, one on the fastest sure.
how much do you believe, can do one fast pc, transfering,
from 1 diskdrive to an other diskdrive, both local attached devices?

perhaps can do about 20-30 GB in 1 hour, if he is really quick...

but this huge diskcopy (precisely the contens of a "large" folder/directory)
is copied from one "system" to an other "system", this over a network,
imagine the load! your "pc" would be busy a really long time...

also at leat more important, after the "copy" everything has to be checked, verified, and re-checked, it's just the way it run's on this high level,

the Snap Appliance 18000 it's the beast, a crucher's dream, I would I have one here, but can't offer the space nor power suply...

it's important to give the needed time for those people, to enshure data security and making fine tuning.

ric

> > > In total we'll have to copy around 350GBs of data to the snap
> device.
> >
> > If it can be of any help I can send you a copy of LapLink 5 if you
> want...
> >
>
> As long as they don't do the copying by floppy it shouldn't take too long. ;-)

Commodore 64 audio tape recorder...

he there!

help, I'm giving up, enough is enough

if you out there, want to build up the holy Snap Appliance 18000
over laplink5, with a dataset, the commodore audio tape, it's time to make a break, shame on you! I will tell this all to your mothers

goodby, going outside this is tomuch for me.

leaving and going in to the familly garden, giving the plants water, they are more recpectfully.

hope being able to forget this nightmare of audio tape on... brrr.

deaply shamed to have spoken to you

ric

> > > > In total we'll have to copy around 350GBs of data to the snap
> > device.
> > >
> > > If it can be of any help I can send you a copy of LapLink 5 if you
> > want...
> > >
> >
> > As long as they don't do the copying by floppy it shouldn't take too
> long. ;-)
>
> Commodore 64 audio tape recorder...
>

hehe! Much more precise would be punch cards!

<a> [/url]

> hehe! Much more precise would be punch cards!

It's not a good idea. We would loose to much time explaining
them how it works. They probably never seen that before...