Plotz (Sep 19 2007)

Message boards : Technical News : Plotz (Sep 19 2007)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 644481 - Posted: 19 Sep 2007, 20:54:26 UTC

Well, like I mentioned yesterday I'm working on more scientific programming than network administration these days (for a refreshing change). Actually plotted out some recent data this morning for the gang which pointed out a bug in our splitter - apparently we haven't been notching out as much garbage data as we should have. Eric/Jeff are fixing that now. That should eventually mean less overflow workunits wasting everybody's time.

Jeff and Bob and also quite busy working on the science database replica stuff. It's been a real bear getting Informix up and running on the replica machine, due to all kinds of version, configuration, and permissions issues. But as I overhear their discussions it sounds like slow but positive progress is being made.

The outage recovery yesterday was pretty quick. Seems like recent web tuning and workunit file distribution over several servers has been working perhaps? Eric is managing the transfer of date from one NAS to two until it's a 75/25 split. Currently it's about 80/20.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 644481 · Report as offensive
QSilver

Send message
Joined: 26 May 99
Posts: 232
Credit: 6,452,764
RAC: 0
United States
Message 644495 - Posted: 19 Sep 2007, 21:32:55 UTC

Thank for the update, Matt. And keep up the good work.

QS
ID: 644495 · Report as offensive
Profile Peter Söderlund
Avatar

Send message
Joined: 31 May 99
Posts: 33
Credit: 1,744,426
RAC: 0
Sweden
Message 644520 - Posted: 19 Sep 2007, 22:19:44 UTC
Last modified: 19 Sep 2007, 22:21:25 UTC

Matt!
I have a qustion about the pending credit.
What's doing it? I'm sure you have mention in before, but I also though you already fix the problem. Or is the reason something new?
And why does it take so long time to get back to zero pending again?

Peter Söderlund
ID: 644520 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 644535 - Posted: 19 Sep 2007, 22:59:19 UTC


Nice Work there Matt - Congratulations to All of You @ Berkeley . . .

ID: 644535 · Report as offensive
John McLeod VII
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 15 Jul 99
Posts: 24806
Credit: 790,712
RAC: 0
United States
Message 644544 - Posted: 19 Sep 2007, 23:09:17 UTC - in response to Message 644520.  

Matt!
I have a qustion about the pending credit.
What's doing it? I'm sure you have mention in before, but I also though you already fix the problem. Or is the reason something new?
And why does it take so long time to get back to zero pending again?

Peter Söderlund

Pending credit will rarely if ever be 0. You will almost always have something waiting for the other host to finish up.


BOINC WIKI
ID: 644544 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13732
Credit: 208,696,464
RAC: 304
Australia
Message 644736 - Posted: 20 Sep 2007, 7:06:11 UTC - in response to Message 644544.  

Matt!
I have a qustion about the pending credit.
What's doing it? I'm sure you have mention in before, but I also though you already fix the problem. Or is the reason something new?
And why does it take so long time to get back to zero pending again?

Peter Söderlund

Pending credit will rarely if ever be 0. You will almost always have something waiting for the other host to finish up.

Even more so with the long deadlines on these Work Units and the initial replication & distribution of only 2.
Grant
Darwin NT
ID: 644736 · Report as offensive
JLDun
Volunteer tester
Avatar

Send message
Joined: 21 Apr 06
Posts: 573
Credit: 196,101
RAC: 0
United States
Message 644737 - Posted: 20 Sep 2007, 7:15:12 UTC - in response to Message 644736.  


Even more so with the long deadlines on these Work Units and the initial replication & distribution of only 2.

Yup. I'll admit I've used the longer deadlines to sneak in some time on other projects (gasp!) for my Laptop...

ID: 644737 · Report as offensive
JLDun
Volunteer tester
Avatar

Send message
Joined: 21 Apr 06
Posts: 573
Credit: 196,101
RAC: 0
United States
Message 644739 - Posted: 20 Sep 2007, 7:18:22 UTC - in response to Message 644481.  

Seems like recent web tuning and workunit file distribution over several servers has been working perhaps? Eric is managing the transfer of date from one NAS to two until it's a 75/25 split. Currently it's about 80/20.

- Matt

A question from nearly no-tech user:
Would this mean that the "tapes" are going to be handled by more than one physical machine?
ID: 644739 · Report as offensive
Profile RandyC
Avatar

Send message
Joined: 20 Oct 99
Posts: 714
Credit: 1,704,345
RAC: 0
United States
Message 644802 - Posted: 20 Sep 2007, 11:33:09 UTC - in response to Message 644739.  

Seems like recent web tuning and workunit file distribution over several servers has been working perhaps? Eric is managing the transfer of date from one NAS to two until it's a 75/25 split. Currently it's about 80/20.

- Matt

A question from nearly no-tech user:
Would this mean that the "tapes" are going to be handled by more than one physical machine?


Right now, Lando is the only machine actively splitting. However, Bambi is able to/available to split as well. The file system limitations are the problem currently with limiting the number of splitters.
ID: 644802 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 650738 - Posted: 29 Sep 2007, 4:07:43 UTC - in response to Message 644544.  
Last modified: 29 Sep 2007, 4:09:21 UTC

Pending credit will rarely if ever be 0. You will almost always have something waiting for the other host to finish up.

Drop the "if ever" bit. The pending on my P60 is ZERO 99.9999% of the time, Of course it takes 3-5 weeks per wu, so everyone waits for it's return, and the WU is validated credited nearly immediately. LOL

so, if you don't want any pending, get yourselves some Pentium 60 Mhz machines.
ID: 650738 · Report as offensive
Profile Daniel Michel
Volunteer tester
Avatar

Send message
Joined: 2 Feb 04
Posts: 14925
Credit: 1,378,607
RAC: 6
United States
Message 650746 - Posted: 29 Sep 2007, 4:31:37 UTC

Everybody getting geared up and crunching the new 5.28's may be causing some to have more pending WU's...If you crunch 'em fast you have to wait for the rest of the world to catch up...And when a bunch of people started crunching the 5.28's all at the same time...There is going to be a big differential on how soon they get finished.

PROUD TO BE TFFE!
ID: 650746 · Report as offensive

Message boards : Technical News : Plotz (Sep 19 2007)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.