Ups and Downs (Mar 22 2007)

Message boards : Technical News : Ups and Downs (Mar 22 2007)
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 535239 - Posted: 22 Mar 2007, 22:04:33 UTC
Last modified: 22 Mar 2007, 22:05:24 UTC

Yesterday afternoon we had to reboot kryten/penguin to flush their pipes. Sigh. Bruno is well on its way towards becoming a full fledged upload server, but the sooner we get bruno to be the download server the better. The major gating item on that is the need for a new 24 port gigabit switch for our closet. Long story.

Meanwhile many clients are still connecting to kryten for uploads. This is thanks to the wacky unpredictable internet while trickles out DNS changes at surprisingly slow rates. While diagnosing this I wrote a script to show me a sample of the most recent client version types to connect to our servers. I then made it into a web page (there's a link on the server status page as well). Yup - we're dominated by Windows, but they're not to blame for any DNS-related issues. Anyway kryten will probably completely free of upload traffic within a week or so.

I just heard cheers from Jeff's desk - he compiled an assimilator on bruno. He's now working on the validator - linking issues.

Bob worked some magic and got sidious back on track today without having to do a full restore. So it's acting as a replica again. We're still not exactly sure why, but we found the MYD files zeroed out within the past week (and was only exercised upon stopping/restarting the database on Tuesday). Some research shows this may be a bug when replicating a mysql version 4.1 database to version 5.0, which is exactly what we're doing. We're planning on upgrading the 4.1 soon, so maybe this problem will disappear.

Oh yeah - there was a network blip this morning around 6am. Not us. It was campus working routers further up the pike. And we had a minor blip around noon. That was me screwing around trying to get the beta project working again. I think Eric is ironing out the last remaining details on that as I type.

There is some concern that results got munged during all this switching around. Probably so, and we're sorry if this happened to you. We'll try to clean it up and get people their credit as best we can.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 535239 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 535244 - Posted: 22 Mar 2007, 22:20:05 UTC - in response to Message 535239.  

Yesterday afternoon we had to reboot kryten/penguin to flush their pipes. Sigh. Bruno is well on its way towards becoming a full fledged upload server, but the sooner we get bruno to be the download server the better. The major gating item on that is the need for a new 24 port gigabit switch for our closet. Long story.

Meanwhile many clients are still connecting to kryten for uploads. This is thanks to the wacky unpredictable internet while trickles out DNS changes at surprisingly slow rates. While diagnosing this I wrote a script to show me a sample of the most recent client version types to connect to our servers. I then made it into a web page (there's a link on the server status page as well). Yup - we're dominated by Windows, but they're not to blame for any DNS-related issues. Anyway kryten will probably completely free of upload traffic within a week or so.

I just heard cheers from Jeff's desk - he compiled an assimilator on bruno. He's now working on the validator - linking issues.

Bob worked some magic and got sidious back on track today without having to do a full restore. So it's acting as a replica again. We're still not exactly sure why, but we found the MYD files zeroed out within the past week (and was only exercised upon stopping/restarting the database on Tuesday). Some research shows this may be a bug when replicating a mysql version 4.1 database to version 5.0, which is exactly what we're doing. We're planning on upgrading the 4.1 soon, so maybe this problem will disappear.

Oh yeah - there was a network blip this morning around 6am. Not us. It was campus working routers further up the pike. And we had a minor blip around noon. That was me screwing around trying to get the beta project working again. I think Eric is ironing out the last remaining details on that as I type.

There is some concern that results got munged during all this switching around. Probably so, and we're sorry if this happened to you. We'll try to clean it up and get people their credit as best we can.

- Matt


Great Work all around by Each of You @ Berkeley - and CONGRATULATIONS TOO . . .

'all's Well that end's well . . ." THanks for the Post Matt . . .
ID: 535244 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 20140
Credit: 7,508,002
RAC: 20
United Kingdom
Message 535255 - Posted: 22 Mar 2007, 22:48:06 UTC - in response to Message 535239.  

...The major gating item on that is the need for a new 24 port gigabit switch for our closet. Long story.

A story for another lunchbreak perchance?

(More seriously, the stories, insight and info are interesting, thanks. So is getting the science rolling along!)

... While diagnosing this I wrote a script to show me a sample of the most recent client version types to connect to our servers. I then made it into a web page (there's a link on the server status page as well). Yup - we're dominated by Windows,...

Don't forget that the unsupported types such as x86_64-pc-linux-gnu/x86_64-unknown-linux-gnu ( ;-) ) will be underrepresented being as they will not be pestering as much due to 1 day(?) deferrals.

Happy crunchin',

Regards,
Martin

See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 535255 · Report as offensive
Robert Nelson
Volunteer tester
Avatar

Send message
Joined: 13 Aug 99
Posts: 43
Credit: 3,632,674
RAC: 1
United States
Message 535311 - Posted: 23 Mar 2007, 0:23:58 UTC - in response to Message 535255.  


(More seriously, the stories, insight and info are interesting, thanks. So is getting the science rolling along!)


Agreed, Matt many of us don't post that often, but keep up on what is happening and find your missives on the ups and downs, frustrations and successes very interesting. It gives us great incite into how difficult it is to keep something like this going. Much appreciated.
ID: 535311 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 535313 - Posted: 23 Mar 2007, 0:27:33 UTC
Last modified: 23 Mar 2007, 0:38:10 UTC

Fascinating list of the recent BOINC versions reporting in. I've done you a little graph (click to view):


(direct link)

Edit - it works better with a log scale:


(direct link)
ID: 535313 · Report as offensive
Profile Misfit
Volunteer tester
Avatar

Send message
Joined: 21 Jun 01
Posts: 21804
Credit: 2,815,091
RAC: 0
United States
Message 535336 - Posted: 23 Mar 2007, 1:51:48 UTC - in response to Message 535239.  

Yup - we're dominated by Windows, but they're not to blame for any DNS-related issues.

That would be a Misfit related issue. .o0(I also use Windows.)
me@rescam.org
ID: 535336 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 535372 - Posted: 23 Mar 2007, 3:32:24 UTC - in response to Message 535336.  

Yup - we're dominated by Windows, but they're not to blame for any DNS-related issues.

That would be a Misfit related issue. .o0(I also use Windows.)

You use what You like Misfit, Nothing wrong with that. Ditto on the OS. :D
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 535372 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 535490 - Posted: 23 Mar 2007, 12:25:11 UTC - in response to Message 535239.  

Meanwhile many clients are still connecting to kryten for uploads. This is thanks to the wacky unpredictable internet while trickles out DNS changes at surprisingly slow rates. While diagnosing this I wrote a script to show me a sample of the most recent client version types to connect to our servers. I then made it into a web page (there's a link on the server status page as well). Yup - we're dominated by Windows, but they're not to blame for any DNS-related issues. Anyway kryten will probably completely free of upload traffic within a week or so.

A likely candidate to blame is the BOINC-client itself, BOINC alpha had many reports in January there DNS apparently is cached by libCurl used in the client, and only way to clean-out "bad" names is to re-start BOINC-client...

"I make so many mistakes. But then just think of all the mistakes I don't make, although I might."
ID: 535490 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 535540 - Posted: 23 Mar 2007, 14:42:59 UTC - in response to Message 535534.  
Last modified: 23 Mar 2007, 14:43:15 UTC

Fascinating stats.


2644 (%26.93) windows_intelx86 5.4.11
1318 (%13.42) windows_intelx86 5.02
1258 (%12.81) windows_intelx86 5.8.15
666 (%6.78) windows_intelx86 5.4.9
573 (%5.84) windows_intelx86 5.8.11
552 (%5.62) windows_intelx86 4.45
424 (%4.32) windows_intelx86 5.8.8
281 (%2.86) i686-apple-darwin 5.4.9
202 (%2.06) windows_intelx86 5.5.0
153 (%1.56) i686-pc-linux-gnu 5.4.9
144 (%1.47) windows_intelx86 4.25
141 (%1.44) windows_intelx86 4.49


Any views as to why less than 13% of people are using the latest RECCOMMENDED Boinc client???


People install it and forget it.
ID: 535540 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 535546 - Posted: 23 Mar 2007, 14:59:50 UTC - in response to Message 535540.  

Fascinating stats.


2644 (%26.93) windows_intelx86 5.4.11
1318 (%13.42) windows_intelx86 5.02
1258 (%12.81) windows_intelx86 5.8.15
666 (%6.78) windows_intelx86 5.4.9
573 (%5.84) windows_intelx86 5.8.11
552 (%5.62) windows_intelx86 4.45
424 (%4.32) windows_intelx86 5.8.8
281 (%2.86) i686-apple-darwin 5.4.9
202 (%2.06) windows_intelx86 5.5.0
153 (%1.56) i686-pc-linux-gnu 5.4.9
144 (%1.47) windows_intelx86 4.25
141 (%1.44) windows_intelx86 4.49


Any views as to why less than 13% of people are using the latest RECCOMMENDED Boinc client???


People install it and forget it.

People Install and forget as they have busy lives, Some might even say lazy too.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 535546 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 535553 - Posted: 23 Mar 2007, 15:09:16 UTC - in response to Message 535540.  
Last modified: 23 Mar 2007, 15:13:32 UTC

Fascinating stats.


2644 (%26.93) windows_intelx86 5.4.11
1318 (%13.42) windows_intelx86 5.02
1258 (%12.81) windows_intelx86 5.8.15
666 (%6.78) windows_intelx86 5.4.9
573 (%5.84) windows_intelx86 5.8.11
552 (%5.62) windows_intelx86 4.45
424 (%4.32) windows_intelx86 5.8.8
281 (%2.86) i686-apple-darwin 5.4.9
202 (%2.06) windows_intelx86 5.5.0
153 (%1.56) i686-pc-linux-gnu 5.4.9
144 (%1.47) windows_intelx86 4.25
141 (%1.44) windows_intelx86 4.49


Any views as to why less than 13% of people are using the latest RECCOMMENDED Boinc client???


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

.

Hello, from Albany, CA!...
ID: 535553 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1628
Credit: 24,230,968
RAC: 26
United States
Message 535583 - Posted: 23 Mar 2007, 16:27:46 UTC - in response to Message 535553.  

Fascinating stats.


2644 (%26.93) windows_intelx86 5.4.11
1318 (%13.42) windows_intelx86 5.02
1258 (%12.81) windows_intelx86 5.8.15
666 (%6.78) windows_intelx86 5.4.9
573 (%5.84) windows_intelx86 5.8.11
552 (%5.62) windows_intelx86 4.45
424 (%4.32) windows_intelx86 5.8.8
281 (%2.86) i686-apple-darwin 5.4.9
202 (%2.06) windows_intelx86 5.5.0
153 (%1.56) i686-pc-linux-gnu 5.4.9
144 (%1.47) windows_intelx86 4.25
141 (%1.44) windows_intelx86 4.49


Any views as to why less than 13% of people are using the latest RECCOMMENDED Boinc client???


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.
ID: 535583 · Report as offensive
Profile speedimic
Volunteer tester
Avatar

Send message
Joined: 28 Sep 02
Posts: 362
Credit: 16,590,653
RAC: 0
Germany
Message 535584 - Posted: 23 Mar 2007, 16:34:12 UTC

I suggest an E-mail to all users about the newer software level.


No, I don´t think many want that! Just thinking of my fooded mailboxes...

Maybe some kind of message at startup..?

mic.
mic.


ID: 535584 · Report as offensive
Profile Teratoma [SETI.USA]
Avatar

Send message
Joined: 30 Mar 00
Posts: 16
Credit: 2,200,914
RAC: 0
United States
Message 535588 - Posted: 23 Mar 2007, 16:42:32 UTC - in response to Message 535239.  

The major gating item on that is the need for a new 24 port gigabit switch for our closet. Long story.


Is this equipment available or are you in need of a donation?

..
ID: 535588 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 535591 - Posted: 23 Mar 2007, 16:46:38 UTC - in response to Message 535583.  


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.

Could also be that most people care enough to load BOINC, and probably don't even look at it -- they know work is being done, and that's it.

Some install BOINC and then move on to other jobs and can't update that machine.

... and since many people change E-Mail addresses frequently, SETI definitely can't reach a surprising number of participants.
ID: 535591 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1628
Credit: 24,230,968
RAC: 26
United States
Message 535598 - Posted: 23 Mar 2007, 17:14:58 UTC - in response to Message 535591.  


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.

Could also be that most people care enough to load BOINC, and probably don't even look at it -- they know work is being done, and that's it.

Some install BOINC and then move on to other jobs and can't update that machine.

... and since many people change E-Mail addresses frequently, SETI definitely can't reach a surprising number of participants.

Then how about a feature added to future releases that pops up a window that states NEWER RELEASE AVAILBLE - CLICK HERE TO DOWNLOAD.

ID: 535598 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 535641 - Posted: 23 Mar 2007, 18:53:58 UTC - in response to Message 535598.  


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.

Could also be that most people care enough to load BOINC, and probably don't even look at it -- they know work is being done, and that's it.

Some install BOINC and then move on to other jobs and can't update that machine.

... and since many people change E-Mail addresses frequently, SETI definitely can't reach a surprising number of participants.

Then how about a feature added to future releases that pops up a window that states NEWER RELEASE AVAILBLE - CLICK HERE TO DOWNLOAD.


Those who run Boinc on computers with whom they have questionable legal access to will object to any pop up window.



Boinc....Boinc....Boinc....Boinc....
ID: 535641 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65709
Credit: 55,293,173
RAC: 49
United States
Message 535700 - Posted: 23 Mar 2007, 22:31:01 UTC - in response to Message 535641.  


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.

Could also be that most people care enough to load BOINC, and probably don't even look at it -- they know work is being done, and that's it.

Some install BOINC and then move on to other jobs and can't update that machine.

... and since many people change E-Mail addresses frequently, SETI definitely can't reach a surprising number of participants.

Then how about a feature added to future releases that pops up a window that states NEWER RELEASE AVAILBLE - CLICK HERE TO DOWNLOAD.


Those who run Boinc on computers with whom they have questionable legal access to will object to any pop up window.

I wouldn't doubt that, As the PC user would then do something about Boinc on their PC, It'd be just deserts for the user who has added PCs without the permission of the PCs owner(s) in question. Sending a message to terminate the older classic versions through seti would have been nice but It's something that probably wasn't thought of, emails don't always work as explained already. I'd almost wonder is there anything that can be done? I know when classic was about to shut down a message was sent out and I saw it in the seti software, I don't know how It was done, But maybe this could be done as the seti classic software is expecting something, It's that or maybe shut down the ip address if that is possible at all. Otherwise I'm stumped.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 535700 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1628
Credit: 24,230,968
RAC: 26
United States
Message 535704 - Posted: 23 Mar 2007, 22:59:29 UTC - in response to Message 535700.  


People install it and forget it.


Some people (I'm one...) subscribe to the "if it ain't broke, don't fix it" mentality, not realizing that 5.4.11 has at least one problem that 5.8.15 fixes... the 'no result file' (paraphrase) after doing a work unit. (yes, I upgraded) Also realize that upgrading the Boinc client involves downloading an 8 Mb file - some of us still use dial-up, and that takes about a ½ hour!

Could also be most people don't know there is something better. This is the only thread I read so one day I looked at the release levels and discovered there was something newer I should be running. I suggest an E-mail to all users about the newer software level.

Could also be that most people care enough to load BOINC, and probably don't even look at it -- they know work is being done, and that's it.

Some install BOINC and then move on to other jobs and can't update that machine.

... and since many people change E-Mail addresses frequently, SETI definitely can't reach a surprising number of participants.

Then how about a feature added to future releases that pops up a window that states NEWER RELEASE AVAILBLE - CLICK HERE TO DOWNLOAD.


Those who run Boinc on computers with whom they have questionable legal access to will object to any pop up window.

I wouldn't doubt that, As the PC user would then do something about Boinc on their PC, It'd be just deserts for the user who has added PCs without the permission of the PCs owner(s) in question. Sending a message to terminate the older classic versions through seti would have been nice but It's something that probably wasn't thought of, emails don't always work as explained already. I'd almost wonder is there anything that can be done? I know when classic was about to shut down a message was sent out and I saw it in the seti software, I don't know how It was done, But maybe this could be done as the seti classic software is expecting something, It's that or maybe shut down the ip address if that is possible at all. Otherwise I'm stumped.

May be a dumb idea, but the SETI task is downloaded as needed. Could the code be put in there. I admit the other projects would also have to include the code in their task(s) but it would clean up problems for anyone who includes the code.
ID: 535704 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 535725 - Posted: 23 Mar 2007, 23:37:31 UTC - in response to Message 535641.  


Those who run Boinc on computers with whom they have questionable legal access to will object to any pop up window.

Which by itself makes this a good idea.

ID: 535725 · Report as offensive
1 · 2 · Next

Message boards : Technical News : Ups and Downs (Mar 22 2007)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.