Tweenday One (Dec 26 2007)

Message boards : Technical News : Tweenday One (Dec 26 2007)
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 694838 - Posted: 27 Dec 2007, 0:05:28 UTC

The weekend was a difficult as we kept splitting noisy/fast work, so our back-end production was running full speed most of the time, clogging several pipes, filling some queues, emptying others, etc. We were able to keep reaching our current outbound ceiling of 60 Mbits/sec, so despite the problems we were sending out work as fast as we could otherwise. That's good, but bigger pipes would be better. Also one of the assimilators was failing on a particular result. We're not sure why, but I deleted that one result and that particular dam broke. Some untested forum code was put on line which also wreaked minor havoc. Not my fault.

Anyway.. this is a short mini week for us in between Xmas/New Year's. Since we weren't around yesterday, we had our normal weekly outage today. Also took care of cleaning some extra "bloat" in our database. About 20% of the rows in the host table were hosts that last connected over a year ago and ultimately never got any credit. We blitzed all those.

Upon restarting everything this afternoon after the outage I noticed the feeder executables had disappeared sometime around 3-4 days ago (luckily images of the executables remained in memory since we had no downtime over the weekend). We have snapshots on that filesystem so recovery was instantaneous, but the initial disappearance is mysterious and a bit troubling.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 694838 · Report as offensive
Profile Dr. C.E.T.I.
Avatar

Send message
Joined: 29 Feb 00
Posts: 16019
Credit: 794,685
RAC: 0
United States
Message 694858 - Posted: 27 Dec 2007, 1:29:29 UTC


A Job Well Done Sir . . . nice going Matt (and the others @ the lab)

note: Favourite day of the week:

Tweenday, the magical day between Tuesday and Wednesday, when those of us with faerie blood flit around the sleeping earth righting wrongs and playing pranks. We give leg-cramps to the wicked, lovely dreams to the virtuous but unhappy, and stifle in the crib those babies who are likely to grow up to send e-mail questionnaires asking things like 'What is your favourite day of the week.' © 2007 Michael Horatio Kelly

;)



BOINC Wiki . . .

Science Status Page . . .
ID: 694858 · Report as offensive
Gene Barnhardt

Send message
Joined: 27 May 00
Posts: 3
Credit: 255,307
RAC: 0
United States
Message 694876 - Posted: 27 Dec 2007, 2:20:52 UTC

Looks like project server may be down - have been receiving the following msg for quite some time now. 12/26/2007 9:13:50 PM||Access to reference site succeeded - project servers may be temporarily down.
Help......Running out of work.
ID: 694876 · Report as offensive
Profile Neil Blaikie
Volunteer tester
Avatar

Send message
Joined: 17 May 99
Posts: 143
Credit: 6,652,341
RAC: 0
Canada
Message 694879 - Posted: 27 Dec 2007, 2:26:50 UTC

Excellent job as always.

Have a shot of my large Jack Daniels bottle that Santa deposited in my stocking.

You have earned it guys!

Thank you.
ID: 694879 · Report as offensive
W-K 666 Project Donor
Volunteer tester

Send message
Joined: 18 May 99
Posts: 19014
Credit: 40,757,560
RAC: 67
United Kingdom
Message 694881 - Posted: 27 Dec 2007, 2:29:49 UTC - in response to Message 694876.  

Looks like project server may be down - have been receiving the following msg for quite some time now. 12/26/2007 9:13:50 PM||Access to reference site succeeded - project servers may be temporarily down.
Help......Running out of work.

The servers are just getting back up to speed, after the 24hr delayed Tuesday maintenance period, see cricket graphs
ID: 694881 · Report as offensive
DJStarfox

Send message
Joined: 23 May 01
Posts: 1066
Credit: 1,226,053
RAC: 2
United States
Message 695085 - Posted: 27 Dec 2007, 17:57:31 UTC - in response to Message 694838.  

Upon restarting everything this afternoon after the outage I noticed the feeder executables had disappeared sometime around 3-4 days ago (luckily images of the executables remained in memory since we had no downtime over the weekend). We have snapshots on that filesystem so recovery was instantaneous, but the initial disappearance is mysterious and a bit troubling.


Missing files like that prompt me to make an immediate fsck on the filesystem. Too many crashes under my belt.

I hope you had a Merry Christmas.
ID: 695085 · Report as offensive
PhonAcq

Send message
Joined: 14 Apr 01
Posts: 1656
Credit: 30,658,217
RAC: 1
United States
Message 695095 - Posted: 27 Dec 2007, 18:12:07 UTC - in response to Message 694881.  

Looks like project server may be down - have been receiving the following msg for quite some time now. 12/26/2007 9:13:50 PM||Access to reference site succeeded - project servers may be temporarily down.
Help......Running out of work.

The servers are just getting back up to speed, after the 24hr delayed Tuesday maintenance period, see cricket graphs


Why are the bits 'in' larger than the bits 'out'? I would have thought it would be the other way. Isn't the downloading of wu's the greatest demand on the network?
ID: 695095 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 695099 - Posted: 27 Dec 2007, 18:17:35 UTC - in response to Message 695095.  

Looks like project server may be down - have been receiving the following msg for quite some time now. 12/26/2007 9:13:50 PM||Access to reference site succeeded - project servers may be temporarily down.
Help......Running out of work.

The servers are just getting back up to speed, after the 24hr delayed Tuesday maintenance period, see cricket graphs


Why are the bits 'in' larger than the bits 'out'? I would have thought it would be the other way. Isn't the downloading of wu's the greatest demand on the network?

Dunno.....but there are different versions of the Cricket Graph..try this one.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 695099 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 695213 - Posted: 28 Dec 2007, 0:12:35 UTC - in response to Message 695095.  

...see cricket graphs


Why are the bits 'in' larger than the bits 'out'? I would have thought it would be the other way. Isn't the downloading of wu's the greatest demand on the network?

Because the monitoring point is the campus end of the link from Space Sciences Lab. The bits 'in' to your computer (WU downloads) is also larger than the bits 'out' (result uploads) for the same reason.
                                                              Joe
ID: 695213 · Report as offensive
SockGap

Send message
Joined: 16 Apr 07
Posts: 14
Credit: 7,700,416
RAC: 0
Australia
Message 695215 - Posted: 28 Dec 2007, 0:17:09 UTC - in response to Message 695095.  

Looks like project server may be down - have been receiving the following msg for quite some time now. 12/26/2007 9:13:50 PM||Access to reference site succeeded - project servers may be temporarily down.
Help......Running out of work.

The servers are just getting back up to speed, after the 24hr delayed Tuesday maintenance period, see cricket graphs


Why are the bits 'in' larger than the bits 'out'? I would have thought it would be the other way. Isn't the downloading of wu's the greatest demand on the network?


Because the graph is taken from the point of view of the router. So for that interface the "bits in" are coming "in" from the SETI servers and the "bits out" are the ones being sent back to the SETI servers. If they were monitoring the port on the switch on the other end of that piece of cable (or fibre) then the graph would be reversed.

(Long time reader - first time poster. Finally I can add something to the forum!)

ID: 695215 · Report as offensive
seti@elrcastor.com
Volunteer tester

Send message
Joined: 30 Jan 00
Posts: 35
Credit: 4,879,559
RAC: 0
United States
Message 695369 - Posted: 28 Dec 2007, 17:03:33 UTC

the interface gigabitethernet2_3 is looking towards the seti servers so packets in and packets out are reversed

the interface gigabitethernet5_1 is looking at the internet so packets in and packets out are normal
ID: 695369 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 695396 - Posted: 28 Dec 2007, 19:08:28 UTC - in response to Message 695369.  

the interface gigabitethernet2_3 is looking towards the seti servers so packets in and packets out are reversed

the interface gigabitethernet5_1 is looking at the internet so packets in and packets out are normal

Thank you very much for the new Cricket Graph reference.....
Much easier to make sense of. I may start to link to that page from now on.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 695396 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 695442 - Posted: 28 Dec 2007, 21:58:43 UTC - in response to Message 695396.  

the interface gigabitethernet2_3 is looking towards the seti servers so packets in and packets out are reversed

the interface gigabitethernet5_1 is looking at the internet so packets in and packets out are normal

Thank you very much for the new Cricket Graph reference.....
Much easier to make sense of. I may start to link to that page from now on.

Don't be surprised if after the holidays there's a lot of non-SETI traffic on that page.
                                                                 Joe
ID: 695442 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 695450 - Posted: 28 Dec 2007, 22:16:53 UTC - in response to Message 695442.  


Don't be surprised if after the holidays there's a lot of non-SETI traffic on that page.
                                                                 Joe

Thanx for the heads up. I'll compare the two next year and see what happens....
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 695450 · Report as offensive

Message boards : Technical News : Tweenday One (Dec 26 2007)


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.