Maxed (Dec 16 2010)

Message boards : Technical News : Maxed (Dec 16 2010)

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next

AuthorMessage
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1441
Credit: 213,689
RAC: 0
United States
Message 1057238 - Posted: 17 Dec 2010, 22:04:12 UTC

The extended outages are not just server related but sanity related. It's nice to have several days a week where it doesn't matter what the systems are doing and we can get other work done. That said, I think if things are turning out well we can certainly reduce our regular outages.

- Matt


-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ID: 1057238 · Report as offensive
B-Man
Volunteer tester

Send message
Joined: 11 Feb 01
Posts: 253
Credit: 147,366
RAC: 0
United States
Message 1057267 - Posted: 17 Dec 2010, 23:24:58 UTC - in response to Message 1057238.

The extended outages are not just server related but sanity related. It's nice to have several days a week where it doesn't matter what the systems are doing and we can get other work done. That said, I think if things are turning out well we can certainly reduce our regular outages.

- Matt

But Matt sanity is so over rated. Take the time if needed I at least will still be here. May I suggest a 2 day outage instead of three if longer ones are still needed. Or have a three day outages every 2nd and 4th tuesday of the month?

ID: 1057267 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6438
Credit: 31,811,254
RAC: 6,524
United States
Message 1057327 - Posted: 18 Dec 2010, 2:20:59 UTC - in response to Message 1057238.

Sanity is over rated. But stress is over rated too.



Janice

ID: 1057327 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,995,720
RAC: 64,638
Germany
Message 1057334 - Posted: 18 Dec 2010, 3:24:10 UTC - in response to Message 1057238.

The extended outages are not just server related but sanity related. It's nice to have several days a week where it doesn't matter what the systems are doing and we can get other work done. That said, I think if things are turning out well we can certainly reduce our regular outages.

- Matt


How much and which kind of server/s is/are needed for to let run SETI@home and 'background work' 24/7?

Maybe the 3rd new server could do this?
Or a 4th or more new server/s is/are needed?

ID: 1057334 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,995,720
RAC: 64,638
Germany
Message 1057335 - Posted: 18 Dec 2010, 3:31:03 UTC - in response to Message 1057334.
Last modified: 18 Dec 2010, 3:42:14 UTC

Would be a 'Dell PowerEdge 2800, 2x (2x 2.8 GHz) XEON' helpful, or not well/useful for SETI@home?

I don't have this server, but I know someone - maybe he would donate this server..


ID: 1057335 · Report as offensive
Profile James SotherdenProject Donor
Avatar

Send message
Joined: 16 May 99
Posts: 10133
Credit: 65,645,076
RAC: 35,049
United States
Message 1057336 - Posted: 18 Dec 2010, 3:42:01 UTC

Job Stress I can relate to. Its also something I hadnt thought of for seti. Before reading Matts response, I was thinking maybe we could donate for a dedicated nitpckr server so we wouldnt have to go thru anymore 3 day outages.

I could deal with another 3 day outage as long as we didnt get ghosts.


[/quote]

Old James

ID: 1057336 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6438
Credit: 31,811,254
RAC: 6,524
United States
Message 1057342 - Posted: 18 Dec 2010, 4:26:59 UTC - in response to Message 1057336.

I can not imagine any kind of system admin without stress.

Having worked in a 24/7 environment(for Sutaru) they would need absolute full redundancy, being able to switch back and forth ALL servers at the first glitch, full battery strings plus backup generator..

When they have the first extra million laying around they might be able to start thinking about it. In which case it would be some time after they find E.T.

If they need 3 days, 3 days is reasonable. If they can cut it back to 2.5(off tuesday morning, on thursday night) that would be awesome. There is still some fine tuning between the last servers going in. And more work is ahead.



Janice

ID: 1057342 · Report as offensive
Profile Gary CharpentierCrowdfunding Project Donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 18617
Credit: 21,382,876
RAC: 20,005
United States
Message 1057345 - Posted: 18 Dec 2010, 4:32:04 UTC - in response to Message 1057336.

Job Stress I can relate to. Its also something I hadnt thought of for seti. Before reading Matts response, I was thinking maybe we could donate for a dedicated nitpckr server so we wouldnt have to go thru anymore 3 day outages.

I could deal with another 3 day outage as long as we didnt get ghosts.


Resend is on, that should significantly help with the ghosts.

ID: 1057345 · Report as offensive
Profile Dirk Sadowski
Volunteer tester

Send message
Joined: 6 Apr 07
Posts: 7066
Credit: 100,995,720
RAC: 64,638
Germany
Message 1057354 - Posted: 18 Dec 2010, 4:52:54 UTC - in response to Message 1057342.

I can not imagine any kind of system admin without stress.

Having worked in a 24/7 environment(for Sutaru) they would need absolute full redundancy, being able to switch back and forth ALL servers at the first glitch, full battery strings plus backup generator..

When they have the first extra million laying around they might be able to start thinking about it. In which case it would be some time after they find E.T.

If they need 3 days, 3 days is reasonable. If they can cut it back to 2.5(off tuesday morning, on thursday night) that would be awesome. There is still some fine tuning between the last servers going in. And more work is ahead.


You worked for me?
I guess - you meant SUBARU, or? ;-)

ID: 1057354 · Report as offensive
Profile Helli_retiered
Volunteer tester
Avatar

Send message
Joined: 15 Dec 99
Posts: 707
Credit: 108,785,585
RAC: 0
Germany
Message 1057417 - Posted: 18 Dec 2010, 7:52:07 UTC - in response to Message 1057238.


...
It's nice to have several days a week where it doesn't matter what the systems are doing ...



hehe

I quite believe it.

In the same way the Stress on YOU Guys lowers - in the same Way the Stress on US increases. :D

Helli
A loooong time ago: First Credits after SETI@home Restart

ID: 1057417 · Report as offensive
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,540,027
RAC: 41,473
United Kingdom
Message 1057449 - Posted: 18 Dec 2010, 11:33:55 UTC - in response to Message 1056774.

We're back to shoveling out workunits as fast as we can. I mentioned in another thread that the gigabit link project is still alive. In fact, the whole lab is interested in getting gigabit connectivity to the rest of campus, which makes the whole battle a lot easier (we'll still have to buy our own bits and get the hardware to keep them separate). Still, it's slow going due to campus staff cutbacks and higher priorities.

Now that, at least temporarily, the balance between server power and communications has swung towards the servers, would it be worth re-considering the compression of MB workunit files before transmission? Not much to be gained (and nothing at all for the incompressible AP files), but every little helps - and it would give Oscar something to do when he's bored ;-)

ID: 1057449 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45878
Credit: 814,701,431
RAC: 121,759
United States
Message 1057458 - Posted: 18 Dec 2010, 11:57:23 UTC - in response to Message 1057449.

We're back to shoveling out workunits as fast as we can. I mentioned in another thread that the gigabit link project is still alive. In fact, the whole lab is interested in getting gigabit connectivity to the rest of campus, which makes the whole battle a lot easier (we'll still have to buy our own bits and get the hardware to keep them separate). Still, it's slow going due to campus staff cutbacks and higher priorities.

Now that, at least temporarily, the balance between server power and communications has swung towards the servers, would it be worth re-considering the compression of MB workunit files before transmission? Not much to be gained (and nothing at all for the incompressible AP files), but every little helps - and it would give Oscar something to do when he's bored ;-)

ROFLMAO....
We wouldn't want Oscar to get bored, now would we?
Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1057458 · Report as offensive
Cheopis

Send message
Joined: 17 Sep 00
Posts: 150
Credit: 16,554,085
RAC: 1,990
United States
Message 1057462 - Posted: 18 Dec 2010, 12:03:44 UTC - in response to Message 1057449.
Last modified: 18 Dec 2010, 12:06:53 UTC

We're back to shoveling out workunits as fast as we can. I mentioned in another thread that the gigabit link project is still alive. In fact, the whole lab is interested in getting gigabit connectivity to the rest of campus, which makes the whole battle a lot easier (we'll still have to buy our own bits and get the hardware to keep them separate). Still, it's slow going due to campus staff cutbacks and higher priorities.

Now that, at least temporarily, the balance between server power and communications has swung towards the servers, would it be worth re-considering the compression of MB workunit files before transmission? Not much to be gained (and nothing at all for the incompressible AP files), but every little helps - and it would give Oscar something to do when he's bored ;-)


I don't know how compressable the data is, but it might well be worth the effort to save the bandwidth.

I don't know if anyone has ever written a lossless compression algorithm for CUDA, but I'd think it might actually be a very good match, and might allow any of the modern servers in the closet that can add a video card to do a significant chunk of compression, while using a GPU rather than a CPU.

Well worth considering after the hardware is sorted out and working efficiently again.

ID: 1057462 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45878
Credit: 814,701,431
RAC: 121,759
United States
Message 1057467 - Posted: 18 Dec 2010, 12:12:26 UTC - in response to Message 1057462.

We're back to shoveling out workunits as fast as we can. I mentioned in another thread that the gigabit link project is still alive. In fact, the whole lab is interested in getting gigabit connectivity to the rest of campus, which makes the whole battle a lot easier (we'll still have to buy our own bits and get the hardware to keep them separate). Still, it's slow going due to campus staff cutbacks and higher priorities.

Now that, at least temporarily, the balance between server power and communications has swung towards the servers, would it be worth re-considering the compression of MB workunit files before transmission? Not much to be gained (and nothing at all for the incompressible AP files), but every little helps - and it would give Oscar something to do when he's bored ;-)


I don't know how compressable the data is, but it might well be worth the effort to save the bandwidth.

I don't know if anyone has ever written a lossless compression algorithm for CUDA, but I'd think it might actually be a very good match, and might allow any of the modern servers in the closet that can add a video card to do a significant chunk of compression, while using a GPU rather than a CPU.

Well worth considering after the hardware is sorted out and working efficiently again.

Not sure exactly what the current situation is, but I questioned Eric before the new servers were ordered about the CPU power they were considering.
He told me that the main bottleneck was with I/O, and that the CPUs would probably be loafing most of the time.
So there may be a lotta CPU time itself available for such a scheme.
Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1057467 · Report as offensive
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,540,027
RAC: 41,473
United Kingdom
Message 1057475 - Posted: 18 Dec 2010, 12:25:36 UTC - in response to Message 1057462.
Last modified: 18 Dec 2010, 12:26:10 UTC

I don't know if anyone has ever written a lossless compression algorithm for CUDA, but I'd think it might actually be a very good match, and might allow any of the modern servers in the closet that can add a video card to do a significant chunk of compression, while using a GPU rather than a CPU.

In general, and where space is available, that might be a useful facility.

The trouble is that extreme-density 2U rackmount servers like Oscar and Carolyn (photos) have very little spare space, and cooling air is at a premium, too. The graphics (card? chip?) in such a server is usually a very minimal spec, to save power and space - all it needs to handle is basic engineering and management displays. You don't want to watch DVDs or play games in a server closet.

ID: 1057475 · Report as offensive
OzzFan
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15107
Credit: 45,257,270
RAC: 41,765
United States
Message 1057527 - Posted: 18 Dec 2010, 15:31:10 UTC - in response to Message 1057475.

You don't want to watch DVDs or play games in a server closet.


Then again, it might give them some entertainment with as much time as they've been spending in there lately! :)

ID: 1057527 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45878
Credit: 814,701,431
RAC: 121,759
United States
Message 1057554 - Posted: 18 Dec 2010, 17:46:49 UTC

Well....
The pipe is no longer maxxed out.

Could the limits be raised now so some of us can do a bit of cache filling before the already announced 3 day outage coming up on Tuesday?

Pleeeeeeeeez?


Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1057554 · Report as offensive
Richard HaselgroveProject Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 11136
Credit: 83,540,027
RAC: 41,473
United Kingdom
Message 1057559 - Posted: 18 Dec 2010, 17:52:03 UTC - in response to Message 1057527.

You don't want to watch DVDs or play games in a server closet.

Then again, it might give them some entertainment with as much time as they've been spending in there lately! :)

OK, your employer / Finance Director (the one who did the deal to buy the server) doesn't want you to be watching DVDs or playing games - ever!

ID: 1057559 · Report as offensive
OzzFan
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15107
Credit: 45,257,270
RAC: 41,765
United States
Message 1057614 - Posted: 18 Dec 2010, 20:48:07 UTC - in response to Message 1057559.

You don't want to watch DVDs or play games in a server closet.

Then again, it might give them some entertainment with as much time as they've been spending in there lately! :)

OK, your employer / Finance Director (the one who did the deal to buy the server) doesn't want you to be watching DVDs or playing games - ever!


Yeah, but they're stick-in-the-muds! ;)

ID: 1057614 · Report as offensive
kittymanProject Donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 45878
Credit: 814,701,431
RAC: 121,759
United States
Message 1057617 - Posted: 18 Dec 2010, 20:55:28 UTC

Meanwhile, we are wasting bandwidth.

Let's get them limits raised or lifted.


Kitties make wonderful traveling companions on your journey through life.

Have made a few friends in this life.
Most were cats.

ID: 1057617 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · Next

Message boards : Technical News : Maxed (Dec 16 2010)


 
©2016 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.