What the heck is going on??

Message boards : Number crunching : What the heck is going on??
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 646967 - Posted: 23 Sep 2007, 4:07:44 UTC - in response to Message 646957.  

Vent away,,,,get it off your chest... Since I started collecting data, every several days I end up setting my hosts to No New Work, so I can drain them before switching apps, then when I try to get more work....... I feel your pain. actually, last week it's seems to work OK. We have noticed that when these quick wus are split from the discs, that everyone is normally requesting more work units to fill the same period of time, even though they have limited storage for "wus ready to send", so When they send out "shorties", they always run dry (or atleast they have the last few times). The ONLY way to assure work is to set a higher cache. Higher caches are generally frowned upon by some users, so try to find something that works for YOU. If two doesn't work across all AR's then try 3, If that doesn't work, go for 4, then 5 etc, until you can weather any issue.

Currently the servers are running, it's just that we're sucking the work up faster than they can stock it up.


Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

ID: 646967 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 646974 - Posted: 23 Sep 2007, 4:20:39 UTC

I do infact know. I just wrote about it a minute ago in this post to another user.
ID: 646974 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 646976 - Posted: 23 Sep 2007, 4:28:47 UTC

I imagine if they had enough hard drive space say 50 Terabytes, and enough servers to "presplit and store" wus, then they might be able to sort the work by AR and distribute according to your idea.
ID: 646976 · Report as offensive
Profile KWSN - MajorKong
Volunteer tester
Avatar

Send message
Joined: 5 Jan 00
Posts: 2892
Credit: 1,499,890
RAC: 0
United States
Message 646980 - Posted: 23 Sep 2007, 4:37:17 UTC - in response to Message 646967.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.



Why should they? The "20-minute" short workunits need processing just as much as the long ones do. The Project hasn't guaranteed that there will be work available for any particular participant to download at any given time. In fact, they have stated that there will be times when there won't be.


There is data being split from the tapes. The (currently) 5 MultiBeam splitters are running, grinding out over 12 results per second. Someone is getting these. They are just going out as fast as they are being split, so there is no surplus being built up. There are times (like now) that, due to the data being split (short-run Angle Ranges and noisy (-9) workunits), the total processing capacity of the computers attached to S@H exceeds the amount of data that the project can supply. While the project staff are working to increase their splitting capacity (too many splitters running currently bog down their internal networks and servers), for now we just have to deal with it. But even that is going to eventually have its limits, and with ever-increasing processing capacity among the participants, we are going to hit the wall once again... on a permanent basis... sooner or later...

This is why EVERY participant in S@H/BOINC is strongly encouraged to attach to another BOINC project (or projects) in addition to S@H -- to keep their computers from going idle when S@H is 'out of work' and share out the processing capacity to other, equally deserving projects. Those who choose to not do so (and run S@H only) have effectively consented to having their computers be idle when S@H is 'out of work'.
https://youtu.be/iY57ErBkFFE

#Texit

Don't blame me, I voted for Johnson(L) in 2016.

Truth is dangerous... especially when it challenges those in power.
ID: 646980 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 646987 - Posted: 23 Sep 2007, 5:17:48 UTC - in response to Message 646967.  
Last modified: 23 Sep 2007, 5:19:12 UTC


Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.


My fastest box just spent the last 2 days crunching nothing except the short 20 minute WU's in its cache. Finished a couple of hours ago. Now my next fastest box started doing the same thing and I expect it to take 2 days for it to complete all of it's 20 minute WU's. Not complaining as it is part of carrying a cache on the computers and I pride myself in crunching all the work assigned to me and my boxes.




Boinc....Boinc....Boinc....Boinc....
ID: 646987 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 646996 - Posted: 23 Sep 2007, 5:46:33 UTC - in response to Message 646987.  


Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.


My fastest box just spent the last 2 days crunching nothing except the short 20 minute WU's in its cache. Finished a couple of hours ago. Now my next fastest box started doing the same thing and I expect it to take 2 days for it to complete all of it's 20 minute WU's. Not complaining as it is part of carrying a cache on the computers and I pride myself in crunching all the work assigned to me and my boxes.



Well that's my problem, I'm crunching it all and then some LOL. I don't mind the small WUs as long as my machines can get 'em. But everyone tears through them so fast these days.
ID: 646996 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 647033 - Posted: 23 Sep 2007, 8:15:38 UTC - in response to Message 646967.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.
ID: 647033 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 647037 - Posted: 23 Sep 2007, 8:23:50 UTC - in response to Message 647033.  
Last modified: 23 Sep 2007, 8:24:13 UTC

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

RAC upto 1620ish now and pending upto 7500+

[edit] oh and three machines bone dry again [/edit]
ID: 647037 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 647044 - Posted: 23 Sep 2007, 8:29:38 UTC - in response to Message 647037.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

Great thought, but I'm afraid they probably need more than just adapters. Have a look at this thread - it started life here, but got moved to the Staff Blog for some reason. The servers they need to replace are:

# kosh: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# klaatu: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# penguin: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)

- could you check whether your carton has Solaris drivers on the CD? <grin>

ID: 647044 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 647046 - Posted: 23 Sep 2007, 8:32:44 UTC - in response to Message 647044.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

Great thought, but I'm afraid they probably need more than just adapters. Have a look at this thread - it started life here, but got moved to the Staff Blog for some reason. The servers they need to replace are:

# kosh: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# klaatu: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# penguin: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)

- could you check whether your carton has Solaris drivers on the CD? <grin>



Hrmmm... well I have an HP Proliant DL 145 1U server sitting on my desk doing diddly squat. If they could arrange to cover the shipping it would be theres. nice box. I think I put 2 1.6 gig Opterons in it (it's too loud to run as a cruncher LOL). 2 or 4 gigs of ram, but ram is cheap.
ID: 647046 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 647050 - Posted: 23 Sep 2007, 8:43:04 UTC - in response to Message 647046.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

Great thought, but I'm afraid they probably need more than just adapters. Have a look at this thread - it started life here, but got moved to the Staff Blog for some reason. The servers they need to replace are:

# kosh: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# klaatu: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# penguin: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)

- could you check whether your carton has Solaris drivers on the CD? <grin>


Hrmmm... well I have an HP Proliant DL 145 1U server sitting on my desk doing diddly squat. If they could arrange to cover the shipping it would be theres. nice box. I think I put 2 1.6 gig Opterons in it (it's too loud to run as a cruncher LOL). 2 or 4 gigs of ram, but ram is cheap.

Well, shipping from Canada probably makes more sense than shipping from the UK. If you're serious, why not drop Blurf a private message? He might be able to pair you up with another donor who could pick up the tab for the shipping, and a third to toss in a bit of extra RAM.
ID: 647050 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 647051 - Posted: 23 Sep 2007, 8:46:53 UTC - in response to Message 647050.  
Last modified: 23 Sep 2007, 8:51:29 UTC

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

Great thought, but I'm afraid they probably need more than just adapters. Have a look at this thread - it started life here, but got moved to the Staff Blog for some reason. The servers they need to replace are:

# kosh: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# klaatu: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# penguin: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)

- could you check whether your carton has Solaris drivers on the CD? <grin>


Hrmmm... well I have an HP Proliant DL 145 1U server sitting on my desk doing diddly squat. If they could arrange to cover the shipping it would be theres. nice box. I think I put 2 1.6 gig Opterons in it (it's too loud to run as a cruncher LOL). 2 or 4 gigs of ram, but ram is cheap.

Well, shipping from Canada probably makes more sense than shipping from the UK. If you're serious, why not drop Blurf a private message? He might be able to pair you up with another donor who could pick up the tab for the shipping, and a third to toss in a bit of extra RAM.


Already did. and frankly I'd like to have it off my desk. If someone covers the shipping I might even be able to toss in another couple gigs of ram. It'll bury those old Sparc machines, that much I know.

[edit: 5 machines now offline due to no work units]
ID: 647051 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 647054 - Posted: 23 Sep 2007, 9:00:34 UTC - in response to Message 647051.  

Now I know you probably don't know, but why the heck are the splitters turning out the little short 20 minute WUs. There has to be some way SETI can turn out the WUs based on what's in storage. If the queue gets short, turn out the long ones, if the queue is almost full top it up with little ones. But keep track of the top ups so you don't end up with a full queue of little guys.

I had much the same idea here, and asked Matt if he knew in advance what sort of work was included in each recording session. I don't think he's replied.

As others have commented, it's not a very good long-term solution, but keeping a balance of long and short work going through the splitters would help to keep the stress levels down while the hardware donations drive (they need new servers with Gigabit ethernet) is gathering strength.


If they need gigabit ehternet adapaters I'll send them a box full. Seriously, if that will solve their problems I'll ship em a crate of the damned things (or at least a carton).

Great thought, but I'm afraid they probably need more than just adapters. Have a look at this thread - it started life here, but got moved to the Staff Blog for some reason. The servers they need to replace are:

# kosh: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# klaatu: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)
# penguin: Sun D220R (2 x 440MHz Sparc, 2 GB RAM)

- could you check whether your carton has Solaris drivers on the CD? <grin>


Hrmmm... well I have an HP Proliant DL 145 1U server sitting on my desk doing diddly squat. If they could arrange to cover the shipping it would be theres. nice box. I think I put 2 1.6 gig Opterons in it (it's too loud to run as a cruncher LOL). 2 or 4 gigs of ram, but ram is cheap.

Well, shipping from Canada probably makes more sense than shipping from the UK. If you're serious, why not drop Blurf a private message? He might be able to pair you up with another donor who could pick up the tab for the shipping, and a third to toss in a bit of extra RAM.


Already did. and frankly I'd like to have it off my desk. If someone covers the shipping I might even be able to toss in another couple gigs of ram. It'll bury those old Sparc machines, that much I know.

Great stuff. One down, two to go. Anybody else got a spare server cluttering up their workbench?
ID: 647054 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 647063 - Posted: 23 Sep 2007, 9:51:01 UTC - in response to Message 647054.  


Great stuff. One down, two to go. Anybody else got a spare server cluttering up their workbench?


Well I am really surprised it's that hard for them to find hardware. If I get a response to my private message, I'll see if there are other ways I can help as well. I know some folks at some various manufacturers, I'm sure they can spare some hardware for the cause. (good corporate citizenship and what not).

On the plus side my RAC is upto 1728 and my pending is holding steady around 7500 units.

On the down side I still have 4 machines out of work :/
ID: 647063 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13755
Credit: 208,696,464
RAC: 304
Australia
Message 647066 - Posted: 23 Sep 2007, 10:10:36 UTC - in response to Message 647063.  

Well I am really surprised it's that hard for them to find hardware.

Getting hardware is part of the problem, the other problem is getting hardware that is compatible with all the other hardware received.
Grant
Darwin NT
ID: 647066 · Report as offensive
Osiris30

Send message
Joined: 19 Aug 07
Posts: 264
Credit: 41,917,631
RAC: 0
Barbados
Message 647068 - Posted: 23 Sep 2007, 10:18:03 UTC - in response to Message 647066.  

Well I am really surprised it's that hard for them to find hardware.

Getting hardware is part of the problem, the other problem is getting hardware that is compatible with all the other hardware received.


I just have a hard time believing that one of the big guns out there would have an issue being a corporate sponsor/donor for SETI@Home. Intel, AMD, Microsoft, etc. all have pockets so deep that they would never miss the few thousand dollars it would cost them to support SETI. And the publicity in front of SETI users would certainly be worth the investment.
ID: 647068 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 647100 - Posted: 23 Sep 2007, 12:27:54 UTC - in response to Message 647068.  

Well I am really surprised it's that hard for them to find hardware.

Getting hardware is part of the problem, the other problem is getting hardware that is compatible with all the other hardware received.


I just have a hard time believing that one of the big guns out there would have an issue being a corporate sponsor/donor for SETI@Home. Intel, AMD, Microsoft, etc. all have pockets so deep that they would never miss the few thousand dollars it would cost them to support SETI. And the publicity in front of SETI users would certainly be worth the investment.


Part of the problem is that there's a lot of people out there that feel the Search for Extraterrestrial Intelligence is a waste of time at this point (no offense to SETI, I'm a proud member myself obviously), especially considering the extreme probability that we will not find anything given our current search methods, many feel that solving our own problems such as with Folding@Home and CPDN are much more worthwhile tasks (considering everyone is concerned about going green these days). Donating servers to SETI@Home may not offer as much face time as you'd think, given the current social and political climate.
ID: 647100 · Report as offensive
Kim Vater
Volunteer tester

Send message
Joined: 27 May 99
Posts: 227
Credit: 22,743,307
RAC: 0
Norway
Message 647119 - Posted: 23 Sep 2007, 14:22:00 UTC
Last modified: 23 Sep 2007, 14:24:42 UTC

Another huge problem is, that there doesn't exits a welldocumented flowchart of the serverpark.

I don't think that there exits any documentation at all!
Many people have asked for this over the years, as to be able to offer their help and place accurate hardware-donation.

If one or two key-serverstaff-members leave the project for good (in anger og accidential) the whole projects shuts down IMHO.

My 2 cent.

Kiva
Greetings from Norway

Crunch3er & AK-V8 Inside
ID: 647119 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24881
Credit: 3,081,182
RAC: 7
Ireland
Message 647151 - Posted: 23 Sep 2007, 15:19:37 UTC - in response to Message 647119.  

Osiris30

As a committed seti cruncher, well done on the donation.
ID: 647151 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 647164 - Posted: 23 Sep 2007, 15:30:08 UTC - in response to Message 647119.  

Another huge problem is, that there doesn't exits a welldocumented flowchart of the serverpark.

I don't think that there exits any documentation at all!
Many people have asked for this over the years, as to be able to offer their help and place accurate hardware-donation.

If one or two key-serverstaff-members leave the project for good (in anger og accidential) the whole projects shuts down IMHO.

My 2 cent.

Kiva

Probably the only really key staff member is Eric Korpela, being the project scientist and all. There are at least three other staff members that know as well, we just don't know about them because they don't post. Matt mentions them from time to time.

The BOINC structure sets out the logical servers (upload servers, download servers, schedulers) pretty well. The rest can be found by reading configuration files and DNS and mounts.
ID: 647164 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Number crunching : What the heck is going on??


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.