Message boards :
Number crunching :
Panic Mode On (108) Server Problems?
Message board moderation
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 29 · Next
Author | Message |
---|---|
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
Note that SETI has not always been politically supportable in the past, notably following the efforts of Senator William Proxmire: I am sure of that. NASA has been underfunded since the end of Apollo. So if SETI is politically unsupportable, then don't attempt to squeeze funds out of government. The science organizations should be somewhat less politicized. They have their own politics but are not usually tied into government policy decisions. Private enterprise and commercial interests should be even less politicized. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Jeff Buck Send message Joined: 11 Feb 00 Posts: 1441 Credit: 148,764,870 RAC: 0 |
...but I think some of the same attitudes persist on Capitol Hill.If ever there were a place where the search for intelligent life would be more difficult that what we're attempting here, that would be it. There, and that other building just up the road, anyway. ;^) |
Dr.Diesel Send message Joined: 14 May 99 Posts: 41 Credit: 123,695,755 RAC: 139 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. What other announcement from Eric today? I see only the post about the donation letter going out today in News. Where is the post about additional storage? [Edit] Nevermind. It was in the letter itself. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Dr.Diesel Send message Joined: 14 May 99 Posts: 41 Credit: 123,695,755 RAC: 139 |
Keith, please see here: http://setiathome.berkeley.edu/donor_letter_nov17.php |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. I wouldn't consider $7000 (Toshiba 3TB @$70 X 100) a huge cost if they get $70,000 a year for donations. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Dr.Diesel Send message Joined: 14 May 99 Posts: 41 Credit: 123,695,755 RAC: 139 |
[quote]I wouldn't consider $7000 (Toshiba 3TB @$70 X 100) a huge cost if they get $70,000 a year for donations. It's not quite that easy. :) |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13832 Credit: 208,696,464 RAC: 304 |
My machines ran out of work last night too, and the last two outages they have set idle running out of work (though I think I'm prepared for bunkering now, but manual intervention shouldn't really be necessary given the outages are scheduled and known). If the project really needs our computing resources sounds like there are fairly easy opportunities to improve? The database is unable to function with the large numbers of WUs that would be needed to keep the fastest hosts operating through the weekly outage, hence the serverside limits. It would be good if the maximum cache size could be set to something like 4 days, or even just 2 days. Then the WUs the many slower hosts have could then be given to faster hosts instead, without increasing the load on the database any more than it presently is. Or if the present database storage was replaced with an AFA (All Flash Array) and faster & greater RAM on the main database computer so the weekly outage becomes an hour or less. Anyone got $750,000 to spare? Even better would be BOINC just being able to download work for a system, and the client on the computer determines what goes to the CPU or GPU (or external processing unit), taking in to account each projects WUs and what hardware can & can't process it. But that's something for the future. Grant Darwin NT |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13832 Credit: 208,696,464 RAC: 304 |
I wouldn't consider $7000 (Toshiba 3TB @$70 X 100) a huge cost if they get $70,000 a year for donations. It is if all the $70,000 is already fully allocated with none left over. Grant Darwin NT |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
. . There is one flaw in that thought process, and that is the premise that they are doing us a favour. It is in fact the other way around. The time, the hardware, and the most expensive part these days, the electricity, to perform the greater part of the data processing (and cost) is provided by US collectively as volunteers. Not to say there aren't substantial costs involved at Berkeley HQ but that cost is dwarfed by the costs borne by the multitude of remote hosts. . . The main issue is that it is not for any individuals personal benefit. It is a collective effort to do everyone a favour (hopefully) by finding evidence that we are not the only developed species in the entire cosmos (at least that part of it which we can perceive). The problem for contributors such as Keith is the feeling that HQ is letting us down. That is a great motivation destroyer, made more so when we are asked to fund that central effort. But as you say, institutional funding for a project such as SETI is pretty lean and they rely on the corps of hopefully avid volunteers to build it up that little bit higher. We are not the only source of funding, nor I am sure the primary source, but a much needed part of the funding stream to keep the project going. So for those who really believe this project is worthwhile please keep the faith and continue to support it. Stephen :) |
betreger Send message Joined: 29 Jun 99 Posts: 11408 Credit: 29,581,041 RAC: 66 |
We are not the only source of funding, nor I am sure the primary source, but a much needed part of the funding stream to keep the project going. So for those who really believe this project is worthwhile please keep the faith and continue to support it. +1 |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. . . To be fair it would be a little more as they would need to be a raid array for security. But less than double that I am sure. But even at $10K to $12k it is a significant burden but not what I would consider a HUGE cost, especially compared to other requirements that are much more expensive. Stephen ?? |
Stephen "Heretic" Send message Joined: 20 Sep 12 Posts: 5557 Credit: 192,787,363 RAC: 628 |
. . I can see the sense in that! :) . . But sadly I don't see the reduction in database size achieved on slower crunchers would be close to large enough to make a balanced equation with the demand from faster machines, but of course the download limits would prevent any significant bloat there. . . Hang on I'll check my wallet! :) Stephen :) |
Dr.Diesel Send message Joined: 14 May 99 Posts: 41 Credit: 123,695,755 RAC: 139 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. Lots of parts still missing: - 100 bay enclosure, SuperMicro makes a 90 bay for $6000 (However you would not use 3TB drives for an array of this size) - Toshiba 3TB drives are SATA, so you'll need a 100 port controller card, which isn't made, but you can get low range 24 port cards for ~$500/each - MB/RAM/Fiber cards? This is not how they'd build such an array anyhow, and we have no idea what throughput is required. Given their budget, this array would be significant, even if they homebrewed it. |
Keith Myers Send message Joined: 29 Apr 01 Posts: 13164 Credit: 1,160,866,277 RAC: 1,873 |
If I didn't think the project worthwhile, there is no way in hell that I would have donated over $80,000 so far to the project in my equipment and electricity costs. And that is just the tally since I built the first two dedicated crunchers in 2011. That isn't even considering the electricity and equipment costs that were accrued since I started with my single computer back in 2001. So I am donating a significant portion of my income each year. I just would like more visible results for my efforts and munificence. And yes I do feel like the project is letting me down. My motivation IS being destroyed by all these "death by a thousand slices" project mishaps each week. Seti@Home classic workunits:20,676 CPU time:74,226 hours A proud member of the OFA (Old Farts Association) |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13832 Credit: 208,696,464 RAC: 304 |
Web site just went AWOL, and the last couple of Scheduler requests have resulted in "Couldn't connect to server" errors and a greater than 5min backoff. Grant Darwin NT |
rob smith Send message Joined: 7 Mar 03 Posts: 22436 Credit: 416,307,556 RAC: 380 |
I often see a drop out somewhere around 06:00 UTC - I guess that might be when the data dump for the third party sites is done. Bob Smith Member of Seti PIPPS (Pluto is a Planet Protest Society) Somewhere in the (un)known Universe? |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13832 Credit: 208,696,464 RAC: 304 |
I often see a drop out somewhere around 06:00 UTC - I guess that might be when the data dump for the third party sites is done. I'll have to keep an eye on the time in future. Looking at the Haveland graphs, it was around 0:700 on them- the database Master-queries-per-second took a dive around the time the Website & Scheduler went AWOL. Probably lasted about 10min . Grant Darwin NT |
HAL9000 Send message Joined: 11 Sep 99 Posts: 6534 Credit: 196,805,888 RAC: 57 |
I'm not up on SETI's current storage infrastructure, but in today's announcement from Eric he mentioned needing 300TB of additional storage! That cost will be huge, especially if that needs to be spinning storage, so any hope for "other" improvements are not likely for a while I presume. Enterprise level 10TB SAS drives are really not that expensive at around $400 each & you can get a 40 port controller for about $750. For performance reasons it would probably be better to break things up across a several controllers instead of one. Which could possible reduce the cost. Really for that kind of storage a SAN or use Cloud storage is probably the best option. Realistically it is probably a matter of contacting the university IT department to allocating more storage. Then their department IT bill goes up. SETI@home classic workunits: 93,865 CPU time: 863,447 hours Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[ |
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13832 Credit: 208,696,464 RAC: 304 |
And we're live again... Hmm. Might take a while to get some GPU work- it looks like the ready-to-send buffer is pretty much all Arecibo VLARs. Grant Darwin NT |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.