Message boards :
Technical News :
Swimming in Data (Jun 20 2012)
Message board moderation
Author | Message |
---|---|
Matt Lebofsky Send message Joined: 1 Mar 99 Posts: 1444 Credit: 957,058 RAC: 0 |
Some news. Yesterday we had our usual weekly outage, and shortly after the floodgates opened again bruno (the upload server) crashed. Except we quickly found it didn't actually crash. It was turned off. By the web-enabled power strip. For no apparent reason. We turned it back on and everything was okay, but now it seems like we have a flaky web-enabled power strip on our hands. It is interesting to note that this power strip was plugged into the same breaker as thinman - the previous webserver system that died during that last unexpected power issues. So maybe some funky voltage clobbered this strip as well. Well, we have a spare one which works so no big shakes there. And yes, we ruled out foul play. As for the crashy desktop machines, I may have fixed one. The theory being, oddly enough, too much thermal grease was employed thus reducing the effectiveness of the heat sink. Oops. Well, I'm not quite convinced that was the problem, and we're burning it in now. If it survives a week without crashing, great. The other system is not doing as well. I think we're aiming to get insurance money from the university to cover the cost of these systems killed or injured during these outages. Meanwhile, we're operational, so no real disaster. In better news, georgem is now not only hosting all the workunits and running some backend BOINC services and scientific analysis processes, but it's also hosting all the data (~13TB) from a recent survey of the galactic center collected at Green Bank Telescope. Several grad students will be processing this data on georgem itself. Also paddym has been cleared to finally reformat all its drives into a giant RAID10, and we can now start the process of duplicating the whole SETI@home informix science database on oscar over there. As well it's already actually serving a mysql database containing Kepler data, also collected at the GBT, which we're soon to use old SERENDIP code to analyze in-house. Oh yeah we also found a bug that had been causing a lot of Astropulse splitters to fail, thus reducing the amount of AP workunits being sent out. This has been fixed, and so expect more AP work. - Matt -- BOINC/SETI@home network/web/science/development person -- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude |
Claggy Send message Joined: 5 Jul 99 Posts: 4654 Credit: 47,537,079 RAC: 4 |
Thanks for the update Matt, Claggy |
JohnDK Send message Joined: 28 May 00 Posts: 1222 Credit: 451,243,443 RAC: 1,127 |
Yes thanks, no least the Astropulse splitters news, I gave up doing AP only on my notebook, couldn't get any cache before the AP stopped being sent, may try again now :) |
Cosmic_Ocean Send message Joined: 23 Dec 00 Posts: 3027 Credit: 13,516,867 RAC: 13 |
Speaking of AP, can those last one or two completed v505's be manually kicked and cleared so the status page can reflect v6 statistics, or is there more to it than that? Linux laptop: record uptime: 1511d 20h 19m (ended due to the power brick giving-up) |
Claggy Send message Joined: 5 Jul 99 Posts: 4654 Credit: 47,537,079 RAC: 4 |
Again speaking of Astropulse, can the sequence of validation be fixed so some pending validations don't sit around indefinitely, for example: Workunit 955322258 Claggy |
Julie Send message Joined: 28 Oct 09 Posts: 34060 Credit: 18,883,157 RAC: 18 |
|
Gary Charpentier Send message Joined: 25 Dec 00 Posts: 30975 Credit: 53,134,872 RAC: 32 |
As well it's already actually serving a mysql database containing Kepler data, also collected at the GBT, which we're soon to use old SERENDIP code to analyze in-house. We will, just no rush. They have to rewrite the multi-beam and astropulse code to accept the different data format from GBT. That needs cash to pay the programmers. Then it rolls out on the Beta project. |
kittyman Send message Joined: 9 Jul 00 Posts: 51477 Credit: 1,018,363,574 RAC: 1,004 |
Thank you for the updates and interesting news on the new servers. Hope the insurance angle works out and the project gets reimbursed for some of the damage caused by the power problems! Meow! "Time is simply the mechanism that keeps everything from happening all at once." |
Dimly Lit Lightbulb 😀 Send message Joined: 30 Aug 08 Posts: 15399 Credit: 7,423,413 RAC: 1 |
Thanks for the news Matt. Member of the People Encouraging Niceness In Society club. |
Ex: "Socialist" Send message Joined: 12 Mar 12 Posts: 3433 Credit: 2,616,158 RAC: 2 |
Thanks Matt, and Gary for the elaboration on the Kepler. #resist |
KB7RZF Send message Joined: 15 Aug 99 Posts: 9549 Credit: 3,308,926 RAC: 2 |
Very good news Matt! Thank you for the updates! |
Slavac Send message Joined: 27 Apr 11 Posts: 1932 Credit: 17,952,639 RAC: 0 |
As well it's already actually serving a mysql database containing Kepler data, also collected at the GBT, which we're soon to use old SERENDIP code to analyze in-house. To add onto this a bit, PaddyM's drives were shipped off to the GBT (their second trip to the telescope) and came back nearly filled with data. That's 21, 2TB drives of data. We'll process GBT on our PC's eventually, but I just wanted to give our users a scale of the data being processed in house vs archived for eventual S@H volunteer processing. Executive Director GPU Users Group Inc. - brad@gpuug.org |
Dimly Lit Lightbulb 😀 Send message Joined: 30 Aug 08 Posts: 15399 Credit: 7,423,413 RAC: 1 |
As well it's already actually serving a mysql database containing Kepler data, also collected at the GBT, which we're soon to use old SERENDIP code to analyze in-house. 42TB, round about five and a half million* astropulses. At one and a half astropulses a day that would keep me crunching for bit :) *maybe inaccurate as I'm bad at mathematics :) Member of the People Encouraging Niceness In Society club. |
Scott Campbell Send message Joined: 27 Jun 99 Posts: 4 Credit: 9,913,372 RAC: 0 |
Matt are we down again on the 23rd? I am down to 5 tasks left and they are small ones. It seems I haven't received anything since the 17th. Thanks, Scott |
Claggy Send message Joined: 5 Jul 99 Posts: 4654 Credit: 47,537,079 RAC: 4 |
Matt are we down again on the 23rd? I am down to 5 tasks left and they are small ones. It seems I haven't received anything since the 17th. According to your host's task page you're received at least 78 tasks since the 17th, have 17 in progess tasks, and received 8 tasks today: All tasks for computer 4964303 Have you supplied suitable cache settings for Boinc 7? (there have been changes to the scheduler for Boinc 7) Claggy |
Keith T. Send message Joined: 23 Aug 99 Posts: 962 Credit: 537,293 RAC: 9 |
Still 37 Astropulse V5 results stuck in the pipe. The last one was reported around 6th June. I think these must need some manual intervention by project staff to validate and purge. NC thread http://setiathome.berkeley.edu/forum_thread.php?id=67920 refers to this. Keith. |
Claggy Send message Joined: 5 Jul 99 Posts: 4654 Credit: 47,537,079 RAC: 4 |
Still 37 Astropulse V5 results stuck in the pipe. The last one was reported around 6th June. I think these must need some manual intervention by project staff to validate and purge. NC thread http://setiathome.berkeley.edu/forum_thread.php?id=67920 refers to this. That's 37 Astropulse v505 results that are stuck, Astropulse v5 has been obsolete for a couple of years now: Setiathome Applications Claggy |
Nick Send message Joined: 11 Oct 11 Posts: 4344 Credit: 3,313,107 RAC: 0 |
Thanks Mat for your update, I was wondering why I was not getting any Astropulse units. The Kite Fliers -------------------- Kite fliers: An imaginary club of solo members, those who don't yet belong to a formal team so "fly their own kites" - as the saying goes. |
KWSN THE Holy Hand Grenade! Send message Joined: 20 Dec 05 Posts: 3187 Credit: 57,163,290 RAC: 0 |
Alert! Even though everything shows as "running" on the "server Status" page, uploads are very slow - and usually don't get through at all. Sunday 1 July, 2012 . Hello, from Albany, CA!... |
tjcares Send message Joined: 6 Feb 11 Posts: 5 Credit: 141,065 RAC: 0 |
I also can't upload at all SETI@Home Enhanced 6.03 and AstroPulse ver 6 6.01 Have a quad core x64 unit here. Seems fixed. Thanks:) |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.