Panic Mode On (112) Server Problems?

Message boards : Number crunching : Panic Mode On (112) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · 25 . . . 33 · Next

AuthorMessage
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1942745 - Posted: 5 Jul 2018, 14:25:43 UTC

I must say the system has been running so well lately that there has been nothing to panic about. I agree the system did great last outage at recovering.

Right now we have file 04jl18ab with a ton of errors though and not many files in the splitting queue.

Is there a way to get the date of the gbt files without opening them up?? Last I looked it seemed we were working on files from March 2018, so I hope they have a bunch more for us to work on.
ID: 1942745 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1942747 - Posted: 5 Jul 2018, 14:46:04 UTC - in response to Message 1942745.  

Is there a way to get the date of the gbt files without opening them up??
Eric posted a note soon after we started processing them - the key value is 'modified Julian date' immediately following 'guppi'.

In turn, the number and position of the fields in the BLC file names varies enormously. Can anybody suggest or write code - ideally as an SQL query - which can extract the key values (for me, Modified Julian Date, Object Name, and Observation sequence number) reliably into a consistent format?
ID: 1942747 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1942749 - Posted: 5 Jul 2018, 15:56:34 UTC - in response to Message 1942745.  

Right now we have file 04jl18ab with a ton of errors though and not many files in the splitting queue.

I got word back from Eric that he is looking into the splitter errors now. Some kind of file system problem on lando.
Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1942749 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942753 - Posted: 5 Jul 2018, 16:57:47 UTC - in response to Message 1942747.  
Last modified: 5 Jul 2018, 16:59:56 UTC

Is there a way to get the date of the gbt files without opening them up??
Eric posted a note soon after we started processing them - the key value is 'modified Julian date' immediately following 'guppi'.

In turn, the number and position of the fields in the BLC file names varies enormously. Can anybody suggest or write code - ideally as an SQL query - which can extract the key values (for me, Modified Julian Date, Object Name, and Observation sequence number) reliably into a consistent format?

A quick search turned up this Modified Julian Date Converter. Modified Julian Day Converter which makes it easy to convert the BLC task names for their acquisition date. The second number in the file name is how many seconds after midnight for the observation. The Arecibo tasks are self explanatory in the file name being the observation date.

[Edit] The current BLC tasks being split were acquired April 19, 2018
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942753 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1942756 - Posted: 5 Jul 2018, 17:42:36 UTC - in response to Message 1942753.  

A quick search turned up this Modified Julian Date Converter. Modified Julian Day Converter which makes it easy to convert the BLC task names for their acquisition date. The second number in the file name is how many seconds after midnight for the observation. The Arecibo tasks are self explanatory in the file name being the observation date.

[Edit] The current BLC tasks being split were acquired April 19, 2018
Yes, I found that, but the question was code - I've got a database with ~230,000 task names, and I don't want to paste them all into an online form!

Somewhat to my surprise, I ended up with just 35 recording days, from 09-Jan-2016 to 19-Apr-2018, and up to 60 tapes recorded per day. I need to check that more carefully in the morning.
ID: 1942756 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942758 - Posted: 5 Jul 2018, 18:09:40 UTC - in response to Message 1942756.  

I thought I knew why you were asking for a SQL code writer given your listings about past "tapes"

I was mainly posting the link for the OP request on how to decipher the BLC task names. That site said it uses JavaScript and there might be some already worked out hooks into a SQL database to parse the task names through the converter. Above my knowledge.

Just another tidbit about the task names. For the most part, all of our observations have been primarily of objects from the Hipparchos astronomical catalog. With a few outliers of Messier objects and a few more from the Pulsar catalogs. The reason for the predominance of Hipparchos targets is that is the most general catalog of stars. The Messier and NGC catalogs are of larger objects like galaxies and nebulae. It is more likely to find planets around stars (also they are usually much closer being in our own galaxy) and possible alien civilizations radio frequency output from those planets are what we are searching for.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942758 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1942763 - Posted: 5 Jul 2018, 18:54:55 UTC

One of my Android devices has been stuck trying to upload finished tasks for the greater part of today. It's empty (as Android has no cache) and thus stuck at doing nothing. Anyone else having trouble to upload?
ID: 1942763 · Report as offensive
Profile Sebastian M. Bobrecki
Volunteer tester

Send message
Joined: 7 Feb 02
Posts: 23
Credit: 38,375,443
RAC: 0
Poland
Message 1942766 - Posted: 5 Jul 2018, 19:12:15 UTC - in response to Message 1942747.  

...
In turn, the number and position of the fields in the BLC file names varies enormously. Can anybody suggest or write code - ideally as an SQL query - which can extract the key values (for me, Modified Julian Date, Object Name, and Observation sequence number) reliably into a consistent format?

In MySQL You can try something like this to obtain date:
select timestampadd(SECOND,floor(86400*cast(replace(substring_index(substring_index("blc15_2bit_guppi_58227_21810_HIP67105_0060","_","5"),"_","-2"),"_",".") as DECIMAL(12,6))) ,"1858-11-17");

ID: 1942766 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942771 - Posted: 5 Jul 2018, 19:47:37 UTC - in response to Message 1942763.  

One of my Android devices has been stuck trying to upload finished tasks for the greater part of today. It's empty (as Android has no cache) and thus stuck at doing nothing. Anyone else having trouble to upload?

None of my 3 Android devices is having trouble uploading.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942771 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942772 - Posted: 5 Jul 2018, 19:48:24 UTC

Richard will appreciate the MySQL query code Sebastian. Hope it works for him.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942772 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1942784 - Posted: 5 Jul 2018, 21:47:33 UTC - in response to Message 1942771.  

Thanks for that. Apparently it had a problem with itself. I rebooted it and on BOINC restart it uploaded/reported the stuck tasks & downloaded 4 more. Together with the spare Huawei phone it's now in a foam shell with the 200mm BitFenix fan at the bottom and the 230mm fan at the top. Super cool in there. :)
ID: 1942784 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942795 - Posted: 5 Jul 2018, 23:29:44 UTC - in response to Message 1942784.  

That's a pretty trick solution to keep the phones cool. I have to admit my phone gets darn hot just sitting on the kitchen counter while crunching. I have actually seen the LCD screen on the 4 core Kindle yellow from the heat of crunching.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942795 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1942799 - Posted: 6 Jul 2018, 0:07:02 UTC - in response to Message 1942795.  
Last modified: 6 Jul 2018, 0:16:51 UTC

Repurposing half of the foam shell my Zyxel NAS came in for my small Android farm. :)

One is an Archos tablet, that one gets the hottest by touch. How hot it is, I can't tell as none of the CPU/temperature apps out there can measure its temperature. I think Archos did some changes to its Android 7.1.1, as I can't root this thing either. Had a huge difficulty getting BOINC installed and running. In the end I had to remove or disable 75% of the preinstalled apps before BOINC would work.

The Huawei G700-U10 phone gets only very hot as soon as I turn on the screen. Before (or at least from the time I see it when I turn on the screen) the temperature is around 38C, but with the screen on and no cooling, this quickly rises to 65C. With the cooling it goes up to around 50C. I'll leave the screen off for most of the time. :)
ID: 1942799 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1942818 - Posted: 6 Jul 2018, 1:46:40 UTC

Plenty of new files loaded I see. And another Arecibo from last night. Should make the AP mongers happy for a day.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1942818 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1942851 - Posted: 6 Jul 2018, 7:20:11 UTC - in response to Message 1942818.  

Plenty of new files loaded I see. And another Arecibo from last night. Should make the AP mongers happy for a day.
And even those who just happen by chance on them. ;-)

Cheers.
ID: 1942851 · Report as offensive
Profile KWSN THE Holy Hand Grenade!
Volunteer tester
Avatar

Send message
Joined: 20 Dec 05
Posts: 3187
Credit: 57,163,290
RAC: 0
United States
Message 1942898 - Posted: 6 Jul 2018, 17:22:06 UTC

could someone "hang a tape or tapes" (old term, not sure what a newer term is for this - I'm from mainframe days...) on Beta? Beta is out of work to distribute...
.

Hello, from Albany, CA!...
ID: 1942898 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1942900 - Posted: 6 Jul 2018, 18:01:04 UTC - in response to Message 1942898.  

could someone "hang a tape or tapes" (old term, not sure what a newer term is for this - I'm from mainframe days...) on Beta? Beta is out of work to distribute...

I call 'em datasets, but I think I made that term up myself.
Is Beta testing something new?
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1942900 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1942953 - Posted: 6 Jul 2018, 23:52:06 UTC - in response to Message 1942900.  

could someone "hang a tape or tapes" (old term, not sure what a newer term is for this - I'm from mainframe days...) on Beta? Beta is out of work to distribute...

I call 'em datasets, but I think I made that term up myself.
Is Beta testing something new?


. .Nah, it's been around for ages ...

Stephen

:) I couldn't help myself ...
ID: 1942953 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1942961 - Posted: 7 Jul 2018, 0:14:35 UTC - in response to Message 1942953.  

could someone "hang a tape or tapes" (old term, not sure what a newer term is for this - I'm from mainframe days...) on Beta? Beta is out of work to distribute...

I call 'em datasets, but I think I made that term up myself.
Is Beta testing something new?


. .Nah, it's been around for ages ...

Stephen

:) I couldn't help myself ...

LOL...Ok, ya zinged me on that one.
Meeeeeeeeeeeeeeeeow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1942961 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1943700 - Posted: 11 Jul 2018, 18:34:42 UTC

yes! they need to load some more data for recovery after a LONG outrage! Thank you Seti Team for getting it all working again!
ID: 1943700 · Report as offensive
Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · 25 . . . 33 · Next

Message boards : Number crunching : Panic Mode On (112) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.