Panic Mode On (113) Server Problems?

Message boards : Number crunching : Panic Mode On (113) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 33 · 34 · 35 · 36 · 37 · Next

AuthorMessage
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22717
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1965370 - Posted: 15 Nov 2018, 16:36:28 UTC

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1965370 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14690
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1965373 - Posted: 15 Nov 2018, 16:50:03 UTC - in response to Message 1965370.  

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.
Yes, I think that's the case. The days of the old padded hard disk box and air freight are gone, and we got a limited but adequate internet connection instead. There's a lot of pre-processing work (radar removal and so on) done along the way, but they've had plenty of time and experience to work on automating that.

27 Mar 2018: Script to transmit data files from ao to berkeley autonomously.
ID: 1965373 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22717
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1965381 - Posted: 15 Nov 2018, 17:41:30 UTC

I think the HPISB has mad HVC with the RSA as SR
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1965381 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51522
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1965383 - Posted: 15 Nov 2018, 17:59:45 UTC

Jeff looked into it and thinks it should be fixed now.
Meow!
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1965383 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1965398 - Posted: 15 Nov 2018, 19:31:19 UTC

Thanks to Seti people who fix the machine...and thanks to Kittyman for sending up the signal (like the bat signal , but maybe with a satellite dish or alien motif) , this is going to take a while to recover from.
ID: 1965398 · Report as offensive
Phud Redux

Send message
Joined: 20 Apr 16
Posts: 270
Credit: 2,976,272
RAC: 1
United States
Message 1965429 - Posted: 15 Nov 2018, 22:44:59 UTC

Thanks Mark!
ID: 1965429 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965433 - Posted: 15 Nov 2018, 22:59:34 UTC - in response to Message 1965429.  

Yes, thank kittyman for his usual due diligence in quickly alerting staff to server issues.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965433 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965437 - Posted: 15 Nov 2018, 23:07:27 UTC - in response to Message 1965370.  

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.


. . That would explain the second Arecibo tape appearing at such a strange hour of the day (night) ...

Stephen

?
ID: 1965437 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965439 - Posted: 15 Nov 2018, 23:09:10 UTC - in response to Message 1965381.  

I think the HPISB has mad HVC with the RSA as SR



. . OK, now you're just being mean ....

. . Que?

Stephen

:)
ID: 1965439 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965440 - Posted: 15 Nov 2018, 23:10:38 UTC - in response to Message 1965429.  

Thanks Mark!


. . eerrmm and thanks Jeff

Stephen

:)
ID: 1965440 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 1965542 - Posted: 16 Nov 2018, 9:59:22 UTC

MB Validators are going slow/have given up again. The last time that happened, a few hours later the Splitters called it quits.
Grant
Darwin NT
ID: 1965542 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1965563 - Posted: 16 Nov 2018, 14:08:44 UTC
Last modified: 16 Nov 2018, 14:14:49 UTC

Berkeley has cancelled classes today due to smoke issues. So unless the team can fix things remotely, we might be looking at a problem for a while. Hoping the Seti group stays safe and that the firefighters can get this fire out soon.

edit : just took a look at the status and all seems ok at the moment.

edit: ok, I see it now. it isn't cleaning up. my list of valids is way too long. more than the 24 hour standard. just as was said in previous post, it will go boom at some point, but for now is still running.
ID: 1965563 · Report as offensive
Profile Pierre A Renaud
Avatar

Send message
Joined: 3 Apr 99
Posts: 998
Credit: 9,101,544
RAC: 65
Canada
Message 1965634 - Posted: 16 Nov 2018, 18:49:18 UTC - in response to Message 1965563.  
Last modified: 16 Nov 2018, 19:07:28 UTC

The wildfire situation in California is indeed not looking good when such measures have to be taken =:/

Worsening air quality forces cancellation of classes
By Public Affairs, UC Berkeley| November 15, 2018
https://news.berkeley.edu/2018/11/15/worsening-air-quality-forces-cancellation-of-classes/

The forecast for tomorrow from the Bay Area Air Quality Management District now indicates that conditions are expected to deteriorate. In that context, and based on the guidance of experts on campus, we must assume that the 200 AQI threshold will be exceeded tomorrow. As a result, we have decided to cancel all classes for the remainder of the day today, and on Friday.

Berkeley has cancelled classes today due to smoke issues. So unless the team can fix things remotely, we might be looking at a problem for a while. Hoping the Seti group stays safe and that the firefighters can get this fire out soon.

edit : just took a look at the status and all seems ok at the moment.

edit: ok, I see it now. it isn't cleaning up. my list of valids is way too long. more than the 24 hour standard. just as was said in previous post, it will go boom at some point, but for now is still running.
A preoccupying situation for which I have started a thread
Apr 3, 1999 - May 3, 2020
ID: 1965634 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1858
Credit: 268,616,081
RAC: 1,349
United States
Message 1965635 - Posted: 16 Nov 2018, 18:50:58 UTC

Well, if nothing else someone threw up a load of tapes sufficient to get through the weekend, by the looks of it ...
ID: 1965635 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965640 - Posted: 16 Nov 2018, 19:19:23 UTC
Last modified: 16 Nov 2018, 19:21:25 UTC

I think the conclusion is that "no one" threw any new tapes onto the splitters. The Arecibo tapes are auto-mounted automatically by a script. Probably the Green Bank tapes too but not sure since I didn't see the post saying that GBT had a permanent lab connection.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965640 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13904
Credit: 208,696,464
RAC: 304
Australia
Message 1965696 - Posted: 16 Nov 2018, 23:06:36 UTC - in response to Message 1965635.  

Well, if nothing else someone threw up a load of tapes sufficient to get through the weekend, by the looks of it ...

As long as the system doesn't choke on the Validation/Assimilation backlogs.
Grant
Darwin NT
ID: 1965696 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965704 - Posted: 17 Nov 2018, 0:06:36 UTC - in response to Message 1965640.  

I think the conclusion is that "no one" threw any new tapes onto the splitters. The Arecibo tapes are auto-mounted automatically by a script. Probably the Green Bank tapes too but not sure since I didn't see the post saying that GBT had a permanent lab connection.


. . I remember some discussion about trialling one and deciding it was too expensive so it was dropped. I haven't seen anything since to say that it had been reinstated. There were many volunteers offering to share bandwidth and relay the data to Berkeley but obviously none were taken up. There was also mention of trying to feed it via an internet connection but it was waaay too slow and also worked out very expensive. So I am guessing he was right and someone (thank you) actually took part in the mounting of the additional tapes.

. . But all is for nought if the validators remain stalled and a logjam brings the splitters to a halt as before. For that matter the no14aa tape seems stuck as well.

Stephen

? ?
ID: 1965704 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965709 - Posted: 17 Nov 2018, 0:30:25 UTC - in response to Message 1965704.  

Well Richard's post said the Arecibo files are automatically loaded remotely by a script. So I guess they could afford the permanent connection to AO but not the permanent connection to GBT.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965709 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965730 - Posted: 17 Nov 2018, 1:59:29 UTC - in response to Message 1965704.  
Last modified: 17 Nov 2018, 2:21:56 UTC

. . But all is for nought if the validators remain stalled and a logjam brings the splitters to a halt as before. For that matter the 14no18aa tape seems stuck as well.


. . Correction ...

Stephen

:(
ID: 1965730 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965731 - Posted: 17 Nov 2018, 2:05:25 UTC - in response to Message 1965709.  
Last modified: 17 Nov 2018, 2:16:17 UTC

Well Richard's post said the Arecibo files are automatically loaded remotely by a script. So I guess they could afford the permanent connection to AO but not the permanent connection to GBT.


. . Yep, he did say they have a link to AO. That was not mentioned in the other discussion that I recall but they did say they were investigating getting a piggyback over some other government network. Maybe they were able to do that for AO, so maybe they managed it for GBT as well but that is purely speculation. But since they only seem to be getting 1 or 2 AO tapes per day they may have a cheap low bandwidth link that can support that amount of data. GBT data is far more prolific and would require some serious bandwidth. Even if the roughly 100 tapes that are being mounted in each of the series we have seen lately represent a weeks effort that is about a dozen tapes per day and could be fairly costly bandwidth. Maybe some kind soul will find the time and post about the actual details of their setup.

Stephen

? ?
ID: 1965731 · Report as offensive
Previous · 1 . . . 33 · 34 · 35 · 36 · 37 · Next

Message boards : Number crunching : Panic Mode On (113) Server Problems?


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.