Panic Mode On (113) Server Problems?

Message boards : Number crunching : Panic Mode On (113) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 33 · 34 · 35 · 36 · 37 · Next

AuthorMessage
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1965347 - Posted: 15 Nov 2018, 14:54:20 UTC

Current result creation rate: 0.8923/sec
That is basically what the resends will show. The Arecibo files have the same status as the others, they aren't moving.
No new tasks are being created.
You've got about an hour before the faster machines are empty. Now would be a good time to get it working again.
ID: 1965347 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1965348 - Posted: 15 Nov 2018, 15:00:37 UTC

The kitties have sent word out to the usual suspects.

Meow...............meow................meow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1965348 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1965356 - Posted: 15 Nov 2018, 15:32:48 UTC - in response to Message 1965347.  

mine ran dry over an hour ago.

only the slower machines are still going.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1965356 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965358 - Posted: 15 Nov 2018, 15:59:27 UTC - in response to Message 1965356.  

mine ran dry over an hour ago.

only the slower machines are still going.


. . One machine down, 3 struggling on ...

Stephen

:(
ID: 1965358 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965360 - Posted: 15 Nov 2018, 16:08:42 UTC

Just looked at all the hosts. Everyone is out of gpu work and chewing on the last of the cpu work. Digging through my Einstein and GPUGrid backup work for the gpus.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965360 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22158
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1965370 - Posted: 15 Nov 2018, 16:36:28 UTC

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1965370 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1965373 - Posted: 15 Nov 2018, 16:50:03 UTC - in response to Message 1965370.  

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.
Yes, I think that's the case. The days of the old padded hard disk box and air freight are gone, and we got a limited but adequate internet connection instead. There's a lot of pre-processing work (radar removal and so on) done along the way, but they've had plenty of time and experience to work on automating that.

27 Mar 2018: Script to transmit data files from ao to berkeley autonomously.
ID: 1965373 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22158
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1965381 - Posted: 15 Nov 2018, 17:41:30 UTC

I think the HPISB has mad HVC with the RSA as SR
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1965381 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1965383 - Posted: 15 Nov 2018, 17:59:45 UTC

Jeff looked into it and thinks it should be fixed now.
Meow!
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1965383 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1965398 - Posted: 15 Nov 2018, 19:31:19 UTC

Thanks to Seti people who fix the machine...and thanks to Kittyman for sending up the signal (like the bat signal , but maybe with a satellite dish or alien motif) , this is going to take a while to recover from.
ID: 1965398 · Report as offensive
Phud Redux

Send message
Joined: 20 Apr 16
Posts: 270
Credit: 2,976,272
RAC: 1
United States
Message 1965429 - Posted: 15 Nov 2018, 22:44:59 UTC

Thanks Mark!
ID: 1965429 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965433 - Posted: 15 Nov 2018, 22:59:34 UTC - in response to Message 1965429.  

Yes, thank kittyman for his usual due diligence in quickly alerting staff to server issues.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965433 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965437 - Posted: 15 Nov 2018, 23:07:27 UTC - in response to Message 1965370.  

Just a passing thought - the way that Arecibo data pops up at all sorts of odd times of day makes me think it is an automated process, not relying on a humon to do anything. We know that there is a "hard" link between the telescope and the lab, so it would be perfectly possible for the data to arrive down the wire, be chunked into "tapes" and loaded automagially into the feed to the splitters.


. . That would explain the second Arecibo tape appearing at such a strange hour of the day (night) ...

Stephen

?
ID: 1965437 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965439 - Posted: 15 Nov 2018, 23:09:10 UTC - in response to Message 1965381.  

I think the HPISB has mad HVC with the RSA as SR



. . OK, now you're just being mean ....

. . Que?

Stephen

:)
ID: 1965439 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1965440 - Posted: 15 Nov 2018, 23:10:38 UTC - in response to Message 1965429.  

Thanks Mark!


. . eerrmm and thanks Jeff

Stephen

:)
ID: 1965440 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1965542 - Posted: 16 Nov 2018, 9:59:22 UTC

MB Validators are going slow/have given up again. The last time that happened, a few hours later the Splitters called it quits.
Grant
Darwin NT
ID: 1965542 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1965563 - Posted: 16 Nov 2018, 14:08:44 UTC
Last modified: 16 Nov 2018, 14:14:49 UTC

Berkeley has cancelled classes today due to smoke issues. So unless the team can fix things remotely, we might be looking at a problem for a while. Hoping the Seti group stays safe and that the firefighters can get this fire out soon.

edit : just took a look at the status and all seems ok at the moment.

edit: ok, I see it now. it isn't cleaning up. my list of valids is way too long. more than the 24 hour standard. just as was said in previous post, it will go boom at some point, but for now is still running.
ID: 1965563 · Report as offensive
Profile Pierre A Renaud
Avatar

Send message
Joined: 3 Apr 99
Posts: 998
Credit: 9,101,544
RAC: 65
Canada
Message 1965634 - Posted: 16 Nov 2018, 18:49:18 UTC - in response to Message 1965563.  
Last modified: 16 Nov 2018, 19:07:28 UTC

The wildfire situation in California is indeed not looking good when such measures have to be taken =:/

Worsening air quality forces cancellation of classes
By Public Affairs, UC Berkeley| November 15, 2018
https://news.berkeley.edu/2018/11/15/worsening-air-quality-forces-cancellation-of-classes/

The forecast for tomorrow from the Bay Area Air Quality Management District now indicates that conditions are expected to deteriorate. In that context, and based on the guidance of experts on campus, we must assume that the 200 AQI threshold will be exceeded tomorrow. As a result, we have decided to cancel all classes for the remainder of the day today, and on Friday.

Berkeley has cancelled classes today due to smoke issues. So unless the team can fix things remotely, we might be looking at a problem for a while. Hoping the Seti group stays safe and that the firefighters can get this fire out soon.

edit : just took a look at the status and all seems ok at the moment.

edit: ok, I see it now. it isn't cleaning up. my list of valids is way too long. more than the 24 hour standard. just as was said in previous post, it will go boom at some point, but for now is still running.
A preoccupying situation for which I have started a thread
Apr 3, 1999 - May 3, 2020
ID: 1965634 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1849
Credit: 268,616,081
RAC: 1,349
United States
Message 1965635 - Posted: 16 Nov 2018, 18:50:58 UTC

Well, if nothing else someone threw up a load of tapes sufficient to get through the weekend, by the looks of it ...
ID: 1965635 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1965640 - Posted: 16 Nov 2018, 19:19:23 UTC
Last modified: 16 Nov 2018, 19:21:25 UTC

I think the conclusion is that "no one" threw any new tapes onto the splitters. The Arecibo tapes are auto-mounted automatically by a script. Probably the Green Bank tapes too but not sure since I didn't see the post saying that GBT had a permanent lab connection.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1965640 · Report as offensive
Previous · 1 . . . 33 · 34 · 35 · 36 · 37 · Next

Message boards : Number crunching : Panic Mode On (113) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.