Panic Mode On (108) Server Problems?


Advanced search

Message boards : Number crunching : Panic Mode On (108) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 29 · Next

AuthorMessage
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1903333 - Posted: 28 Nov 2017, 12:26:31 UTC

It looks like the splitters started their maintenance break a few hours early ...
ID: 1903333 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1903339 - Posted: 29 Nov 2017, 0:27:11 UTC

and we are back..
ID: 1903339 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1856
Credit: 268,616,081
RAC: 1,349
United States
Message 1903340 - Posted: 29 Nov 2017, 0:29:42 UTC

All MB channels being split, both GBT and Aricebo, are showing errors on the SSP.
ID: 1903340 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1903341 - Posted: 29 Nov 2017, 0:32:44 UTC - in response to Message 1903340.  

They must still have a bad drive in the array or the one they kicked out recently somehow got reworked back in.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1903341 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1856
Credit: 268,616,081
RAC: 1,349
United States
Message 1903348 - Posted: 29 Nov 2017, 1:04:42 UTC - in response to Message 1903341.  
Last modified: 29 Nov 2017, 1:15:56 UTC

They must still have a bad drive in the array or the one they kicked out recently somehow got reworked back in.

Maybe, but APs are splitting fine.
ID: 1903348 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1856
Credit: 268,616,081
RAC: 1,349
United States
Message 1903351 - Posted: 29 Nov 2017, 1:16:27 UTC

All PFB and GBT splitters have now failed.
ID: 1903351 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1903355 - Posted: 29 Nov 2017, 1:29:12 UTC - in response to Message 1903351.  

All PFB and GBT splitters have now failed.


. . Oops! prepare for a famine ...

Stephen

:(
ID: 1903355 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1903364 - Posted: 29 Nov 2017, 1:47:50 UTC - in response to Message 1903355.  

All PFB and GBT splitters have now failed.


. . Oops! prepare for a famine ...

Stephen

:(

Yep, nada available. Unless someone is working late in the lab, we might go dry overnight.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1903364 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1903426 - Posted: 29 Nov 2017, 6:31:40 UTC - in response to Message 1903421.  

And so it is. Breakthrough Listen splitting fails totally, and Arecibo is totally gone from Splitter Status.
11 hours outage, and the project never really came back.
Beta dry too. Computer will be shut down.


. . Yep, my little farm will also have a holiday ...

Stephen

:(
ID: 1903426 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22540
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1903448 - Posted: 29 Nov 2017, 8:05:55 UTC

Looking at the SSP - either there are some bad tapes or the splitters have gone rouge. We'll have to wait for the Tyre Kicker to get in later today and administer his "Delicately Applied Size Ten Boot).....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1903448 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13855
Credit: 208,696,464
RAC: 304
Australia
Message 1903455 - Posted: 29 Nov 2017, 8:44:05 UTC

AP Validators/assimilators also appear to still be out of action as well. Backlogs continue to climb.
Grant
Darwin NT
ID: 1903455 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1903463 - Posted: 29 Nov 2017, 10:47:11 UTC

Apparently the Master Science database (that's the long-term storage of completed results, not the day-to-day BOINC server that we interact with every day) crashed after 241 days of continuous running. It's restarted, and appears to be running OK, but I guess they're keeping it lightly loaded overnight so they can run further tests in daylight.
ID: 1903463 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1903469 - Posted: 29 Nov 2017, 11:08:52 UTC - in response to Message 1903463.  

Apparently the Master Science database (that's the long-term storage of completed results, not the day-to-day BOINC server that we interact with every day) crashed after 241 days of continuous running. It's restarted, and appears to be running OK, but I guess they're keeping it lightly loaded overnight so they can run further tests in daylight.


. . Thanks Richard.

Stephen

..
ID: 1903469 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22540
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1903477 - Posted: 29 Nov 2017, 12:06:51 UTC

...AP splitters (that are running) look to be delivering a little usable work.
However the MB/PFBs are just churning out lots of errors......
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1903477 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14679
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1903478 - Posted: 29 Nov 2017, 12:07:46 UTC - in response to Message 1903473.  

MB channels (pfb splitter) are all ending in error again. That was the first sign of trouble yesterday.
ID: 1903478 · Report as offensive
Phil Burden

Send message
Joined: 26 Oct 00
Posts: 264
Credit: 22,303,899
RAC: 0
United Kingdom
Message 1903483 - Posted: 29 Nov 2017, 12:43:26 UTC - in response to Message 1903479.  

Yup, still very much F'ed up.
And I only have 9 CPU tasks left to run, and then my computer begins to produce icicles :-)


Get rid of water cooking on your cpu, then no icicles ;-)

P.
ID: 1903483 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1903485 - Posted: 29 Nov 2017, 12:54:16 UTC - in response to Message 1903479.  

Yup, still very much F'ed up.
And I only have 9 CPU tasks left to run, and then my computer begins to produce icicles :-)
And what's wrong with a little ice for your drinks at 7am :D
Cheers!
ID: 1903485 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51478
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1903493 - Posted: 29 Nov 2017, 13:54:38 UTC - in response to Message 1903491.  

One _3 blc, and one newly split AP.
Not much, but more than nothing :-)

Something is usually better than nothing.
In this case, not so much though.

Meowsigh.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1903493 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1903505 - Posted: 29 Nov 2017, 14:41:40 UTC - in response to Message 1903473.  

It's slowly coming to life now. One pfb splitter running, and 4 AP splitters.
No work delivered yet though.
Let's see what happens.


. . The splitters are up and down like yoyos

Stephen

:(

Sleep time for me and the guys ........
ID: 1903505 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1903507 - Posted: 29 Nov 2017, 14:47:41 UTC - in response to Message 1903479.  

Yup, still very much F'ed up.
And I only have 9 CPU tasks left to run, and then my computer begins to produce icicles :-)


. . All 3 machines empty and shut down, this one is getting some house cleaning then sleepy bobo's.

Stephen

:(
ID: 1903507 · Report as offensive
Previous · 1 . . . 13 · 14 · 15 · 16 · 17 · 18 · 19 . . . 29 · Next

Message boards : Number crunching : Panic Mode On (108) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.