Panic Mode On (113) Server Problems?

Message boards : Number crunching : Panic Mode On (113) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · 25 . . . 37 · Next

AuthorMessage
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1959166 - Posted: 8 Oct 2018, 1:01:08 UTC - in response to Message 1959165.  



. . Now all we need is someone to give the pfb splitter a kick and mount some more tapes in the next 24 hours before the current units are exhausted.

Stephen

:)


They loaded more tapes and the splitters are working hard, but it is hard to come back from the earlier outage.
ID: 1959166 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1959172 - Posted: 8 Oct 2018, 1:37:51 UTC - in response to Message 1959166.  
Last modified: 8 Oct 2018, 1:54:41 UTC



. . Now all we need is someone to give the pfb splitter a kick and mount some more tapes in the next 24 hours before the current units are exhausted.

Stephen

:)


They loaded more tapes and the splitters are working hard, but it is hard to come back from the earlier outage.


. . Yes, it will take a while for the RTS buffer to recover, things will be hit and miss until then. But I was concerned that with the high rate of noise bombs we saw in the last 24 hours the remaining Blc22 tapes might disappear all too quickly.

. . More tapes mounted is a good thing. But at 41/sec I wouldn't say the splitters were working hard, but they are working. If they were stepped up to max (70 to 90/sec) then the RTS buffer might be showing more recovery ...

Stephen

:)
ID: 1959172 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13855
Credit: 208,696,464
RAC: 304
Australia
Message 1959209 - Posted: 8 Oct 2018, 5:40:45 UTC - in response to Message 1959148.  

The assimilators are NOT running. At what point will this be a problem??

Unknown.

It has happened in the past that the assimilators weren't running for a while & everything came to a grinding halt when they ran out of disk space.
But what the current storage levels are, and at what point space becomes an issue & everything grinds to a halt I haven't clue.

I notice too that the Arecibo file27se18ab is still sitting there with 2 channels in progress. I think that's been the case for several days now.
And the purge numbers (both results and WUs) appear to have flat lined.
Grant
Darwin NT
ID: 1959209 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1959215 - Posted: 8 Oct 2018, 6:31:43 UTC - in response to Message 1959209.  
Last modified: 8 Oct 2018, 6:37:29 UTC

I have a feeling that it is also the job of the assimilator to tell the scheduler when a task is old enough to be deleted.

It is understandable that the purge number wouldn't climb without the assimilator running, since it isn't finished with it yet.

EDIT: Duhh, the db_purge script isn't running ...
ID: 1959215 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1959354 - Posted: 9 Oct 2018, 1:22:00 UTC

it looks like the stats are down again. havent seen FreeDC and BoincStats stats for several days. but the numbers listed here on the website seem to be updating.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1959354 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1959356 - Posted: 9 Oct 2018, 1:42:23 UTC - in response to Message 1959354.  

Yes. the servers have lots of things messed up now. Expect a long outage tomorrow to hopefully straighten things out properly. We shall see I guess.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1959356 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1959361 - Posted: 9 Oct 2018, 2:31:09 UTC - in response to Message 1959356.  

Yes. the servers have lots of things messed up now. Expect a long outage tomorrow to hopefully straighten things out properly. We shall see I guess.


I certainly agree!! Hopefully they can fix some of the problems that have been happening for a couple of weeks now during Tuesday's outage (outrage?? - probably)
ID: 1959361 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13855
Credit: 208,696,464
RAC: 304
Australia
Message 1959384 - Posted: 9 Oct 2018, 9:49:54 UTC

Uploads are getting a bit flaky. Getting a few that are taking a couple of attempts to finally upload.
Grant
Darwin NT
ID: 1959384 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5126
Credit: 276,046,078
RAC: 462
Message 1959387 - Posted: 9 Oct 2018, 10:48:39 UTC - in response to Message 1958158.  

Grant was right. I was wrong. I didn't know that over time that the times would change. Thanks for all those who continue to respond to my silly posts and teach me how seti works.


I didn't see a "silly" post. I don't think anyone else did either.

Tom
A proud member of the OFA (Old Farts Association).
ID: 1959387 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1959399 - Posted: 9 Oct 2018, 13:00:31 UTC

It's been over 30m since I have received any tasks.
SSP is frozen in time ...
ID: 1959399 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1959403 - Posted: 9 Oct 2018, 13:34:53 UTC - in response to Message 1959399.  

It's been over 30m since I have received any tasks.
SSP is frozen in time ...

No new WU here too.
ID: 1959403 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1959430 - Posted: 10 Oct 2018, 2:42:49 UTC

And we are back...

That was a long outage...
ID: 1959430 · Report as offensive
Profile Unixchick Project Donor
Avatar

Send message
Joined: 5 Mar 12
Posts: 815
Credit: 2,361,516
RAC: 22
United States
Message 1959431 - Posted: 10 Oct 2018, 2:45:37 UTC

nice to be back on our message boards, but I'm guessing it will be a while until things are back to normal.
ID: 1959431 · Report as offensive
Profile lunkerlander
Avatar

Send message
Joined: 23 Jul 18
Posts: 82
Credit: 1,353,232
RAC: 4
United States
Message 1959432 - Posted: 10 Oct 2018, 2:56:18 UTC - in response to Message 1959430.  

Any idea what caused this outage? Was it the same issues that were discussed on Sunday?
ID: 1959432 · Report as offensive
Profile lunkerlander
Avatar

Send message
Joined: 23 Jul 18
Posts: 82
Credit: 1,353,232
RAC: 4
United States
Message 1959433 - Posted: 10 Oct 2018, 3:00:02 UTC - in response to Message 1959432.  

I have 14 completed tasks that say "uploading" and haven't got anything new all day.
ID: 1959433 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1959434 - Posted: 10 Oct 2018, 3:01:35 UTC - in response to Message 1959430.  

And we are back...

That was a long outage...


My queue of 3600 tasks only lasted 12.5hrs. I was idle for about an hour. Lol. Long indeed.

Still idle since I’ve only recieved 1 new task since coming back up.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1959434 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1959435 - Posted: 10 Oct 2018, 3:02:50 UTC - in response to Message 1959432.  

Any idea what caused this outage? Was it the same issues that were discussed on Sunday?

There is planned maintenance every Tuesday. Sometimes it just takes longer than others.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1959435 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11416
Credit: 29,581,041
RAC: 66
United States
Message 1959441 - Posted: 10 Oct 2018, 3:32:28 UTC

Reporting doesn't work ATM, my guess the servers are getting hammered.
ID: 1959441 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1959445 - Posted: 10 Oct 2018, 3:49:43 UTC - in response to Message 1959434.  

My queue of 3600 tasks only lasted 12.5hrs. I was idle for about an hour. Lol. Long indeed.
That must be American math. How did you do 12.5h of work during 11h of maintenance? :D
ID: 1959445 · Report as offensive
Ian&Steve C.
Avatar

Send message
Joined: 28 Sep 99
Posts: 4267
Credit: 1,282,604,591
RAC: 6,640
United States
Message 1959446 - Posted: 10 Oct 2018, 3:57:36 UTC - in response to Message 1959445.  
Last modified: 10 Oct 2018, 4:02:03 UTC

My queue of 3600 tasks only lasted 12.5hrs. I was idle for about an hour. Lol. Long indeed.
That must be American math. How did you do 12.5h of work during 11h of maintenance? :D


that was starting from about 9:30am or so, then i left for work. i wasnt able to babysit it to keep the queue filled until the moment the outage started. i had about 2900 CPU tasks stacked up for the outage, and the 700 GPU tasks kept full up. right before i left for work i swapped all the 2900 CPU tasks back to GPU.
Seti@Home classic workunits: 29,492 CPU time: 134,419 hours

ID: 1959446 · Report as offensive
Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · 25 . . . 37 · Next

Message boards : Number crunching : Panic Mode On (113) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.