Panic Mode On (116) Server Problems?

Message boards : Number crunching : Panic Mode On (116) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 47 · Next

AuthorMessage
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 716
Credit: 8,032,827
RAC: 62
France
Message 1987857 - Posted: 29 Mar 2019, 22:05:56 UTC

6 creations /sec , only got resend ^^
ID: 1987857 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1987860 - Posted: 29 Mar 2019, 22:16:19 UTC - in response to Message 1987854.  

Sent a message to Eric.

Meow.

Thanks, Mark!
With only 1 of 32 splitters running, it could be a cold weekend here :)
ID: 1987860 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987862 - Posted: 29 Mar 2019, 22:18:59 UTC - in response to Message 1987847.  

. . I have been getting 'no tasks available' for the last 5 hours plus.

That's what showing in my logs as well "Project has no tasks available."
Not surprising given splitter output is less than 10 WU/s with just the one splitter running.

And I noticed that the db puge is also not running- that is not going to help things at all.
Grant
Darwin NT
ID: 1987862 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1987863 - Posted: 29 Mar 2019, 22:19:55 UTC - in response to Message 1987857.  

6 creations /sec , only got resend ^^

At least it helps empty the database a little bit in terms of only sending out expired tasks.
Another thing that probably isn't helping is that db_purge is disabled.

Mark thanks for sending a message to Eric. Currently it is 15:19 in server land.
ID: 1987863 · Report as offensive
rcthardcore

Send message
Joined: 23 Nov 08
Posts: 48
Credit: 1,306,006
RAC: 0
United States
Message 1987866 - Posted: 29 Mar 2019, 22:36:01 UTC

Still having intermittent upload problems too.
ID: 1987866 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1987869 - Posted: 29 Mar 2019, 22:55:47 UTC

I just received 7 new tasks so something is moving in the right direction. Thank you to whoever was involved
ID: 1987869 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987870 - Posted: 29 Mar 2019, 22:55:47 UTC - in response to Message 1987866.  

Still having intermittent upload problems too.

No signs of upload issues in my logs for the last 8 hours.
Grant
Darwin NT
ID: 1987870 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987873 - Posted: 29 Mar 2019, 23:05:22 UTC
Last modified: 29 Mar 2019, 23:08:20 UTC

db purge is showing green again, and the splitters are also showing green again (other than PFB splitter 0 which I don't recall ever seeing running)- now they just need to crank up their pace and pump out the WUs (70+/s would be nice).
Thank you Eric.
Grant
Darwin NT
ID: 1987873 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1987881 - Posted: 29 Mar 2019, 23:39:04 UTC

Eric says it is fixed.
For now.

Meow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1987881 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1987883 - Posted: 29 Mar 2019, 23:44:20 UTC - in response to Message 1987881.  

Eric says it is fixed.
For now.

Meow.

Thanks Mark for passing on the message
ID: 1987883 · Report as offensive
Profile Bill G Special Project $75 donor
Avatar

Send message
Joined: 1 Jun 01
Posts: 1282
Credit: 187,688,550
RAC: 182
United States
Message 1987886 - Posted: 30 Mar 2019, 0:01:36 UTC - in response to Message 1987883.  

If it is fixed??? I am still getting hung downloads that I am clearing manually.

SETI@home classic workunits 4,019
SETI@home classic CPU time 34,348 hours
ID: 1987886 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1987887 - Posted: 30 Mar 2019, 0:03:04 UTC - in response to Message 1987886.  

If it is fixed??? I am still getting hung downloads that I am clearing manually.


. . I think he means that the splitter problem is fixed so we can now get work ...

Stephen

:)
ID: 1987887 · Report as offensive
Profile Bill G Special Project $75 donor
Avatar

Send message
Joined: 1 Jun 01
Posts: 1282
Credit: 187,688,550
RAC: 182
United States
Message 1987888 - Posted: 30 Mar 2019, 0:04:43 UTC - in response to Message 1987887.  

If it is fixed??? I am still getting hung downloads that I am clearing manually.


. . I think he means that the splitter problem is fixed so we can now get work ...

Stephen

:)

OK

SETI@home classic workunits 4,019
SETI@home classic CPU time 34,348 hours
ID: 1987888 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987889 - Posted: 30 Mar 2019, 0:06:20 UTC - in response to Message 1987886.  

If it is fixed??? I am still getting hung downloads that I am clearing manually.

At least you're getting downloads- I've picked up a few (and yes, the instant backoffs are still in effect), but mostly it's been "Project has no tasks available." It's been a long dry period, and even though the splitters are now running, it's taking them a while to actually pump out much in the way of work.

Now the splitters are running again, he'll have more time to work on the download issues.
Grant
Darwin NT
ID: 1987889 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1987890 - Posted: 30 Mar 2019, 0:10:30 UTC

Just brought the system back online and immediately got two AP tasks that instantly went to backoff/retry. Have a feeling it is going to be a worrisome weekend.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1987890 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1987895 - Posted: 30 Mar 2019, 0:26:55 UTC - in response to Message 1987890.  

Just brought the system back online and immediately got two AP tasks that instantly went to backoff/retry. Have a feeling it is going to be a worrisome weekend.


. . Sadly it seems that way. It is looking like a major rebuild of SETI HQ is much needed. But considering the amount of data we are now moving about and processing I don't think is a great surprise to anyone.

Stephen

:(
ID: 1987895 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987900 - Posted: 30 Mar 2019, 0:41:13 UTC

My last couple of requests for work (that actually got some work) were able to download without repeated Retry intervention.
Grant
Darwin NT
ID: 1987900 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987905 - Posted: 30 Mar 2019, 0:51:36 UTC - in response to Message 1987900.  

My last couple of requests for work (that actually got some work) were able to download without repeated Retry intervention.

Ignore that, it was just an abnormality. Frequent retries necessary to get any work to actually download since then.
Grant
Darwin NT
ID: 1987905 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1987909 - Posted: 30 Mar 2019, 1:01:43 UTC - in response to Message 1987895.  

Just brought the system back online and immediately got two AP tasks that instantly went to backoff/retry. Have a feeling it is going to be a worrisome weekend.


. . Sadly it seems that way. It is looking like a major rebuild of SETI HQ is much needed. But considering the amount of data we are now moving about and processing I don't think is a great surprise to anyone.

Stephen

:(

For a rebuild to happen at HQ I believe a lot of money is needed, until this happens I don't think any rebuilding will be going on apart from fixing things that break. I believe the download issue is because something was changed on the campus network & people in the know are aware of the issue to my knowledge
ID: 1987909 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1987913 - Posted: 30 Mar 2019, 1:58:07 UTC
Last modified: 30 Mar 2019, 1:58:19 UTC

Instant timeouts on downloads might not be an issue for too long as the splitter output has fallen to 0, even though the Server Status page shows them as running, and the Ready-to-send buffer is still empty.
Grant
Darwin NT
ID: 1987913 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 . . . 47 · Next

Message boards : Number crunching : Panic Mode On (116) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.