Panic Mode On (109) Server Problems?

Message boards : Number crunching : Panic Mode On (109) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 . . . 36 · Next

AuthorMessage
Profile Advent42
Avatar

Send message
Joined: 23 Mar 17
Posts: 175
Credit: 4,015,683
RAC: 0
Ireland
Message 1906444 - Posted: 11 Dec 2017, 17:42:28 UTC - in response to Message 1906388.  

So far so good...:-)
ID: 1906444 · Report as offensive
Profile Gary Charpentier Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 25 Dec 00
Posts: 30608
Credit: 53,134,872
RAC: 32
United States
Message 1906574 - Posted: 12 Dec 2017, 1:50:13 UTC

Just a reminder, when you panic while the outage is on tomorrow you are welcome at https://boinc.berkeley.edu/dev/forum_thread.php?id=8105.
ID: 1906574 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1906597 - Posted: 12 Dec 2017, 2:53:11 UTC - in response to Message 1906574.  

Just a reminder, when you panic while the outage is on tomorrow you are welcome at https://boinc.berkeley.edu/dev/forum_thread.php?id=8105.

I've got washing down 2 more rooms booked for tomorrow, but you never know.

Cheers.
ID: 1906597 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11360
Credit: 29,581,041
RAC: 66
United States
Message 1906636 - Posted: 12 Dec 2017, 5:38:40 UTC - in response to Message 1906634.  

Yep
ID: 1906636 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13720
Credit: 208,696,464
RAC: 304
Australia
Message 1906639 - Posted: 12 Dec 2017, 7:09:22 UTC

Splitter output varies from, good, to great, to mostly insufficient. Luckily the brief periods of health are long enough to offset the longer periods where they're barley putting out work.
The MB Validation/Assimilation backlog has almost cleared, unfortunately the MB & AP deletion backlogs are reaching record levels.
And the Replica is at it's 3rd biggest lag for the year, and heading for the second biggest.

And I got home from work to find my main system almost out of work. The Scheduler really is having greater than usual issues. The triple update got me some work, but no where near a full cache, with the weekly outage only hours away.
Grant
Darwin NT
ID: 1906639 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1906675 - Posted: 12 Dec 2017, 12:31:03 UTC - in response to Message 1906639.  

Splitter output varies from, good, to great, to mostly insufficient. Luckily the brief periods of health are long enough to offset the longer periods where they're barley putting out work.
The MB Validation/Assimilation backlog has almost cleared, unfortunately the MB & AP deletion backlogs are reaching record levels.
And the Replica is at it's 3rd biggest lag for the year, and heading for the second biggest.

And I got home from work to find my main system almost out of work. The Scheduler really is having greater than usual issues. The triple update got me some work, but no where near a full cache, with the weekly outage only hours away.


. . Yep, of all times to be getting "no tasks available" messages :(

Stephen

:(
ID: 1906675 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1906688 - Posted: 12 Dec 2017, 12:55:37 UTC

Feels a bit like message 1900400:

For some reason the query that fills the "ready to send" queue is running about 10 times slower than it normally does.
Maybe we'll find out after the outrage. Last time, it was too little memory allocated. We might be able to afford some extra memory now :-)
ID: 1906688 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11360
Credit: 29,581,041
RAC: 66
United States
Message 1906703 - Posted: 13 Dec 2017, 14:17:43 UTC

splitter output is not working
Current result creation rate ** 0/sec 0.0236/sec 0.0563/sec
ID: 1906703 · Report as offensive
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 715
Credit: 8,032,827
RAC: 62
France
Message 1906708 - Posted: 13 Dec 2017, 14:33:45 UTC
Last modified: 13 Dec 2017, 14:34:24 UTC


13-Dec-2017 15:32:23 [SETI@home] Sending scheduler request: To fetch work.
13-Dec-2017 15:32:23 [SETI@home] Requesting new tasks for CPU and AMD/ATI GPU
13-Dec-2017 15:32:45 [SETI@home] Scheduler request failed: Couldn't connect to server
13-Dec-2017 15:32:48 [---] Project communication failed: attempting access to reference site
13-Dec-2017 15:32:49 [---] Internet access OK - project servers may be temporarily down.


some lags to acces forum too ;)
ID: 1906708 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34253
Credit: 79,922,639
RAC: 80
Germany
Message 1906716 - Posted: 13 Dec 2017, 15:01:22 UTC - in response to Message 1906708.  


13-Dec-2017 15:32:23 [SETI@home] Sending scheduler request: To fetch work.
13-Dec-2017 15:32:23 [SETI@home] Requesting new tasks for CPU and AMD/ATI GPU
13-Dec-2017 15:32:45 [SETI@home] Scheduler request failed: Couldn't connect to server
13-Dec-2017 15:32:48 [---] Project communication failed: attempting access to reference site
13-Dec-2017 15:32:49 [---] Internet access OK - project servers may be temporarily down.


some lags to acces forum too ;)


It always takes a few hours until the servers catch up with demand.


With each crime and every kindness we birth our future.
ID: 1906716 · Report as offensive
Profile Dr.Diesel Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 14 May 99
Posts: 41
Credit: 123,695,755
RAC: 139
United States
Message 1906722 - Posted: 13 Dec 2017, 15:12:39 UTC - in response to Message 1906716.  


It always takes a few hours until the servers catch up with demand.


Check out the Database/file status, As of. Servers might be up, or at least showing up, but the project is still down/stuck/messed up.
ID: 1906722 · Report as offensive
Profile betreger Project Donor
Avatar

Send message
Joined: 29 Jun 99
Posts: 11360
Credit: 29,581,041
RAC: 66
United States
Message 1906724 - Posted: 13 Dec 2017, 15:13:46 UTC - in response to Message 1906716.  
Last modified: 13 Dec 2017, 15:14:27 UTC

It always takes a few hours until the servers catch up with demand.

For that to happen they will have to start splitting new data.
ID: 1906724 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14649
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1906725 - Posted: 13 Dec 2017, 15:14:05 UTC
Last modified: 13 Dec 2017, 15:33:58 UTC

If you have big backlogs, try reporting fewer tasks at a time.

13/12/2017 15:05:07 | SETI@home | Reporting 150 completed tasks
13/12/2017 15:06:24 | SETI@home | Scheduler request failed: HTTP internal server error

13/12/2017 15:11:38 | SETI@home | Reporting 64 completed tasks
13/12/2017 15:12:17 | SETI@home | Scheduler request completed
and on another machine,

13/12/2017 15:27:28 | SETI@home | Reporting 191 completed tasks
13/12/2017 15:28:24 | SETI@home | Scheduler request failed: HTTP internal server error
May be a particular problem if you run Raistmer's apps with the huge stderr_txt entries. That file was 2.4 MB.

13/12/2017 15:32:01 | SETI@home | Reporting 64 completed tasks
was only 845 KB, and got through.
ID: 1906725 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1906729 - Posted: 13 Dec 2017, 15:30:19 UTC

JACKPOT!
ASUS i7 960 SETI@home 13/12/2017 9:26:43 AM Scheduler request completed: got 17 new tasks

Of course my slow computer first, LOL
ID: 1906729 · Report as offensive
Profile Kissagogo27 Special Project $75 donor
Avatar

Send message
Joined: 6 Nov 99
Posts: 715
Credit: 8,032,827
RAC: 62
France
Message 1906730 - Posted: 13 Dec 2017, 15:31:13 UTC

server is back few minutes after ;)


13-Dec-2017 15:35:26 [SETI@home] Sending scheduler request: To fetch work.
13-Dec-2017 15:35:26 [SETI@home] Requesting new tasks for CPU and AMD/ATI GPU
13-Dec-2017 15:36:06 [SETI@home] Scheduler request completed: got 0 new tasks
13-Dec-2017 15:36:06 [SETI@home] Project has no tasks available


0 AP to grab .. normal ;)
ID: 1906730 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1906739 - Posted: 13 Dec 2017, 15:48:55 UTC - in response to Message 1906729.  

JACKPOT!
ASUS i7 960 SETI@home 13/12/2017 9:26:43 AM Scheduler request completed: got 17 new tasks

Of course my slow computer first, LOL

NO, NADA, nothing down here. LOL
ID: 1906739 · Report as offensive
Profile Dr.Diesel Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 14 May 99
Posts: 41
Credit: 123,695,755
RAC: 139
United States
Message 1906740 - Posted: 13 Dec 2017, 15:49:57 UTC - in response to Message 1906730.  

I attempted to suspend a few ready to report tasks (hoping a to trickle a few in), and my entire backlog disappeared. :(
ID: 1906740 · Report as offensive
Profile Brent Norman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 1 Dec 99
Posts: 2786
Credit: 685,657,289
RAC: 835
Canada
Message 1906743 - Posted: 13 Dec 2017, 15:54:09 UTC

ASUS i7-3820 SETI@home 13/12/2017 9:49:42 AM Scheduler request completed: got 16 new tasks

A handful more in, over 2600 reported back, at least that cleared out.
ID: 1906743 · Report as offensive
Profile KWSN Ekky Ekky Ekky
Avatar

Send message
Joined: 25 May 99
Posts: 944
Credit: 52,956,491
RAC: 67
United Kingdom
Message 1906756 - Posted: 13 Dec 2017, 16:20:30 UTC

Please Sir, can I have some (never mind more!)?

ID: 1906756 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13161
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1906757 - Posted: 13 Dec 2017, 16:22:28 UTC

Having to use http_debug to even get a good connection. Mostly been getting project isn't available. Very slow in getting work reported. No tasks are available.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1906757 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 . . . 36 · Next

Message boards : Number crunching : Panic Mode On (109) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.