Panic Mode On (106) Server Problems?

Message boards : Number crunching : Panic Mode On (106) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 29 · Next

AuthorMessage
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1870693 - Posted: 2 Jun 2017, 16:59:40 UTC - in response to Message 1870692.  
Last modified: 2 Jun 2017, 17:01:03 UTC

Trust me .... it was down and unreachable. I used Is it down for just me
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1870693 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1870694 - Posted: 2 Jun 2017, 17:07:53 UTC
Last modified: 2 Jun 2017, 17:29:33 UTC

I see that in the mean time someone opened up a can of shorties for us. All work in cache has a deadline of 23 June, and runs for 4.3 minutes (on my AMD RX470).

Also got 29mr08ad.2356.7434.13.40 tasks that stick at 0.01% for minutes, even stay running when I exit BOINC. Eventually they'll reset and do a large spike count.
And 11oc08ab.24560.6207.3.30 tasks that stick at 0.02% for their whole duration until they err.
ID: 1870694 · Report as offensive
Profile Dimly Lit Lightbulb 😀
Volunteer tester
Avatar

Send message
Joined: 30 Aug 08
Posts: 15399
Credit: 7,423,413
RAC: 1
United Kingdom
Message 1870698 - Posted: 2 Jun 2017, 17:14:20 UTC - in response to Message 1870692.  

Here's a handy link to verify it's actually S@H Site that is down

http://www.isitdownrightnow.com/setiathome.berkeley.edu.html

Quick and easy.

But then people wouldn't sat at their computers hitting the update button every 304 seconds FOR HOURS. Scribbling things down in a little notebook:

    Update 1: Unsuccessful, maybe an internet hiccup
    Update 27: Still no response, this is unaaceptable!
    Update 178: *MASHING OF KEYBOARD* 4kSmJbckm&cWNCRG6ZzFy8nvfaw6GaGParqRE-*Y#*a#nTKuR@ucH=sJ$6JdC_%B I'M WELL ANGRY INNIT!!!!!!!!!!!!!!!


Lol :)



Member of the People Encouraging Niceness In Society club.

ID: 1870698 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1870727 - Posted: 2 Jun 2017, 21:38:45 UTC - in response to Message 1870634.  
Last modified: 2 Jun 2017, 21:42:23 UTC

Finally, I set my Preferences to no AP

I always do that when changing application settings.
"Run only the selected applications Seti@home v8" is the only one I never change.
APv7 & "If no work available for the selected application..." are the 2 I always change from whatever they are set on when the system stops getting work.

Change them both, save changes.
Update manager, give it a 2-3 automatic requests if it doesn't start getting work, then change the application settings back to what they were, save it, update the manger and then generally on the next request for work, it comes pouring down (if it didn't on the intial change of settings).

It has been particularly bad for the last day or so.


And as for the allocation of work- my faster system has got barely any GBT work, the slower one after getting nothing but Arecibo is now getting almost all GBT. The faster one then picked up a few GBT WUs, then it's back to all Arecibo, then the slower one started getting some Arecibo as well.
When the crap hits the fan, it's never distributed evenly.


BTW- anyone else notice those particularly chewy Arecibo WUs?
Took as long (or slightly longer) to crunch them than GBT WUs do.
Grant
Darwin NT
ID: 1870727 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1870745 - Posted: 2 Jun 2017, 22:41:42 UTC - in response to Message 1870645.  

Was it Jeff's fan control script or the Nvidia update that got you into trouble with Einstein?


. . It was the update. I hadn't run the fan control at that point. It was the restart that seemed to sort it out and I have done something wrong because the fan control still didn't run. So it is definitely blameless ...

Stephen

<shrug>
ID: 1870745 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1870764 - Posted: 2 Jun 2017, 23:20:39 UTC

Have we had another database glitch with the last outage?
My Pendings & Valids have spike yet again (they didn't drop after the last spike), and appear to still be on their way up to new heights.
Grant
Darwin NT
ID: 1870764 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1870770 - Posted: 2 Jun 2017, 23:34:33 UTC - in response to Message 1870764.  

Have we had another database glitch with the last outage?
My Pendings & Valids have spike yet again (they didn't drop after the last spike), and appear to still be on their way up to new heights.


. . Something has happened because I was unable to access the web site at all last night, not the forums nor the home or accounts pages, Everything was offline for quite a while for some reason.

Stephen

??
ID: 1870770 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1870777 - Posted: 2 Jun 2017, 23:50:23 UTC - in response to Message 1870770.  

Have we had another database glitch with the last outage?
My Pendings & Valids have spike yet again (they didn't drop after the last spike), and appear to still be on their way up to new heights.


. . Something has happened because I was unable to access the web site at all last night, not the forums nor the home or accounts pages, Everything was offline for quite a while for some reason.

Yes, but returning & getting and downloading work was unaffected.
A web site issue shouldn't result in database issues; unless one caused the other somehow.
Grant
Darwin NT
ID: 1870777 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1870788 - Posted: 3 Jun 2017, 0:23:43 UTC

The web server at least went down for sure, but it didn't effect uploads/downloads or reporting here.

Cheers.
ID: 1870788 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1870805 - Posted: 3 Jun 2017, 0:55:25 UTC - in response to Message 1870788.  

The web server at least went down for sure, but it didn't effect uploads/downloads or reporting here.

Cheers.


. . Nope, they were unaffected for me as well. But I was wondering if whatever brought down the Web Server may have caused a hiccough in the other server operations as well. Since I suspect they are housed in the same environment.

Stephen

??
ID: 1870805 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1871013 - Posted: 4 Jun 2017, 1:30:30 UTC

It does seem that funny things are happening in serverland ATM.

Warning: shell_exec(): Unable to execute '/home/boincadm/projects/sah/bin/mysql_connect_test carolyn' in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/sah_status.php on line 334 Warning: shell_exec(): Unable to execute '/home/boincadm/projects/sah/bin/paddym_connect_test' in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/sah_status.php on line 342 Warning: shell_exec(): Unable to execute '/home/boincadm/projects/sah/bin/marvin_connect_test' in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/sah_status.php on line 350 Warning: shell_exec(): Unable to execute '/home/boincadm/projects/sah/bin/apache_running_on_host synergy' in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/sah_status.php on line 369 Warning: shell_exec(): Unable to execute '/home/boincadm/projects/sah/bin/nginx_running_on_host georgem' in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/sah_status.php on line 386 

Getting some big slow downs here at times.

Cheers.
ID: 1871013 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1871017 - Posted: 4 Jun 2017, 1:41:01 UTC - in response to Message 1871013.  

I would have to agree. It seems currently that that issue is sorted itself. Currently in the last hour over 112,000 results have been returned maybe this is because the server could not receive work or maybe we are in the mist of another shortie storm. On the bright side either way at least work is getting returned :)
ID: 1871017 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1871028 - Posted: 4 Jun 2017, 2:20:21 UTC - in response to Message 1871017.  

I would have to agree. It seems currently that that issue is sorted itself. Currently in the last hour over 112,000 results have been returned maybe this is because the server could not receive work or maybe we are in the mist of another shortie storm. On the bright side either way at least work is getting returned :)

Quite a few shorties.
And the percentage of GBT work has dropped off again, at least on my systems, so even without the shorties the amount returned per hour would increase quite a bit.
Grant
Darwin NT
ID: 1871028 · Report as offensive
Speedy
Volunteer tester
Avatar

Send message
Joined: 26 Jun 04
Posts: 1643
Credit: 12,921,799
RAC: 89
New Zealand
Message 1871036 - Posted: 4 Jun 2017, 2:59:29 UTC - in response to Message 1871028.  

I would have to agree. It seems currently that that issue is sorted itself. Currently in the last hour over 112,000 results have been returned maybe this is because the server could not receive work or maybe we are in the mist of another shortie storm. On the bright side either way at least work is getting returned :)

Quite a few shorties.
And the percentage of GBT work has dropped off again, at least on my systems, so even without the shorties the amount returned per hour would increase quite a bit.

Yes I agree Grant it certainly does increase when that happens
ID: 1871036 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1871052 - Posted: 4 Jun 2017, 4:32:32 UTC - in response to Message 1871028.  


Quite a few shorties.
And the percentage of GBT work has dropped off again, at least on my systems, so even without the shorties the amount returned per hour would increase quite a bit.


. . Yep, same here.

Stephen

..
ID: 1871052 · Report as offensive
Profile Bill G Special Project $75 donor
Avatar

Send message
Joined: 1 Jun 01
Posts: 1282
Credit: 187,688,550
RAC: 182
United States
Message 1871114 - Posted: 4 Jun 2017, 14:42:21 UTC - in response to Message 1871052.  

So have we run out of pfb work?

SETI@home classic workunits 4,019
SETI@home classic CPU time 34,348 hours
ID: 1871114 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1871116 - Posted: 4 Jun 2017, 14:55:26 UTC - in response to Message 1871114.  

So have we run out of pfb work?

Dunno. Sent a heads up to Eric and Jeff about 2 hours ago about the queue running dry.
But it's only close to 8AM in Berkeley now, and the weekend.
We shall see.

Meow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1871116 · Report as offensive
Nicnac

Send message
Joined: 24 May 15
Posts: 7
Credit: 147,947
RAC: 0
Germany
Message 1871119 - Posted: 4 Jun 2017, 15:16:08 UTC

Did I miss any news? SInce the last time servers were down for maintenance I am only getting 1 WU at a time although my settings are to download enough work for a whole day at once. Also there are periods where there is no communication with the project server at all, like now.
ID: 1871119 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1871178 - Posted: 4 Jun 2017, 23:57:05 UTC

. . Well for what it's worth something seems to be stuck again, for the last 5 hours nothing but guppis and a handful of Arecibo VLARs.

Stephen

??
ID: 1871178 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1871181 - Posted: 5 Jun 2017, 0:07:05 UTC

Nothing is stuck ATM, but there are no Arecibo files loaded to be split so we're in for a guppy flood.

Cheers.
ID: 1871181 · Report as offensive
Previous · 1 . . . 8 · 9 · 10 · 11 · 12 · 13 · 14 . . . 29 · Next

Message boards : Number crunching : Panic Mode On (106) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.