Panic Mode On (89) Server Problems?

Message boards : Number crunching : Panic Mode On (89) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · Next

AuthorMessage
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1577061 - Posted: 24 Sep 2014, 13:43:57 UTC - in response to Message 1577060.  

OK, 13:00 UTC has arrived. Any more error messages to report, while I draft the email?

pre- and code-tags don't work correctly. less-than character is converted to < in both and code-tag eats line breaks.

pre:
less-than: <
another line


code:
less-than: <
another line

That got broken on the Boinc dev board too.

Claggy
ID: 1577061 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577077 - Posted: 24 Sep 2014, 14:12:59 UTC - in response to Message 1577060.  

OK, 13:00 UTC has arrived. Any more error messages to report, while I draft the email?

pre- and code-tags don't work correctly. less-than character is converted to &lt; in both and code-tag eats line breaks.

pre:
less-than: <
another line


code:
less-than: <
another line

And now also at Beta. B***er. You'd expect to be swapping code snippets on a Beta project, even if it isn't a high priority here. Addendum upcoming...
ID: 1577077 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1577101 - Posted: 24 Sep 2014, 15:07:34 UTC - in response to Message 1576997.  

OK, I've collected four different error messages from

forum_index.php
home.php
sah_donate.php
show_user.php

(home and sah_donate are similar but subtly different)

Any more contributions for the compendium in the next couple of hours, please - say by 13:00 UTC - and I'll bundle them up and send them off.

Edit - found another one in sah_status.php
And enjoy http://setiweb.ssl.berkeley.edu/beta/status.php

Did you happen to drop a reminder about http://setiathome.berkeley.edu/client_types.php not updating, or is that more for the project guys to do?
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1577101 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577106 - Posted: 24 Sep 2014, 15:24:26 UTC - in response to Message 1577101.  

OK, I've collected four different error messages from

forum_index.php
home.php
sah_donate.php
show_user.php

(home and sah_donate are similar but subtly different)

Any more contributions for the compendium in the next couple of hours, please - say by 13:00 UTC - and I'll bundle them up and send them off.

Edit - found another one in sah_status.php
And enjoy http://setiweb.ssl.berkeley.edu/beta/status.php

Did you happen to drop a reminder about http://setiathome.berkeley.edu/client_types.php not updating, or is that more for the project guys to do?

Some of the other new stats tools like cpu_list.php and gpu_list.php are clearly BOINC-generic, because they work at other projects too. But client_types.php doesn't (and it's not in the BOINC source \html\user tree) - so I think it must be SETI-specific, and doesn't really belong in David's lap with the rest of this set. I did mention it in passing when we sorted out the last BOINC-induced server error - old client versions not being allocated new work, at the beginning of this month - but I didn't make a big song-and-dance about it. Just that it would have been useful then...
ID: 1577106 · Report as offensive
David S
Volunteer tester
Avatar

Send message
Joined: 4 Oct 99
Posts: 18352
Credit: 27,761,924
RAC: 12
United States
Message 1577109 - Posted: 24 Sep 2014, 15:32:18 UTC - in response to Message 1576975.  

I get this on my account page:

Warning: mysql_query(): Can't connect to local MySQL server through socket '/var/lib/mysql/mysql.sock' (2) in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/donations.inc on line 17 Warning: mysql_query(): A link to the server could not be established in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/donations.inc on line 17 Warning: mysql_fetch_object(): supplied argument is not a valid MySQL result resource in /disks/carolyn/b/home/boincadm/projects/sah/html/seti_boinc_html/donations.inc on line 18

You and I are both donors already - that's probably why we both get it on our account page, but Glenn doesn't. Is your donation history (number/total amount of donations and date of last donation) missing?

I got this too, just a few minutes ago, and yes my donations are missing.

I had some database errors in the forums last night, about the time the cricket shows a big spike (6pm PDT), but I just went back and tried again and it was okay.

I wasn't paying attention to my crunchers' connections at the time.
David
Sitting on my butt while others boldly go,
Waiting for a message from a small furry creature from Alpha Centauri.

ID: 1577109 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1577113 - Posted: 24 Sep 2014, 15:40:28 UTC
Last modified: 24 Sep 2014, 15:58:14 UTC

Has anyone else noticed a problem with the the validators running way behind. I know of at least 5 of my WUs that have been reported by both me and my wingman and are still sitting in a Validation Pending state, with "Completed, waiting for validation", for over 15 hours.

http://setiathome.berkeley.edu/workunit.php?wuid=1599799024
http://setiathome.berkeley.edu/workunit.php?wuid=1599798865
http://setiathome.berkeley.edu/workunit.php?wuid=1599792725
http://setiathome.berkeley.edu/workunit.php?wuid=1599792731
http://setiathome.berkeley.edu/workunit.php?wuid=1599799042

There are probably more, but I stopped checking after 5. I noticed these before I went to bed last night, but decided to wait until this morning to see if they had validated. They don't appear to have done so. (I even cleared my browser cache, just to make sure I wasn't getting old news.)

These were all reported after yesterdays outage.

Edit: Oh yeah, I've got lots more! It looks like any tasks I reported between about 23:41 and 23:51 UTC yesterday, where I was the second wingman to report (which should have triggered the validators) are hung up in Neverland!
ID: 1577113 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1577114 - Posted: 24 Sep 2014, 15:45:47 UTC - in response to Message 1577061.  

OK, 13:00 UTC has arrived. Any more error messages to report, while I draft the email?

pre- and code-tags don't work correctly. less-than character is converted to &lt; in both and code-tag eats line breaks.

pre:
less-than: <
another line


code:
less-than: <
another line

That got broken on the Boinc dev board too.

Claggy

I can finally do them. They now work for me, both as HTML code and as the actual character. ;-)
ID: 1577114 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577118 - Posted: 24 Sep 2014, 15:57:26 UTC - in response to Message 1577113.  

Has anyone else noticed a problem with the the validators running way behind. I know of at least 5 of my WUs that have been reported by both me and my wingman and are still sitting in a Validation Pending state, with "Completed, waiting for validation", for over 15 hours.

http://setiathome.berkeley.edu/workunit.php?wuid=1599799024
http://setiathome.berkeley.edu/workunit.php?wuid=1599798865
http://setiathome.berkeley.edu/workunit.php?wuid=1599792725
http://setiathome.berkeley.edu/workunit.php?wuid=1599792731
http://setiathome.berkeley.edu/workunit.php?wuid=1599799042

There are probably more, but I stopped checking after 5. I noticed these before I went to bed last night, but decided to wait until this morning to see if they had validated. They don't appear to have done so. (I even cleared my browser cache, just to make sure I wasn't getting old news.)

These were all reported after yesterdays outage.

With 1,129 pending, I think I'll wait until the daily reports have purged through before checking to see what's left - the anomalies will stand out more clearly then. Somebody remind me in a couple of weeks, please.

There is a failsafe in place, which weeds out most errors like that - the transitioners/validators take a second look at stuck WUs on the day the original deadlines would have passed (three weeks for shorties, six/seven/eight weeks away for the rest). I think the database can stand a short-term overload like that - and think of your credits as safe in a savings account.

But I think most regular posters will have instances of pending tasks which get stuck for months, or even years - that's a more serious problem, because there's no remaining failsafe triggering another retry. That should be added to the list of things that would be fixed if the project had an infinite supply of Round Tuits, but it's a long list.
ID: 1577118 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1577120 - Posted: 24 Sep 2014, 16:03:40 UTC - in response to Message 1577118.  

Richard,

Looks like I was editing my post while you were typing, so I'll copy it here.

Edit: Oh yeah, I've got lots more! It looks like any tasks I reported between about 23:41 and 23:51 UTC yesterday, where I was the second wingman to report (which should have triggered the validators) are hung up in Neverland!


Perhaps some other high-volume users could take a look in that window and see if there's a pattern.
ID: 1577120 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577121 - Posted: 24 Sep 2014, 16:04:29 UTC - in response to Message 1577114.  

I can finally do them. They now work for me, both as HTML code and as the actual character. ;-)

Then work your magic here too, please.

I've got a 9,000+ character, 229 line code snippet in my private message inbox from the server problems at the beginning of this month, and it's being rendered all on one line.

Talk about thread s - t - r - e - t - c - h - i - n - g ...
ID: 1577121 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577122 - Posted: 24 Sep 2014, 16:08:23 UTC - in response to Message 1577120.  

Richard,

Looks like I was editing my post while you were typing, so I'll copy it here.

Edit: Oh yeah, I've got lots more! It looks like any tasks I reported between about 23:41 and 23:51 UTC yesterday, where I was the second wingman to report (which should have triggered the validators) are hung up in Neverland!

Perhaps some other high-volume users could take a look in that window and see if there's a pattern.

Fair point. There are only 22 'Workunits waiting for validation' shown on the server status page (down from 63 a few minutes ago), so it sounds like that counting routine is broken too, even though the page itself seems to be working despite the error messages.
ID: 1577122 · Report as offensive
WezH
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 576
Credit: 67,033,957
RAC: 95
Finland
Message 1577123 - Posted: 24 Sep 2014, 16:10:01 UTC
Last modified: 24 Sep 2014, 16:10:46 UTC

I'm do have this error code on every page

Notice: Undefined variable: PROJECT in /disks/carolyn/b/home/boincadm/projects/sah/html/languages/compiled/pl.po.inc on line 374


Maybe because I'm in Finland but I do use English language WinXP/Chrome and I choose English as my language in S@H pages?

Also fonts are really big etc.
"Please keep Your signature under four lines so Internet traffic doesn't go up too much"

- In 1992 when I had my first e-mail address -
ID: 1577123 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1577127 - Posted: 24 Sep 2014, 16:16:08 UTC - in response to Message 1577122.  

Richard,

Looks like I was editing my post while you were typing, so I'll copy it here.

Edit: Oh yeah, I've got lots more! It looks like any tasks I reported between about 23:41 and 23:51 UTC yesterday, where I was the second wingman to report (which should have triggered the validators) are hung up in Neverland!

Perhaps some other high-volume users could take a look in that window and see if there's a pattern.

Fair point. There are only 22 'Workunits waiting for validation' shown on the server status page (down from 63 a few minutes ago), so it sounds like that counting routine is broken too, even though the page itself seems to be working despite the error messages.

Here's another twist. For WU 1598612308 mine was the third host tie-breaker. My task is "Completed, waiting for validation", while the other 2 are still "Completed, validation inconclusive".
ID: 1577127 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1577130 - Posted: 24 Sep 2014, 16:21:04 UTC - in response to Message 1577123.  

Wez,

Most people are seeing these as well on different pages. Seems to be related to the changes they did yesterday. Hopefully they are working on fixing these problems.
ID: 1577130 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577135 - Posted: 24 Sep 2014, 16:26:11 UTC - in response to Message 1577130.  

Wez,

Most people are seeing these as well on different pages. Seems to be related to the changes they did yesterday. Hopefully they are working on fixing these problems.

That particular one hadn't been mentioned before, and wasn't in my 'comprenhensive compendium' error report to the BOINC devs.

I can't see it on "every page", even by selecting a non-default language, but I do see it on language_select.php, so I'll add it to the next batch.
ID: 1577135 · Report as offensive
Sirius B Project Donor
Volunteer tester
Avatar

Send message
Joined: 26 Dec 00
Posts: 24879
Credit: 3,081,182
RAC: 7
Ireland
Message 1577137 - Posted: 24 Sep 2014, 16:28:37 UTC

Hmm, here's a poser as I've not seen it mentioned anywhere. Now that the project has relocated to the colo, rather than see all this testing on Seti main, why not re-activate Boinc Alpha & do all the testing there & as well on Seti Beta?

Or are the Boinc servers at UCB rather than the colo?
ID: 1577137 · Report as offensive
Juha
Volunteer tester

Send message
Joined: 7 Mar 04
Posts: 388
Credit: 1,857,738
RAC: 0
Finland
Message 1577142 - Posted: 24 Sep 2014, 16:36:06 UTC - in response to Message 1577121.  

I can finally do them. They now work for me, both as HTML code and as the actual character. ;-)

Then work your magic here too, please.


Make everyone a project admin? :P
ID: 1577142 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1577144 - Posted: 24 Sep 2014, 16:37:32 UTC - in response to Message 1577127.  

Here's another twist. For WU 1598612308 mine was the third host tie-breaker. My task is "Completed, waiting for validation", while the other 2 are still "Completed, validation inconclusive".

And APs are included, too:
http://setiathome.berkeley.edu/workunit.php?wuid=1599954929
ID: 1577144 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1577145 - Posted: 24 Sep 2014, 16:38:33 UTC - in response to Message 1577137.  

Hmm, here's a poser as I've not seen it mentioned anywhere. Now that the project has relocated to the colo, rather than see all this testing on Seti main, why not re-activate Boinc Alpha & do all the testing there & as well on Seti Beta?

Or are the Boinc servers at UCB rather than the colo?

Two possible answers to that one:

1) By testing here, there are many more pairs of eyes available for proof-reading, and the bugs get eradicated quickly.
2) David thinks that the code he writes is good enough to be placed in the public domain immediately, without testing.

I'll leave it to readers to choose their own solution.....

The physical location of the servers is irrelevant - server administrators globally are used to working remotely these days, and very little is done hands-on except hardware replacement. For what it's worth, the BOINC server (Isaac) was relocated to the colo as well, shortly after the SETI server farm was moved.
ID: 1577145 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1577148 - Posted: 24 Sep 2014, 16:39:14 UTC - in response to Message 1577137.  

Hmm, here's a poser as I've not seen it mentioned anywhere. Now that the project has relocated to the colo, rather than see all this testing on Seti main, why not re-activate Boinc Alpha & do all the testing there & as well on Seti Beta?

Or are the Boinc servers at UCB rather than the colo?

Well the colo is part of the Berkeley campus & run by their IT staff IIRC.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1577148 · Report as offensive
Previous · 1 . . . 19 · 20 · 21 · 22 · 23 · 24 · Next

Message boards : Number crunching : Panic Mode On (89) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.