Panic Mode On (107) Server Problems?

Message boards : Number crunching : Panic Mode On (107) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 29 · Next

AuthorMessage
BetelgeuseFive Project Donor
Volunteer tester

Send message
Joined: 6 Jul 99
Posts: 158
Credit: 17,117,787
RAC: 19
Netherlands
Message 1885930 - Posted: 25 Aug 2017, 7:37:10 UTC

Hi folks,

I just noticed I had an unusually high number of pending tasks.
Looks like something was broken during or immediately after the long outage on August 9.
I have a lot of tasks that still have not been validated even though they were reported by both wingmen around this time:

https://setiathome.berkeley.edu/workunit.php?wuid=2632244434
https://setiathome.berkeley.edu/workunit.php?wuid=2632235792
https://setiathome.berkeley.edu/workunit.php?wuid=2628882004
https://setiathome.berkeley.edu/workunit.php?wuid=2632191521

There are lots more, but I think you get the point ...
Maybe someone needs to run a script to fix this.

Tom
ID: 1885930 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22447
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1885933 - Posted: 25 Aug 2017, 7:55:50 UTC

People "bunkering" for the start of the WOW event....
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1885933 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1885989 - Posted: 25 Aug 2017, 14:42:41 UTC - in response to Message 1885933.  

People "bunkering" for the start of the WOW event....

I think you mean the "end" of the WOW event.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1885989 · Report as offensive
Profile Jeff Buck Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester

Send message
Joined: 11 Feb 00
Posts: 1441
Credit: 148,764,870
RAC: 0
United States
Message 1886015 - Posted: 25 Aug 2017, 15:56:31 UTC - in response to Message 1885930.  

Yes, those appear to be WUs that slipped past the validator, even though both hosts have reported. I think that happens after every outage, but sometimes it's more obvious than others.

The validator will take a second pass at those and should validate them just fine, but not until the original report deadline for the tasks are reached. In the case of the first example you posted, which looks like it was a "shortie", that should be 28 Aug 2017, 4:21:33 UTC. However, your second example has an original report deadline of 29 Sep 2017, 22:01:24 UTC, so you'll have to wait quite a while for that one to validate. Nothing you can do about it, but you will eventually get the credit.
ID: 1886015 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22447
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1886017 - Posted: 25 Aug 2017, 16:04:21 UTC

No - a lot of people bunkered at the start, just look at the throughput on day on. No doubt there are some that bunker at the end, but that's a much higher risk activity.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1886017 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886080 - Posted: 25 Aug 2017, 21:57:31 UTC

Are we crashing here????
Checked a couple of rigs, and getting 'no tasks available'.
And the stats pages are not responding well at all.
Hope not, being Friday afternoon.

Meow?
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886080 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886083 - Posted: 25 Aug 2017, 22:07:42 UTC - in response to Message 1886082.  

Yeah, it seems problematic at the moment.
Let's hope it recovers, and doesn't crash!!!

Edit: And just after posting that, the cache filled up again.
As usual, as soon as you post about a problem, it goes away :-)

Well, if that's the way to fix things.............LOL.
I also got a couple of batches after posting that.
Something was temporarily veeeeeeeeeeeeeeeery busy.

Meow.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886083 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13835
Credit: 208,696,464
RAC: 304
Australia
Message 1886084 - Posted: 25 Aug 2017, 22:10:40 UTC - in response to Message 1886080.  
Last modified: 25 Aug 2017, 22:36:58 UTC

Are we crashing here????
Checked a couple of rigs, and getting 'no tasks available'.

Usual Scheduler weirdness.
Tbar's Update, Update, Update method got my cache re-filled.

Although it looks like the Master database Queries per second have dropped right off, and the AP graphs appear to be flatlining (very early on so hard to say for sure at this stage) so there could be trouble brewing.


EDIT- passing glitch.
Master Queries per sec did die off for a while there, then it came back with a vengeance & has settled back down to more normal levels.
Grant
Darwin NT
ID: 1886084 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1886089 - Posted: 25 Aug 2017, 22:33:48 UTC - in response to Message 1886017.  

No - a lot of people bunkered at the start, just look at the throughput on day on. No doubt there are some that bunker at the end, but that's a much higher risk activity.


. . I really don't understand why they bother in most cases. While it gives them a high spot on the result table at the beginning their lower daily numbers mean throughout the event others just keep passing them and that makes their bunkering look so desperate ...

. . It also distorts the final numbers since most of their "results" are from outside the event period. And it is such a tedious obsessive thing to do .... Hopefully one day the organisers will suggest it is not a good practice.

Stephen

<shrug>
ID: 1886089 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1886091 - Posted: 25 Aug 2017, 22:35:13 UTC - in response to Message 1886080.  

Are we crashing here????
Checked a couple of rigs, and getting 'no tasks available'.
And the stats pages are not responding well at all.
Hope not, being Friday afternoon.

Meow?



. . AAhhh, so the bug has reached the Kittyman ... :(

Stephen
ID: 1886091 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1886092 - Posted: 25 Aug 2017, 22:36:03 UTC - in response to Message 1886082.  

Yeah, it seems problematic at the moment.
Let's hope it recovers, and doesn't crash!!!

Edit: And just after posting that, the cache filled up again.
As usual, as soon as you post about a problem, it goes away :-)


. . Fequently, but sadly not always ....

Stephen

.
ID: 1886092 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886094 - Posted: 25 Aug 2017, 22:37:53 UTC - in response to Message 1886091.  

Are we crashing here????
Checked a couple of rigs, and getting 'no tasks available'.
And the stats pages are not responding well at all.
Hope not, being Friday afternoon.

Meow?



. . AAhhh, so the bug has reached the Kittyman ... :(

Stephen

Nah. Full up again with no intervention.
Something else was afoot. My pendings also shot up and then dropped back down when the downloads started coming again.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886094 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1886117 - Posted: 25 Aug 2017, 23:54:15 UTC - in response to Message 1886094.  


. . AAhhh, so the bug has reached the Kittyman ... :(
Stephen

Nah. Full up again with no intervention.
Something else was afoot. My pendings also shot up and then dropped back down when the downloads started coming again.


. . Sounds like a temporary traffic jam within SETI HQ.

Stephen

.
ID: 1886117 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1886122 - Posted: 26 Aug 2017, 0:35:56 UTC - in response to Message 1886094.  

Are we crashing here????
Checked a couple of rigs, and getting 'no tasks available'.
And the stats pages are not responding well at all.
Hope not, being Friday afternoon.

Meow?


. . AAhhh, so the bug has reached the Kittyman ... :(

Stephen

Nah. Full up again with no intervention.
Something else was afoot. My pendings also shot up and then dropped back down when the downloads started coming again.

Not sure what happened, but it looks like I missed it somehow.
Project details for: SETI@home including all dates
Total number of work requests: 507
Number of requests gaining work: 159
Number of requests not gaining work: 348
Number of requests not gaining work: 336 (project task limit)
Number of requests not gaining work: 9 (project shut down for maintenance)
Number of requests not gaining work: 1 (request was too recent)
Number of requests not gaining work: 2 (Project has no tasks available)
Number of times no work was requested: 0
Number of tasks gained: 190

Project details for: SETI@home on 25-Aug-2017
Total number of work requests: 134
Number of requests gaining work: 43
Number of requests not gaining work: 91
Number of requests not gaining work: 91 (project task limit)
Number of tasks gained: 44

Project details for: SETI@home on 24-Aug-2017
Total number of work requests: 148
Number of requests gaining work: 46
Number of requests not gaining work: 102
Number of requests not gaining work: 101 (project task limit)
Number of requests not gaining work: 1 (request too recent)
Number of tasks gained: 51

Project details for: SETI@home on 23-Aug-2017
Total number of work requests: 135
Number of requests gaining work: 42
Number of requests not gaining work: 93
Number of requests not gaining work: 91 (project task limit)
Number of requests not gaining work: 2 (Project has no tasks available)
Number of tasks gained: 45

Project details for: SETI@home on 22-Aug-2017
Total number of work requests: 90
Number of requests gaining work: 28
Number of requests not gaining work: 62
Number of requests not gaining work: 53 (project task limit)
Number of requests not gaining work: 9 (project down for maintenance)
Number of tasks gained: 50

No Scheduler Requests found for SETI@home on 21-Aug-2017

No Scheduler Requests found for SETI@home on 20-Aug-2017

SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1886122 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886277 - Posted: 26 Aug 2017, 19:00:39 UTC - in response to Message 1886276.  
Last modified: 26 Aug 2017, 19:03:24 UTC

The creation rate of the splitters is very low now.
"Results ready to send" is dropping like a stone.
If nothing changes for the better, we'll be out of work in approx. 5 hours, if "Results received in last hour" stays about the same.

I'll watch it for a bit before I send out a kitty distress call.............

EDIT.....
Creation rate just popped back up.
Think it might be one of those temporary overload thingys.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886277 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886279 - Posted: 26 Aug 2017, 19:14:00 UTC - in response to Message 1886278.  

The creation rate of the splitters is very low now.
"Results ready to send" is dropping like a stone.
If nothing changes for the better, we'll be out of work in approx. 5 hours, if "Results received in last hour" stays about the same.

I'll watch it for a bit before I send out a kitty distress call.............

EDIT.....
Creation rate just popped back up.
Think it might be one of those temporary overload thingys.

OK, we'll see. I haven't been able to get any new tasks for my main computer for an hour now.

Well, I'm afraid that's the rogue scheduler bug.
I'm within a few tasks of a full tank.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886279 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886283 - Posted: 26 Aug 2017, 19:21:22 UTC - in response to Message 1886281.  

The creation rate of the splitters is very low now.
"Results ready to send" is dropping like a stone.
If nothing changes for the better, we'll be out of work in approx. 5 hours, if "Results received in last hour" stays about the same.

I'll watch it for a bit before I send out a kitty distress call.............

EDIT.....
Creation rate just popped back up.
Think it might be one of those temporary overload thingys.

OK, we'll see. I haven't been able to get any new tasks for my main computer for an hour now.

Well, I'm afraid that's the rogue scheduler bug.
I'm within a few tasks of a full tank.

Nah, I think it is the "You need to post about it" bug.
My cache just filled up again, to the top :-)
Geeze.....

LOL....seems to be a common fix-it tool around here lately.
Nice when it works.
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886283 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51477
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1886285 - Posted: 26 Aug 2017, 19:38:40 UTC - in response to Message 1886284.  

The creation rate of the splitters is very low now.
"Results ready to send" is dropping like a stone.
If nothing changes for the better, we'll be out of work in approx. 5 hours, if "Results received in last hour" stays about the same.

I'll watch it for a bit before I send out a kitty distress call.............

EDIT.....
Creation rate just popped back up.
Think it might be one of those temporary overload thingys.

OK, we'll see. I haven't been able to get any new tasks for my main computer for an hour now.

Well, I'm afraid that's the rogue scheduler bug.
I'm within a few tasks of a full tank.

Nah, I think it is the "You need to post about it" bug.
My cache just filled up again, to the top :-)
Geeze.....

LOL....seems to be a common fix-it tool around here lately.
Nice when it works.

Yeah, worked for the second time today.
I think the scheduler is connected to this thread, and reacts to certain words :-)

The scheduler is part of Skynet.....
"Time is simply the mechanism that keeps everything from happening all at once."

ID: 1886285 · Report as offensive
Stephen "Heretic" Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 20 Sep 12
Posts: 5557
Credit: 192,787,363
RAC: 628
Australia
Message 1886304 - Posted: 26 Aug 2017, 22:17:06 UTC - in response to Message 1886284.  


Nah, I think it is the "You need to post about it" bug.
My cache just filled up again, to the top :-)
Geeze.....

LOL....seems to be a common fix-it tool around here lately.
Nice when it works.

Yeah, worked for the second time today.
I think the scheduler is connected to this thread, and reacts to certain words :-)


. . It seems to be, now all we have to do is work out what the key words are then the post could be short and effective ... :)

Stephen

:)
ID: 1886304 · Report as offensive
Profile Keith Myers Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 29 Apr 01
Posts: 13164
Credit: 1,160,866,277
RAC: 1,873
United States
Message 1886355 - Posted: 27 Aug 2017, 2:59:52 UTC

Guess it's time to complain of no work available for any machine and hope that the schedulers pick up on the keywords.
Seti@Home classic workunits:20,676 CPU time:74,226 hours

A proud member of the OFA (Old Farts Association)
ID: 1886355 · Report as offensive
Previous · 1 . . . 11 · 12 · 13 · 14 · 15 · 16 · 17 . . . 29 · Next

Message boards : Number crunching : Panic Mode On (107) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.