Pending units

Message boards : Number crunching : Pending units
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

AuthorMessage
Profile HSchmirPo
Avatar

Send message
Joined: 17 Jan 06
Posts: 18
Credit: 39,561,621
RAC: 0
Germany
Message 1031302 - Posted: 6 Sep 2010, 4:28:36 UTC

Last time I checked my pendings was 2 weeks before and it was about 1.500000. Since then I have to wait a minute and it shows ... NOTHING. Strange!
ET? It's me!
ID: 1031302 · Report as offensive
Keith White
Avatar

Send message
Joined: 29 May 99
Posts: 392
Credit: 13,035,233
RAC: 22
United States
Message 1031378 - Posted: 6 Sep 2010, 16:55:41 UTC

[rant]

My concern isn't credits (well annoyed yes, concerned no), I know that eventually the work units will get done by someone and I'll get the credits. My concern is how all of these "forgotten" work units impact server storage/stability.

And when I mean forgotten, I'm talking about checking my wingmen and finding them downloading new work while they are still sitting on 100s of not 1000s of work units that had been assigned to them weeks ago. It wouldn't be bad if this was just an indication of a large queue size but the work units being processed and returned are the ones fetched down more recently than there, hence my term "forgotten".

Looking at Scarecrow's 90 day server charts you can see the "In Progress" number have rocketed up to near 8 million and "Waiting for Validation" to over 7 million. This has to impact server storage negatively.

Going to the age old excuse of "server glich, they assigned me X number of work units but I never received them" only works for me a couple of times.

[/rant]
"Life is just nature's way of keeping meat fresh." - The Doctor
ID: 1031378 · Report as offensive
Profile BANZAI56
Volunteer tester

Send message
Joined: 17 May 00
Posts: 139
Credit: 47,299,948
RAC: 2
United States
Message 1031406 - Posted: 6 Sep 2010, 18:23:52 UTC - in response to Message 1031378.  
Last modified: 6 Sep 2010, 18:24:28 UTC

Going to the age old excuse of "server glich, they assigned me X number of work units but I never received them" only works for me a couple of times.



Bad news for ya; it’s a very real condition and has been happening far too often, for far too long.

Read through the thread titled: Ghost work units
ID: 1031406 · Report as offensive
andybutt
Volunteer tester
Avatar

Send message
Joined: 18 Mar 03
Posts: 262
Credit: 164,205,187
RAC: 516
United Kingdom
Message 1031433 - Posted: 6 Sep 2010, 19:41:31 UTC - in response to Message 1031406.  

How about a graph for pending credits in something like Boinc stats? That would be very interesting
ID: 1031433 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6497
Credit: 34,134,168
RAC: 0
United States
Message 1031442 - Posted: 6 Sep 2010, 20:03:40 UTC - in response to Message 1031406.  

Going to the age old excuse of "server glich, they assigned me X number of work units but I never received them" only works for me a couple of times.



Bad news for ya; it’s a very real condition and has been happening far too often, for far too long.

Read through the thread titled: Ghost work units


The good news: it looks like they are working on some checks and resends in the beta servers. More good news: it looks like they are testing it before making it live.


Janice
ID: 1031442 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1031479 - Posted: 6 Sep 2010, 22:09:42 UTC - in response to Message 1031433.  

How about a graph for pending credits in something like Boinc stats? That would be very interesting

LOL, even calculating that for one top user is an expensive database operation, see the Pending credit: NOT WORKING thread. Adding that for every user when doing the daily stats dumps might be terrible.
                                                                  Joe
ID: 1031479 · Report as offensive
Josef W. Segur
Volunteer developer
Volunteer tester

Send message
Joined: 30 Oct 99
Posts: 4504
Credit: 1,414,761
RAC: 0
United States
Message 1031482 - Posted: 6 Sep 2010, 22:20:20 UTC - in response to Message 1031442.  

The good news: it looks like they are working on some checks and resends in the beta servers. More good news: it looks like they are testing it before making it live.

Beta has had the full version of resend_lost_results enabled for several years, and indications are that's still true. The limited new version from changeset [trac]changeset:22203[/trac] cannot be tested while that's enabled.
                                                                 Joe
ID: 1031482 · Report as offensive
Keith White
Avatar

Send message
Joined: 29 May 99
Posts: 392
Credit: 13,035,233
RAC: 22
United States
Message 1031536 - Posted: 7 Sep 2010, 3:49:25 UTC - in response to Message 1031442.  

Going to the age old excuse of "server glich, they assigned me X number of work units but I never received them" only works for me a couple of times.



Bad news for ya; it’s a very real condition and has been happening far too often, for far too long.

Read through the thread titled: Ghost work units


The good news: it looks like they are working on some checks and resends in the beta servers. More good news: it looks like they are testing it before making it live.


LOL

Well as nice as folding in a resend function shouldn't some effort be made to figure out why it happens in the first place and stop it?

Going to the age old excuse of "server glich, they assigned me X number of work units but I never received them" only works for me a couple of times.



Bad news for ya; it’s a very real condition and has been happening far too often, for far too long.

Read through the thread titled: Ghost work units

Sadly I saw this after I hit send. I just seem to always be paired up with these guys.

"Life is just nature's way of keeping meat fresh." - The Doctor
ID: 1031536 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1031595 - Posted: 7 Sep 2010, 13:48:27 UTC - in response to Message 1031536.  

Trust me Keith, it's not just you paired up with these guys. I have some that have timed out, been resent and timed out again. Hopefully three's the charm! :-)


PROUD MEMBER OF Team Starfire World BOINC
ID: 1031595 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1031741 - Posted: 8 Sep 2010, 5:36:23 UTC

Wonder if the new server being provisioned might add enough processing power to the system to allow the resend feature being reimplemented here in an effort to cut down on the 'ghost bloat' of the database.

Hmmmmmmm..
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1031741 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1031751 - Posted: 8 Sep 2010, 7:45:06 UTC

And the Ghost WU problem doesn't only effect the Mega-machines. My lowly laptop which crunches only on a T7500 processor and has an RAC of 1200 had 100 ghost units allocated to it. This is 1.5 times it's 4 day cache.

T.A.
ID: 1031751 · Report as offensive
Profile Geek@Play
Volunteer tester
Avatar

Send message
Joined: 31 Jul 01
Posts: 2467
Credit: 86,146,931
RAC: 0
United States
Message 1031812 - Posted: 8 Sep 2010, 14:08:37 UTC

My last successfull pending request was Aug 6 and resulted in 757,409.31.

After that the pending request fails.

Boinc....Boinc....Boinc....Boinc....
ID: 1031812 · Report as offensive
Profile Len
Avatar

Send message
Joined: 15 Mar 10
Posts: 52
Credit: 11,725,173
RAC: 86
United Kingdom
Message 1032444 - Posted: 10 Sep 2010, 7:27:02 UTC

I fear I may be one of those who is getting, and processing newer units while older units theoretically sit not being processed.

The strange thing is that I can't see those same units when I look at my online list of pending. Nothing I do seems to get them processed and they will soon start to time out. There is a block of 8 tasks with deadlines from 19/09/2010 to 11/10/2010 that have simply been ignored by the Localhost BOINC Manager. Not shown in my pending list online, and so probably are "lost units". I think these were downloaded about the same time my lost upload(s) happened.

However, overall, its just something for my PC to be doing all day. No skin off my back as they say.

Len
I think I am. Therefore I am. I think.
ID: 1032444 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6497
Credit: 34,134,168
RAC: 0
United States
Message 1032467 - Posted: 10 Sep 2010, 9:55:47 UTC - in response to Message 1032444.  

Len:
The non-ghost pending you can clean up by running yourself "dry" from time to time. I did that as well as suspending my 0's and 1's until I had the resends cleaned off of my machine. This also gave me a chance to load up on Sunday(not such a busy day) for the current outage.

It took time... but I like to think it helped. Simply setting "no new tasks" for a bit would eventually get it.
Janice
ID: 1032467 · Report as offensive
Profile Fred J. Verster
Volunteer tester
Avatar

Send message
Joined: 21 Apr 04
Posts: 3252
Credit: 31,903,643
RAC: 0
Netherlands
Message 1032646 - Posted: 10 Sep 2010, 19:43:17 UTC - in response to Message 1032467.  

Had a lot of Ghosts on 1 rig and quite a lot of Pending credit: 139,564.91 .

At least they were comleted whithout error.
Sure hope the New Server will solve, the worst 'bottlenec'.


ID: 1032646 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1032647 - Posted: 10 Sep 2010, 19:51:33 UTC - in response to Message 1032467.  

Len:
The non-ghost pending you can clean up by running yourself "dry" from time to time. I did that as well as suspending my 0's and 1's until I had the resends cleaned off of my machine. This also gave me a chance to load up on Sunday(not such a busy day) for the current outage.

It took time... but I like to think it helped. Simply setting "no new tasks" for a bit would eventually get it.

Nice thought, spirit.......but my rigs never run 'dry' if I can help it.

The kitties always need the kibble bowl full.

Seti needs to solve this on their end........
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1032647 · Report as offensive
Profile James Sotherden
Avatar

Send message
Joined: 16 May 99
Posts: 10436
Credit: 110,373,059
RAC: 54
United States
Message 1032648 - Posted: 10 Sep 2010, 19:52:32 UTC

I agree with soft^spirit, Ive been doing the NNT for this and the last outage. Pendings are way high, but hopefully I can stop getting ghosts.
[/quote]

Old James
ID: 1032648 · Report as offensive
Profile soft^spirit
Avatar

Send message
Joined: 18 May 99
Posts: 6497
Credit: 34,134,168
RAC: 0
United States
Message 1032651 - Posted: 10 Sep 2010, 19:59:25 UTC - in response to Message 1032646.  

Had a lot of Ghosts on 1 rig and quite a lot of Pending credit: 139,564.91 .

At least they were comleted whithout error.
Sure hope the New Server will solve, the worst 'bottlenec'.



The idea of the new server was to get Nitpicker its own server.. If the lab crew can swap things around and do more that is all that much better.

The bottleneck seems to currently be disk space, a combination of ghosts and re-issues. Short term solutions seem needed to me. Longer term.. it might be much larger file servers.
Janice
ID: 1032651 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 1032654 - Posted: 10 Sep 2010, 20:00:48 UTC - in response to Message 1032648.  

If you check those new pendings you will see a lot of them will clear quickly as soon as the validater catches up. As for the new server,the bottleneck is in the bandwidth. The new server will help with storage and reliability but can't do anything about the bandwidth.


PROUD MEMBER OF Team Starfire World BOINC
ID: 1032654 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1032662 - Posted: 10 Sep 2010, 20:14:39 UTC

I would like the pending credits page problem fixed.


"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1032662 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · Next

Message boards : Number crunching : Pending units


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.