Project Backoff too extreme...

Message boards : Number crunching : Project Backoff too extreme...
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · Next

AuthorMessage
_heinz
Volunteer tester

Send message
Joined: 25 Feb 05
Posts: 744
Credit: 5,539,270
RAC: 0
France
Message 972307 - Posted: 20 Feb 2010, 16:44:12 UTC

Looks like before next tuesday nothing will be changed....
I'm really disappointed, since 3 days I can't upload any work and don't get new work for seti. This way seti will lost a lot of members. I switched to docking@home now.




D5400XS V8-Xeon
ID: 972307 · Report as offensive
Rattledagger
Volunteer tester

Send message
Joined: 22 Jan 00
Posts: 23
Credit: 1,010,202
RAC: 0
Norway
Message 972317 - Posted: 20 Feb 2010, 16:55:02 UTC - in response to Message 972257.  

Don't you love it, the backoff kicks in yeat lets one remain uploading...As soon as that unit starts to upload it kicks it in the Backoff mode. If I downgrade to a version without this TOTALLY STUPID Project Backoff will I lose the work I have waiting?

The project-backoff was added for a reason...

Why was it added?
Let's say everyone is constantly hitting the "retry now"-button for uploads, and on average each failed upload takes 10 seconds before time-outs. This would give 60000 new upload-attempts per second to a server that is normally handling somewhere around 15 results/second (54k results/hour).

Fairly obviously, the server has no hope of handling 60k results/second, so it's more likely to crash and handle zero result/day than anything else...


But, what about the project-backoff?
If everyone is waiting for the project backoff to wear-off, and this on average is 2 hours, there will be 83 new upload-attempts per second.

Now, 83 results/second can still be too much to handle, but there's atleast much less chance of killing the server, and the server is more likely to handle part of the load successfully.


As for older clients without the project backoff, if you've got more than 360 files to upload you'll be constantly trying to upload anyway, so these clients is already behaving as if the user is constantly hitting "retry now", and therefore overloads the server.

In any case, with the servers currently handling only 3 results/second, it's unlikely anything individual users does will have any large impact either way.

Anyway, I'll answer your question, even it's a bad idea to downgrade to a client that puts even higher load on a server that can't handle the current load... As long as you uninstall current client before installing an older client, you shouldn't lose any work... Well, atleast as long as you don't downgrade to a client that can't use a resource, if you example downgrades to a v6.2.xx-client chances are any CUDA-results will be erroring-out.


ID: 972317 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 972321 - Posted: 20 Feb 2010, 17:00:50 UTC - in response to Message 972317.  
Last modified: 20 Feb 2010, 17:03:45 UTC

Don't you love it, the backoff kicks in yeat lets one remain uploading...As soon as that unit starts to upload it kicks it in the Backoff mode. If I downgrade to a version without this TOTALLY STUPID Project Backoff will I lose the work I have waiting?

The project-backoff was added for a reason...

Why was it added?
Let's say everyone is constantly hitting the "retry now"-button for uploads, and on average each failed upload takes 10 seconds before time-outs. This would give 60000 new upload-attempts per second to a server that is normally handling somewhere around 15 results/second (54k results/hour).

Fairly obviously, the server has no hope of handling 60k results/second, so it's more likely to crash and handle zero result/day than anything else...


But, what about the project-backoff?
If everyone is waiting for the project backoff to wear-off, and this on average is 2 hours, there will be 83 new upload-attempts per second.

Now, 83 results/second can still be too much to handle, but there's atleast much less chance of killing the server, and the server is more likely to handle part of the load successfully.


As for older clients without the project backoff, if you've got more than 360 files to upload you'll be constantly trying to upload anyway, so these clients is already behaving as if the user is constantly hitting "retry now", and therefore overloads the server.

In any case, with the servers currently handling only 3 results/second, it's unlikely anything individual users does will have any large impact either way.

Anyway, I'll answer your question, even it's a bad idea to downgrade to a client that puts even higher load on a server that can't handle the current load... As long as you uninstall current client before installing an older client, you shouldn't lose any work... Well, atleast as long as you don't downgrade to a client that can't use a resource, if you example downgrades to a v6.2.xx-client chances are any CUDA-results will be erroring-out.


Don't give me any crap about the client hack-off.

If the project does not want to hear from me, so be it.

Your self serving excuse of an argument just does not cut it.

And if that seems a little curt........so be it.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 972321 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 972331 - Posted: 20 Feb 2010, 17:26:42 UTC - in response to Message 972321.  

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

ID: 972331 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 972336 - Posted: 20 Feb 2010, 17:33:56 UTC - in response to Message 972331.  

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

So thousands of WU's take the back burner, eh?

This is not a casual user you are talking to.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 972336 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 972340 - Posted: 20 Feb 2010, 17:39:54 UTC - in response to Message 972336.  

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

So thousands of WU's take the back burner, eh?

This is not a casual user you are talking to.

Which does not explain why you think you are entitled to more than your fair share of the available bandwidth/connections/resources.
ID: 972340 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65833
Credit: 55,293,173
RAC: 49
United States
Message 972347 - Posted: 20 Feb 2010, 17:49:53 UTC - in response to Message 972296.  

Don't you love it, the backoff kicks in yeat lets one remain uploading...As soon as that unit starts to upload it kicks it in the Backoff mode. If I downgrade to a version without this TOTALLY STUPID Project Backoff will I lose the work I have waiting?

Right now backoff or not the problem seems to be somewhere between Seti and all of US, So do nothing, As nothing for the moment can be done, Besides read posts Here or somewhere else and Eric is aware that there is a problem with uploads, I think He figured that out by looking at the amount or the lack really of any data flowing back in from US.


It's not only the US. It's the whole world that have issues connecting with SETI.

Sten-Arne

Agreed, This is a big problem, Best let Eric handle It then.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 972347 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 972348 - Posted: 20 Feb 2010, 17:50:45 UTC - in response to Message 972340.  
Last modified: 20 Feb 2010, 17:53:30 UTC

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

So thousands of WU's take the back burner, eh?

This is not a casual user you are talking to.

Which does not explain why you think you are entitled to more than your fair share of the available bandwidth/connections/resources.

I could make a snide comment.
But the kitties have been making me behave.
It is soooooooo easy taking side shots.

But my wish is still to just phone home.

You do remember the Bar-T, doncha?

Give me an apology, Ned.

I got one barrel left.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 972348 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 972367 - Posted: 20 Feb 2010, 18:23:04 UTC - in response to Message 972107.  

What's to justify???
Trying to report work done?????

I have a rig that's got everything uploaded and can't f'n phone home to the servers for days now to report it.

Where are the fish????

Don't try to punt the ball around with me.......I commented on this problem before most even knew it existed.


Yeah, try justifying reporting work done when BOINC will already do that on it's own, without the user aggressively pushing their own through before everyone else's because they think their workunits need to be reported immediately.

There's no reason to force yours through before everyone else.
ID: 972367 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 972369 - Posted: 20 Feb 2010, 18:24:33 UTC - in response to Message 972348.  

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

So thousands of WU's take the back burner, eh?

This is not a casual user you are talking to.

Which does not explain why you think you are entitled to more than your fair share of the available bandwidth/connections/resources.

I could make a snide comment.
But the kitties have been making me behave.
It is soooooooo easy taking side shots.

But my wish is still to just phone home.

You do remember the Bar-T, doncha?

Give me an apology, Ned.

I got one barrel left.


Ned doesn't owe you an apology. It does not matter how much you crunch, you do not get priority over everyone else. If you want to "phone home", just let BOINC do it's damn job!

Start taking shots and they will be hidden. No flames around here. Knock it off.
ID: 972369 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 972376 - Posted: 20 Feb 2010, 18:40:24 UTC - in response to Message 972367.  

What's to justify???
Trying to report work done?????

I have a rig that's got everything uploaded and can't f'n phone home to the servers for days now to report it.

Where are the fish????

Don't try to punt the ball around with me.......I commented on this problem before most even knew it existed.


Yeah, try justifying reporting work done when BOINC will already do that on it's own, without the user aggressively pushing their own through before everyone else's because they think their workunits need to be reported immediately.

There's no reason to force yours through before everyone else.

i got 7 rigs out of 8 that I have not pushed a button on.
Ignorant, you can be.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 972376 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 972381 - Posted: 20 Feb 2010, 18:45:55 UTC - in response to Message 972376.  

What's to justify???
Trying to report work done?????

I have a rig that's got everything uploaded and can't f'n phone home to the servers for days now to report it.

Where are the fish????

Don't try to punt the ball around with me.......I commented on this problem before most even knew it existed.


Yeah, try justifying reporting work done when BOINC will already do that on it's own, without the user aggressively pushing their own through before everyone else's because they think their workunits need to be reported immediately.

There's no reason to force yours through before everyone else.

i got 7 rigs out of 8 that I have not pushed a button on.
Ignorant, you can be.


Did I state anything about your actuality of pressing buttons? You spoke up in defense of the habit, so I responded back. Can hardly be classified as ignorant if you're defending the practice. But it can be ignorant to insist your somehow more important than everyone else simply because of the amount of work you do.
ID: 972381 · Report as offensive
Profile perryjay
Volunteer tester
Avatar

Send message
Joined: 20 Aug 02
Posts: 3377
Credit: 20,676,751
RAC: 0
United States
Message 972463 - Posted: 20 Feb 2010, 21:58:29 UTC

Why do I get the feeling this thread is headed for a lock? Calm down guys, Hurricane Electric seems to be the villain here not each other. Large cache, small cache, super fast cruncher, slowpoke, we're all getting hit by this.


PROUD MEMBER OF Team Starfire World BOINC
ID: 972463 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51469
Credit: 1,018,363,574
RAC: 1,004
United States
Message 972502 - Posted: 20 Feb 2010, 22:37:46 UTC - in response to Message 972381.  

What's to justify???
Trying to report work done?????

I have a rig that's got everything uploaded and can't f'n phone home to the servers for days now to report it.

Where are the fish????

Don't try to punt the ball around with me.......I commented on this problem before most even knew it existed.


Yeah, try justifying reporting work done when BOINC will already do that on it's own, without the user aggressively pushing their own through before everyone else's because they think their workunits need to be reported immediately.

There's no reason to force yours through before everyone else.

i got 7 rigs out of 8 that I have not pushed a button on.
Ignorant, you can be.


Did I state anything about your actuality of pressing buttons? You spoke up in defense of the habit, so I responded back. Can hardly be classified as ignorant if you're defending the practice. But it can be ignorant to insist your somehow more important than everyone else simply because of the amount of work you do.

Not if you happen to be so.
Meow meow.

"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 972502 · Report as offensive
OzzFan Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Apr 02
Posts: 15691
Credit: 84,761,841
RAC: 28
United States
Message 972546 - Posted: 21 Feb 2010, 0:38:20 UTC - in response to Message 972502.  
Last modified: 21 Feb 2010, 0:58:16 UTC

What's to justify???
Trying to report work done?????

I have a rig that's got everything uploaded and can't f'n phone home to the servers for days now to report it.

Where are the fish????

Don't try to punt the ball around with me.......I commented on this problem before most even knew it existed.


Yeah, try justifying reporting work done when BOINC will already do that on it's own, without the user aggressively pushing their own through before everyone else's because they think their workunits need to be reported immediately.

There's no reason to force yours through before everyone else.

i got 7 rigs out of 8 that I have not pushed a button on.
Ignorant, you can be.


Did I state anything about your actuality of pressing buttons? You spoke up in defense of the habit, so I responded back. Can hardly be classified as ignorant if you're defending the practice. But it can be ignorant to insist your somehow more important than everyone else simply because of the amount of work you do.

Not if you happen to be so.
Meow meow.


You are only so in your head. Reality has said otherwise many times in the past.
ID: 972546 · Report as offensive
1mp0£173
Volunteer tester

Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 972550 - Posted: 21 Feb 2010, 0:41:59 UTC - in response to Message 972348.  

If the project does not want to hear from me, so be it.

The project does not want to hear from you to the exclusion of others.

You have to play nice and take your turn.

So thousands of WU's take the back burner, eh?

This is not a casual user you are talking to.

Which does not explain why you think you are entitled to more than your fair share of the available bandwidth/connections/resources.

I could make a snide comment.
But the kitties have been making me behave.
It is soooooooo easy taking side shots.

But my wish is still to just phone home.

You do remember the Bar-T, doncha?

Give me an apology, Ned.

I got one barrel left.

Physical force seems to be your response to everything.

Phone home, great. The line is busy, and there are many other callers.

Wait your turn.
ID: 972550 · Report as offensive
Profile Pappa
Volunteer tester
Avatar

Send message
Joined: 9 Jan 00
Posts: 2562
Credit: 12,301,681
RAC: 0
United States
Message 972562 - Posted: 21 Feb 2010, 1:30:27 UTC

Okay...

Silly question... What happens if the "Libcurl" bug is on the Server Side?

From My Side, Boinc is doing what it supposed to do. I have the Debug Logs to prove it. Portions have been emailed.

Regards

Please consider a Donation to the Seti Project.

ID: 972562 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14655
Credit: 200,643,578
RAC: 874
United Kingdom
Message 972570 - Posted: 21 Feb 2010, 1:39:45 UTC - in response to Message 972562.  

Okay...

Silly question... What happens if the "Libcurl" bug is on the Server Side?

From My Side, Boinc is doing what it supposed to do. I have the Debug Logs to prove it. Portions have been emailed.

Regards

You don't need libcurl or BOINC logs. I think we need this sort of data now:


(Direct link)

That's a good one (complete upload). Most get RST packets from Bruno. Why?
ID: 972570 · Report as offensive
Profile Pappa
Volunteer tester
Avatar

Send message
Joined: 9 Jan 00
Posts: 2562
Credit: 12,301,681
RAC: 0
United States
Message 972581 - Posted: 21 Feb 2010, 2:10:11 UTC - in response to Message 972570.  

To my knowledge there are two modes on Uploads. Balanced and Aggressive (to compete with downloads).

I have knowledge that Eric placed uploads in the "balanced" mode after the outage. So if on of the "listeners" (a connection attempt) should happen and there was no thread to connect it would get a RST (reset packet) which would cause a retry.

So without the TCPDump, I have seen acknowledgements (server) and the start of an upload (without the acknowleding SYN packet). Then the timeout.

The Scheduler is a different story.

Note: If this seems like too much technical information, it probably is. advanced users are working on it and please be patient.

Regards

Please consider a Donation to the Seti Project.

ID: 972581 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14655
Credit: 200,643,578
RAC: 874
United Kingdom
Message 972583 - Posted: 21 Feb 2010, 2:17:49 UTC - in response to Message 972581.  
Last modified: 21 Feb 2010, 2:18:11 UTC

To my knowledge there are two modes on Uploads. Balanced and Aggressive (to compete with downloads).

I have knowledge that Eric placed uploads in the "balanced" mode after the outage. So if on of the "listeners" (a connection attempt) should happen and there was no thread to connect it would get a RST (reset packet) which would cause a retry.

So without the TCPDump, I have seen acknowledgements (server) and the start of an upload (without the acknowleding SYN packet). Then the timeout.

The Scheduler is a different story.

Note: If this seems like too much technical information, it probably is. advanced users are working on it and please be patient.

Regards

Have you checked the failure traces in Technical News? SYN seemed fine - the RST came later.
ID: 972583 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · Next

Message boards : Number crunching : Project Backoff too extreme...


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.