Rescheduling - final attempt

Message boards : Number crunching : Rescheduling - final attempt
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480098 - Posted: 21 Feb 2014, 10:20:06 UTC - in response to Message 1480092.  

What you propose (1000 tasks per host) is example of wrongly applied rescheduling and I would warn against such actions until your host can complete all those 1000 tasks in few days (look current average turnaround for particular estimate how much days it will be).

And more common note - "if all" never will be implemented as I stated before. If all would care about theyr hosts right behavior there will be no limits at all. The same is true regarding rescheduling. Never "if all" will be reached for absolutely different reasons starting from "cause it's not fair" feeling of some to "I just doesn't care" feelings of others.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480098 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480104 - Posted: 21 Feb 2014, 10:37:32 UTC
Last modified: 21 Feb 2014, 10:59:32 UTC

I was sleeping and there are so many post to read/comment.
I dont´like to use names in my post to avoyd conflicts and missunderstandigs, but this time i´m forced to use.

@Raistmer you are part of the "good reshedulers" group, those i mention in my initial post as 2 group, the small circle who realy knows how to rescheduler without impacting the project, so i see no problem with your practice, on the contrary, what you make is try to optimize you resources and do more science, so it´s good for the project. And if IIRC you stay withint the limits, so emotions aside you are right from my POV. But the problem is the circle of those who realy knows is very small, very few realy knows how to do that.

In my opinion, call the use of optimized apps as "cheating" is wrong, why, the project allow their use, they use are within the roules, so you can´t "cheat" if you are within aproved path. Insist on this point is futile.

@Tbar There is nothing wrong if you have 400 ready crunched WU in your cache, if you have thats simple shows you do a lot of science and probabily you have an internet access problem. What is wrong is if you "cheat" to optain a 400WU cache of "pendings" because this are above the project 200WU limit Period. The same aplies to add mores hosts to your farm, add more hosts is aproved by the project, so nobody could said that is "cheating" too.

@Wiggo we agree in a lot of points, the only point i can´t agree with you is when you insist in point someone directly, that only could flame the thread, and we need to keep the thread alive. Help us, let´s focus on the real big problem, those who "cheat" and build larges caches just for credit (my called 3 group).

To all, i belive the problem now is allready exposed, what we need now is a way to fix it, but that is with the project dev´s and admin, we could make little from our side beside ask all the comunity to avoid the bad rescheduler practice and keep the good rescheduling between the aproved limit.

Just for curiosity... after 5 days without new AP WU avaiable form the project and our caches where empty of AP WU for days... lets see what the big 3 anonymous "cheaters" have in their caches...

http://setiathome.berkeley.edu/results.php?hostid=6637324 pendings 214

http://setiathome.berkeley.edu/results.php?hostid=6016862 pendings 727

http://setiathome.berkeley.edu/results.php?hostid=6794209 pendings 210

Now compare that number with the 82,613 Results out in the field (by last Server Status Page). That give us 1.4% of the actual total AP WU avaiable, in just 3 hosts who produces less than 0,1% of the project daily output, so anyone could see that´s wrong. And the number is a lot worst, why because the results on the filed figure count CPU+GPU WU so if you made the same math just on the GPU WU i´m sure you will get something very impresive (if anyone knows who to do that i´m curious to see the real number)

Anything else must be added?

And please take no ofenses from my posts, sometimes the translations are not good but please be sure that´s clearely not my intention.

<edit> Still don´t understand why anonymous hosts are allowed on SETI or any other project. Hide the list of your host theoricaly is to keep your privacy and that is questionable, anonymous hosts are not. I know it´s hard to separate both. The use of anonymous hosts leave allways to situations like this one, use of the anonymous courtain to break the roules. But that is for another thread.
ID: 1480104 · Report as offensive
Gone

Send message
Joined: 31 May 99
Posts: 150
Credit: 125,779,206
RAC: 0
United Kingdom
Message 1480110 - Posted: 21 Feb 2014, 10:53:30 UTC

Apologies, I was being sarcastic, which doesn't always translate well.
I have NO intention of rescheduling anything.
I was just trying to point out what would happen if many people did it and my take on it from a competitive point of view.


Reg
ID: 1480110 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480111 - Posted: 21 Feb 2014, 10:55:12 UTC - in response to Message 1480104.  


@Raistmer you are part of the "good reshedulers" group, those i mention in my initial post as 2 group, the small circle who realy knows how to rescheduler without impacting the project, so i see no problem with your practice, on the contrary, what you make is try to optimize you resources and do more science, so it´s good for the project. And if IIRC you stay withint the limits, so emotions aside you are right from my POV. But the problem is the circle of those who realy knows is very small, very few realy knows how to do that.


Almost but not quite. I'm above limits (well, already under but it's just becasue usual AP tasks shortage). We on common ground treating hosts whit too many tasks to process in time as misbehaving ones but differ in approach to limit per se. I don't consider it as "God's revelation" and "unbreakable".
Hence there are some differencies in my and yours definitions of "good rescheduling group". My little (little? perhaps yes indeed cause number who does rescheduling correctly small) wider.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480111 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480114 - Posted: 21 Feb 2014, 10:59:31 UTC - in response to Message 1480104.  
Last modified: 21 Feb 2014, 11:00:28 UTC


http://setiathome.berkeley.edu/results.php?hostid=6016862 pendings 727

http://setiathome.berkeley.edu/results.php?hostid=6794209 pendings 210


Only last one has 5 errors but 5 still not too big number, hardly it got those erros because of rescheduling.

EDIT:
http://setiathome.berkeley.edu/results.php?hostid=6637324 pendings 214

this one shows 22 errors. Something to check on this host indeed.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480114 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480118 - Posted: 21 Feb 2014, 11:09:04 UTC
Last modified: 21 Feb 2014, 11:11:13 UTC

You are right, but we are not talking here about error, i never say they are wrong because the error they produce, heavely error producing hosts if for a compleately diferent thread. I inclusive clearely said on one post, they inclusive return their crunched WU in time... but that not makes them right.

I´m sure if their pendings WU where distributed alond the community all this WU (besides timeout or error of course) will allready crunched and reported days ago, and those WU where allready cleared from the DB.

Lets focus on the 727 pending host. IIRC it has about 1100 WU pendings 5 days ago, so it crunches about 72 WU/day... Their cache still holds for 10 days more... so if my calculations are correct it work with 15 days of cache... Sorry that can´t be right.

The old individual vs community discusion... he don´t have more right than any other one.

<edit> LOL - If you are a little above the 200 WU limit, don´t worry, you and the Lunnatics team have a lot of credit with the community... we simple look on the other direction... but please not extrapolate...
ID: 1480118 · Report as offensive
TBar
Volunteer tester

Send message
Joined: 22 May 99
Posts: 5204
Credit: 840,779,836
RAC: 2,768
United States
Message 1480119 - Posted: 21 Feb 2014, 11:09:38 UTC - in response to Message 1480104.  

@Tbar There is nothing wrong if you have 400 ready crunched WU in your cache, if you have thats simple shows you do a lot of science and probabily you have an internet access problem. What is wrong is if you "cheat" to optain a 400WU cache of "pendings" because this are above the project 200WU limit Period. The same aplies to add mores hosts to your farm, add more hosts is aproved by the project, so nobody could said that is "cheating" too...

Right, gotcha. It's fine if my AP only Mac works through 400 APs in 4 days as long as it's in groups of 200. If I run them all on the same host number though it's cheating. Right...that makes sense...not.

Nothing wrong with my FIOS internet, I can download 8 APs in a few seconds.
As of this moment, my two Mac hosts have around 140 APs left, that's enough for about a day and a half. Then the machine goes cold.
ID: 1480119 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480123 - Posted: 21 Feb 2014, 11:18:03 UTC - in response to Message 1480119.  
Last modified: 21 Feb 2014, 11:24:44 UTC

If I run them all on the same host number though it's cheating. Right...that makes sense...not.

Yes it not makes sense, but if you have 2 or + host numbers even on the same computer, nobody could blame you for nothing, it´s between the roules, so is right. I could agree the rules are foulty, but until someone change the roule, you are right. BTW There are few who actualy do that...
About the internet, i´m sure you understand what i try to said, 400 ready crunched WU without reporting indicates your host are not connecting with the project servers for a long time, normaly that happening only when you have some connection problem (other thread).
ID: 1480123 · Report as offensive
Profile William
Volunteer tester
Avatar

Send message
Joined: 14 Feb 13
Posts: 2037
Credit: 17,689,662
RAC: 0
Message 1480126 - Posted: 21 Feb 2014, 11:30:39 UTC

@ Juan regarding anon hosts

That's off-topic and I am sure somebody has a better explanation for that design decision, but the reason for allowing hosts to be anonymous is privacy. You lose users if they have to put their cards on the table.
Reasons for hiding your hosts are as diverse as the people.
You should respect the need for privacy.
Of course some people hide their hosts because they are up to no good and don't want their name associated with their wrongdoing.
There's always bad nuts.
And staff can always look it up anyway. It's just the wider public that can't satisfy their curiosity/voyeurism. And why should they? You don't invite the world into your living room either!

People always have reasons. They might be good or bad but there are always reasons. It's unfair to have a go at the law abiding majority because of a few crooks.

You'll be aware I must have reasons, too. Sometimes anonymity and unreal identities are tantamount to being able to do what you do - it's not just the bad guys that hide behind a mask.
A person who won't read has no advantage over one who can't read. (Mark Twain)
ID: 1480126 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480128 - Posted: 21 Feb 2014, 11:37:12 UTC - in response to Message 1480126.  
Last modified: 21 Feb 2014, 11:49:37 UTC

@william

I Agree with the privacy and have nothing against, i inclusive said hide the user list of computers is easy to understand.

But use anonymate to do "bad" things is wrong, i don´t said we all need to know who is the owner of the anonymous hosts, that´s sure only will flame the threads, what i try so said is, somebody (maybe something like you the mod´s do in the forums) need to keep the anonymous hosts "on track" so they not extrapolate their limits. They could remain anonymous without any problem, but they need to respect the roules as anyother member of the community, just that. Maybe something like a PM telling... hey what you are doing is not good... please avoid that practice... who knows?

LOL - I knows what you means... Did you ever see the movie... I know what you did the last summer...
ID: 1480128 · Report as offensive
draco
Volunteer tester

Send message
Joined: 6 Dec 05
Posts: 119
Credit: 3,327,457
RAC: 0
Latvia
Message 1480130 - Posted: 21 Feb 2014, 12:03:39 UTC - in response to Message 1480126.  


People always have reasons. They might be good or bad but there are always reasons.


there, i think, is another state. reasons not be divided in good nr bad, but wrong and logically.
there always is peoples, who think logically, rational,a nd lot of that, who think alogically. and nobody can prove them, for example, a 2 x 2 not the same as 5 x 2, because is large category of that, who be sure, a 2 x 2 = many, and 10x10 also is many, as so, all that is equivalent.
as so, if someone not understand things, when it is clearly writed, further discussion is waste of time, as i understand from my experience.
as says old russian proverb - "если человек идиот - то это надолго".
i publish that only therefore, i be sure, some people there, maybe because a small living experience, try to prove some opponents again and again - looks like he thinks, he can prove peoples, who cannot point some logical structures and so on. as always, nothing personally, but that is reality, in what we lives....
ID: 1480130 · Report as offensive
Profile shizaru
Volunteer tester
Avatar

Send message
Joined: 14 Jun 04
Posts: 1130
Credit: 1,967,904
RAC: 0
Greece
Message 1480132 - Posted: 21 Feb 2014, 12:07:17 UTC
Last modified: 21 Feb 2014, 12:10:46 UTC

...i can´t agree with you... you insist in point someone directly, that only could flame the thread.


I was about to say the same. Although maybe not nice enough to pass the "annoy or antagonize other people" & "messages that are deliberately hostile or insulting" rules of moderation :P

On a side note, it has made sense for years to build many & mediocre crunchers for Seti. I've said it before & I'll say it again: my netbook has never starved for work in over 3 years, except for when the Lab shut down for a week or more. A smart person would build as many single-card (let's say) GT 650 machines as they could afford if they really wanted to avoid the stress & babysitting.

I think David Anderson called it "the hot-rod mentality" in an Nvidia keynote, many years ago. Now I'm all for "hot-rods"... I really am.. they just haven't made sense for years, as far as Seti is concerned.

On another side note, these threads are just a prelude. I imagine they will get worse before they get better. It appears Raistmer has kicked a hornets nest and that is almost definitely a good thing. What he is doing manually now will likely be done automatically (based on his experience & findings) one day by Boinc. Sure it'll take like 5 years but whatever:)

On another-other side note, going up against a volunteer guru has the painfully obvious effect of biting the hand that feeds you. And it's OK to bite the hand that feeds you but you better have a faaaaar better argument than dogma.

Edit: And this from someone running stock apps and AP de-selected:)
ID: 1480132 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480136 - Posted: 21 Feb 2014, 12:23:17 UTC - in response to Message 1480118.  

You are right, but we are not talking here about error, i never say they are wrong because the error they produce, heavely error producing hosts if for a compleately diferent thread. I inclusive clearely said on one post, they inclusive return their crunched WU in time... but that not makes them right.

I´m sure if their pendings WU where distributed alond the community all this WU (besides timeout or error of course) will allready crunched and reported days ago, and those WU where allready cleared from the DB.

Lets focus on the 727 pending host. IIRC it has about 1100 WU pendings 5 days ago, so it crunches about 72 WU/day... Their cache still holds for 10 days more... so if my calculations are correct it work with 15 days of cache... Sorry that can´t be right.

The old individual vs community discusion... he don´t have more right than any other one.

<edit> LOL - If you are a little above the 200 WU limit, don´t worry, you and the Lunnatics team have a lot of credit with the community... we simple look on the other direction... but please not extrapolate...


But that's very my point, it's not because some have "lot of credit with community" (the single result of this "credit" would be to more deeply analyze what such peoples saying, it's not make them right just because of that but "average Joe" opinion and specialist opinion just can't have similar weight), but for completely other reasons. And I disagree with "if they would distributed among...". If those tasks were distrbuted to stock app they would be completed much later even than quite excessive hoarder with fast GPU can provide.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480136 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480138 - Posted: 21 Feb 2014, 12:25:41 UTC - in response to Message 1480123.  
Last modified: 21 Feb 2014, 12:25:52 UTC

If I run them all on the same host number though it's cheating. Right...that makes sense...not.

Yes it not makes sense, but if you have 2 or + host numbers even on the same computer, nobody could blame you for nothing, it´s between the roules, so is right. I could agree the rules are foulty, but until someone change the roule, you are right. BTW There are few who actualy do that...


And this is again I can't agree with. It's not "rule", it's technical limit (!).
It's not some law, rule and whatever. Some peoples on this board trying to make such rule from this limitation but it's not.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480138 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480139 - Posted: 21 Feb 2014, 12:27:24 UTC - in response to Message 1480126.  



You'll be aware I must have reasons, too. Sometimes anonymity and unreal identities are tantamount to being able to do what you do - it's not just the bad guys that hide behind a mask.


+1
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480139 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480140 - Posted: 21 Feb 2014, 12:31:10 UTC - in response to Message 1480130.  
Last modified: 21 Feb 2014, 12:31:34 UTC


as says old russian proverb - "если человек идиот - то это надолго".
i publish that only therefore, i be sure, some people there, maybe because a small living experience, try to prove some opponents again and again - looks like he thinks, he can prove peoples, who cannot point some logical structures and so on. as always, nothing personally, but that is reality, in what we lives....


LoL, perhaps so :) But it's hard to tolerate if you see witchhunting and wrong accusation on public, it's purely illogical, indeed, but sense of justice disobeys.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480140 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1480143 - Posted: 21 Feb 2014, 12:36:27 UTC - in response to Message 1480132.  

but you better have a faaaaar better argument than dogma.

LoL, exactly :) I can be wrong as anyone can, but not because of dogma, +10.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1480143 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480144 - Posted: 21 Feb 2014, 12:37:26 UTC - in response to Message 1480110.  
Last modified: 21 Feb 2014, 12:44:13 UTC

Apologies, I was being sarcastic, which doesn't always translate well.
I have NO intention of rescheduling anything.
I was just trying to point out what would happen if many people did it and my take on it from a competitive point of view.


Reg

I allready use you and I as an example, just don´t remember the post, with your farm you could easely acumulate 5% of the entire avaiable AP WU´s if you decide to do competitive rescheduling and don´t care about timeouts. Now imagine Mark or MJS...(10% at least), in other words, we 4 could easely acumulate >1/4 of the total project avaiable AP WU, resulting in a compleate starvation to the rest of the community... and a lot of enemies of course...
But guy´s don´t panic, i´m sure no one of us will ever try to do that. So Reg go back to your evil plywood construction plans. My new 690 is allready in transit. :)

But it's hard to tolerate if you see witchhunting and wrong accusation on public, it's purely illogical, indeed, but sense of justice disobeys.

That´s i totaly agree. No witchhunting that only flames the threads.
ID: 1480144 · Report as offensive
juan BFP Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 16 Mar 07
Posts: 9786
Credit: 572,710,851
RAC: 3,799
Panama
Message 1480154 - Posted: 21 Feb 2014, 12:53:06 UTC - in response to Message 1480138.  
Last modified: 21 Feb 2014, 12:53:52 UTC

it's technical limit (!).

I´m sure you knows this is not the real true...

Friends/Enemies. To avoid emotions, flaming, etc. I will do partialy what was sugested by Chris, I will left this thread not SETI... at least for now, and back to my normal life. Left to each one concience what is right or wrong to do with rescheduling, hope a lot choose the right path.
ID: 1480154 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1480155 - Posted: 21 Feb 2014, 12:57:16 UTC - in response to Message 1480145.  

And staff can always look it up anyway.

Really, is that so? Staff as in Mods or Admins?

Staff, as in Berkeley payroll. Mods certainly can't.
ID: 1480155 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · Next

Message boards : Number crunching : Rescheduling - final attempt


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.