To Whomever this concerns: Backoffs and error -6

Message boards : Number crunching : To Whomever this concerns: Backoffs and error -6
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 9 · Next

AuthorMessage
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 887298 - Posted: 22 Apr 2009, 15:38:02 UTC - in response to Message 887295.  

Here's something Perl installation on XP.

http://home.wangjianshuo.com/archives/20021124_install_perl_on_windows_xp.htm

If you can hang in there for a moment, SJ, we might be able to do something in vb script, which you'll have already - no installation necessary.

I'm trying to attract Jason's attention as we speak.
ID: 887298 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887299 - Posted: 22 Apr 2009, 15:40:02 UTC - in response to Message 887298.  

Here's something Perl installation on XP.

http://home.wangjianshuo.com/archives/20021124_install_perl_on_windows_xp.htm

If you can hang in there for a moment, SJ, we might be able to do something in vb script, which you'll have already - no installation necessary.

I'm trying to attract Jason's attention as we speak.

Too late. Oops.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887299 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14654
Credit: 200,643,578
RAC: 874
United Kingdom
Message 887305 - Posted: 22 Apr 2009, 15:50:10 UTC - in response to Message 887299.  

Too late. Oops.

Not to worry - gives us two avenues to go at, instead of just one.

Jason is nibbling at the bait, but I haven't hooked him yet. And I have to go out for about an hour. Will see what transpires when I get back.
ID: 887305 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887314 - Posted: 22 Apr 2009, 16:04:26 UTC - in response to Message 887305.  

Too late. Oops.

Not to worry - gives us two avenues to go at, instead of just one.

Jason is nibbling at the bait, but I haven't hooked him yet. And I have to go out for about an hour. Will see what transpires when I get back.

Ah yes raw meat as the bait, Must be quite a fish to haul in, Must be something that needs Tuna.

I will be standing by for more.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887314 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 887325 - Posted: 22 Apr 2009, 16:56:57 UTC - in response to Message 887314.  

Well, as so many posts were made and so many man-hours were spent on reading, answering and so on and so forth (I came to this thread only now ;) ) think it's worth to post current version of script that does CPU<->GPU task shuffle based on their AR (hope it will save some another man-hours spent to escalate this situation).

But DISCLAIMER :
BLAME ONLY YOURSELF for using this script and consequencies it could take.
BTW, my CUDA MB builds were "released" under the same disclaimer => this thread looks like "User agreement violation" to me ;).


Perl script (V2, only rudimentary deadline meeting protection, should not be used with cache more than 1-3 days of work, BOINC should be disabled before running this script, it should be located in BOINC data (not BOINC binaries) directory.):


$path="client_state.xml";
$results="client_state.xml_new";


open (IN, $path);

$NumOfCPUTasks=0;
$NumOfGPUTasks=0;
$NumGPUToNumCPU_high_limit=2;
$NumGPUToNumCPU_low_limit=0.5;
$Num_tasks_limit=500;
while (<IN>) {
if( /<workunit>/ ){
#parsing result
$trueAR=-1;#error condition
$WUname="";
while(<IN>){
if( /<\/workunit>/ ){
last;
}
if( /<name>(.*)<\/name>/ ){#reading task file and deciding where it should go
open (WU, "projects\\setiathome.berkeley.edu\\".$1) || die "ERROR: cant open task file";
$WUname=$1;
while(<WU>){
if( /<true_angle_range>(.*)<\/true_angle_range>/ ){
$trueAR=$1;
if( $trueAR == -1 ){
die "ERROR detected - cant determine AR value\n";
}
if($trueAR < 0.13 || $trueAR > 1.127){
$tasks{$WUname}=603;
}else{$tasks{$WUname}=608;}
last;
}

}
close(WU);

}
elsif( /<version_num>603<\/version_num>/ ){$NumOfCPUTasks++;}
elsif( /<version_num>608<\/version_num>/ ){$NumOfGPUTasks++;}

}

}
}
close(IN);
print "Number of CPU tasks before rescheduling:".$NumOfCPUTasks."\n";
print "Number of GPU tasks before rescheduling:".$NumOfGPUTasks."\n";
$GPU_to_CPU_ratio=$NumOfGPUTasks/$NumOfCPUTasks;
if($GPU_to_CPU_ratio >$NumGPUToNumCPU_high_limit){
die "Too many tasks allocated to GPU already";}
if($GPU_to_CPU_ratio <$NumGPUToNumCPU_low_limit){
die "Too many tasks allocated to CPU already";}
if($NumOfCPUTasks+$NumOfGPUTasks>$Num_tasks_limit){
die "Too many tasks in cache already";}
$NumOfCPUTasks=0;
$NumOfGPUTasks=0;
open (IN, $path);
open (RES, ">".$results);
while (<IN>) {
if( /<result>/ ){
$WUname="";
print RES $_;
while(<IN>){
if( /<wu_name>(.*)<\/wu_name>/ ){
$WUname=$1;
print RES $_;
}elsif( /<version_num>/ ){;}
elsif( /<plan_class>/ ){;}#skipping
elsif( /<\/result>/ ){
if($tasks{$WUname}==603){
print RES " <version_num>603<\/version_num>\n";

}else{
print RES " <version_num>608<\/version_num>\n";
print RES " <plan_class>cuda<\/plan_class>\n";
}
print RES $_;
last;
}
else{ print RES $_;}
}
}elsif( /<workunit>/ ){
$WUname="";
print RES $_;
while(<IN>){
if( /<name>(.*)<\/name>/ ){
$WUname=$1;
print RES $_;
}elsif( /<version_num>/ ){;}
elsif( /<\/workunit>/ ){
if($tasks{$WUname}==603){
print RES " <version_num>603<\/version_num>\n";
$NumOfCPUTasks++;

}else{
print RES " <version_num>608<\/version_num>\n";
$NumOfGPUTasks++;
}
print RES $_;
last;
}
else{ print RES $_;}
}

}else{ print RES $_;}
}
print "Number of CPU tasks after rescheduling:".$NumOfCPUTasks."\n";
print "Number of GPU tasks after rescheduling:".$NumOfGPUTasks."\n";

(C)Raistmer 2009
This script provided on next conditions:
Feel free to modify it to fit your own host config or your own preferencies, no restrictions for dublication or modification imposed.
The single restriction is: to blame something other than user of this script himself for consequencies of this script using forbidden. Such blame will be considered as "User agreement" and copyleft violation and will be pursued by all means possible :P

(Hope this half-joke will make some of "I don't care what I doing but others should take care of this" users more responsible for their own deeds ;) )
ID: 887325 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887331 - Posted: 22 Apr 2009, 17:18:32 UTC - in response to Message 887325.  
Last modified: 22 Apr 2009, 17:21:17 UTC

Ok so what do I name this file? By Boinc data folder I gather You mean where the seti files to crunched are located at?

I named mine like so: gpu-cpu.perl

Oh and any app in particular to run with this file? V10 or V11 or ? I'm using V11 so far, Will change if needed.

As OP of the thread, It's bearing fruit. Soon It will be time for harvest.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887331 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 887333 - Posted: 22 Apr 2009, 17:25:48 UTC - in response to Message 887331.  

Ok so what do I name this file?

Dont_blame_SETI_staff_for_my_own_decisions.pl
;)
Original name was CPU_GPU_rebrand_V2.pl but in this thread I prefer new name.


By Boinc data folder I gather You mean where the seti files to crunched are located at?

No. I mean parent directory for projects and slots subdirectories.
SETI files are located in SETI project directory (subdir of projects that in turn subdir of BOINC data directory).


Oh and any app in particular to run with this file? V10 or V11 or ? I'm using V11 so far, Will change if needed.

This script for using only with BOINC 6.6.20 (no another versions supported cause I don't want to spend time on questions regarding BOINC dev-builds installations) and w/o "teamed" pack.
Any CUDA MB app can be used (all my last builds and even stock one).
ID: 887333 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887335 - Posted: 22 Apr 2009, 17:31:50 UTC - in response to Message 887333.  

Sure whatever You say Raist, I would be happy with any name You suggested and I can live with It. Here goes nothing. So far so good, Everything looks nominal and is running Hot, Straight and True to the target. Maybe we'll sink that flattop yet. ;)
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887335 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 887338 - Posted: 22 Apr 2009, 17:36:35 UTC - in response to Message 887333.  


By Boinc data folder I gather You mean where the seti files to crunched are located at?

No. I mean parent directory for projects and slots subdirectories.

Where the client_state.xml file is located, that the script is looking for.
ID: 887338 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887339 - Posted: 22 Apr 2009, 17:40:28 UTC - in response to Message 887333.  
Last modified: 22 Apr 2009, 17:43:07 UTC

How will one know If this is running If so placed and with 6.6.20 and such?

As afterward I did get 13 computation errors, But no error number this time at all in the messages tab of Boinc, Boinc just says computation error on all of them in the Tasks Tab.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887339 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887344 - Posted: 22 Apr 2009, 17:41:30 UTC - in response to Message 887338.  


By Boinc data folder I gather You mean where the seti files to crunched are located at?

No. I mean parent directory for projects and slots subdirectories.

Where the client_state.xml file is located, that the script is looking for.

Ok that's where It's at, So I'll leave It there.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887344 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 887345 - Posted: 22 Apr 2009, 17:45:11 UTC - in response to Message 887339.  
Last modified: 22 Apr 2009, 17:52:32 UTC

How will one know If this is running If so placed and with 6.6.20 and such?

As afterward I did get 13 computation errors, But no error number this time at all in the messages tab of Boinc, Boinc just says computation error on all of them in the Tasks Tab.


Did you run script already?
What information it printed on screen?

ADDON: to run it you should:
1) stop BOINC
2) run script via command:
perl Dont_blame_SETI_staff_for_my_own_decisions.pl
3) copy client_state.xml_new to client_state.xml (check that client_state.xml_new has non-zero size before).
4) start BOINC

"2)" assumes you have working installation of Perl on your host and perl.exe in PATH.
(there are some perl implementations that don't need any installation - just single executable + one DLL file).
ID: 887345 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887351 - Posted: 22 Apr 2009, 18:00:51 UTC - in response to Message 887345.  

How will one know If this is running If so placed and with 6.6.20 and such?

As afterward I did get 13 computation errors, But no error number this time at all in the messages tab of Boinc, Boinc just says computation error on all of them in the Tasks Tab.


Did you run script already?
What information it printed on screen?

ADDON: to run it you should:
1) stop BOINC
2) run script via command:
perl Dont_blame_SETI_staff_for_my_own_decisions.pl
3) start BOINC

"2)" assumes you have working installation of Perl on your host and perl.exe in PATH.
(there are some perl implementations that don't need any installation - just single executable + one DLL file).

Ok It's a good thing I know about using the cmd line(DOS experience here), Here's the output and I'm hoping to cut down the size of My cache to 3 days as It's at 7 so far and dropping as I have Boinc set to NNT to keep Boinc 6.6.20(and newer) from asking for more WU's.

CPU_GPU_rebrand_V2 wrote:

Microsoft Windows [Version 5.2.3790]
(C) Copyright 1985-2003 Microsoft Corp.

C:\Documents and Settings\Administrator.PC1>CPU_GPU_rebrand_V2.pl
'CPU_GPU_rebrand_V2.pl' is not recognized as an internal or external command,
operable program or batch file.

C:\Documents and Settings\Administrator.PC1>cd..

C:\Documents and Settings>cd..

C:\>CPU_GPU_rebrand_V2.pl
'CPU_GPU_rebrand_V2.pl' is not recognized as an internal or external command,
operable program or batch file.

C:\>cd documents and settings

C:\Documents and Settings>cd all users.windows

C:\Documents and Settings\All Users.WINDOWS>cd application data

C:\Documents and Settings\All Users.WINDOWS\Application Data>cd boinc

C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC>CPU_GPU_rebrand_V2.pl
Number of CPU tasks before rescheduling:748
Number of GPU tasks before rescheduling:123
Too many tasks allocated to CPU already at C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC\CPU_GPU_rebrand_V2.pl line 54.

C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC>


Ok so I cheated and used the first name as I like It better.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887351 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 887354 - Posted: 22 Apr 2009, 18:06:24 UTC - in response to Message 887351.  
Last modified: 22 Apr 2009, 18:07:20 UTC

Better always start with Perl name_of_the_script.pl ... that way you can also use debug things like -w (smaller warnings about script) or -W (all warnings about script).

This then translates into perl -W name_of_the_script.pl

(oops, space deleted)
ID: 887354 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 887355 - Posted: 22 Apr 2009, 18:14:29 UTC - in response to Message 887354.  
Last modified: 22 Apr 2009, 18:19:11 UTC

Better always start with Perl name_of_the_script.pl ... that way you can also use debug things like -w (smaller warnings about script) or -W (all warnings about script).

This then translates into perl -W name_of_the_script.pl

(oops, space deleted)


Agreed :)
I use perl -w but was not sure all perl interpretators support this switch.

@SuperJoker
Hehe, no cheating here ;)


Too many tasks allocated to CPU already at C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC\CPU_GPU_rebrand_V2.pl line 54.
It's protection to not allow careless users to trash whole 10 days cache just because they don't make backup before trying something new.
So with this script such user can "kill" only 500 SETI MB tasks at once ;)
ID: 887355 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 887358 - Posted: 22 Apr 2009, 18:24:23 UTC - in response to Message 887355.  

Agreed :)
I use perl -w but was not sure all perl interpretators support this switch.

No, not all do it. You'd have to check with your version of Perl what its command-line arguments are. But as far as I read in this thread, SJ was getting ActivePerl, which does do these two commands. StrawberryPerl only does lower case -w
ID: 887358 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887359 - Posted: 22 Apr 2009, 18:27:46 UTC - in response to Message 887355.  

Better always start with Perl name_of_the_script.pl ... that way you can also use debug things like -w (smaller warnings about script) or -W (all warnings about script).

This then translates into perl -W name_of_the_script.pl

(oops, space deleted)


Agreed :)
I use perl -w but was not sure all perl interpretators support this switch.

@SuperJoker
Hehe, no cheating here ;)


Too many tasks allocated to CPU already at C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC\CPU_GPU_rebrand_V2.pl line 54.
It's protection to not allow careless users to trash whole 10 days cache just because they don't make backup before trying something new.
So with this script such user can "kill" only 500 SETI MB tasks at once ;)

Ok I used "perl -w CPU_GPU_rebrand_V2.pl" no change as below(both before and after, It still doesn't like line 54(Car 54 where are You?;))) I'll just have to wait until 4 or 5 days have passed before trying this again.

C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC>CPU_GPU_rebrand_V2.pl
Number of CPU tasks before rescheduling:748
Number of GPU tasks before rescheduling:123
Too many tasks allocated to CPU already at C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC\CPU_GPU_rebrand_V2.pl line 54.

C:\Documents and Settings\All Users.WINDOWS\Application Data\BOINC>perl -w CPU_GPU_rebrand_V2.pl
Number of CPU tasks before rescheduling:748
Number of GPU tasks before rescheduling:123
Too many tasks allocated to CPU already at CPU_GPU_rebrand_V2.pl line 54.

The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887359 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 887362 - Posted: 22 Apr 2009, 18:33:18 UTC - in response to Message 887359.  

Sure you should wait until total SETI MB tasks number on this host will be less than 500.
ID: 887362 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65794
Credit: 55,293,173
RAC: 49
United States
Message 887363 - Posted: 22 Apr 2009, 18:40:27 UTC - in response to Message 887362.  

Sure you should wait until total SETI MB tasks number on this host will be less than 500.

881 and dropping so far, I'll let You know in a few days or so.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 887363 · Report as offensive
Profile Rick B

Send message
Joined: 6 Mar 01
Posts: 299
Credit: 1,532,791
RAC: 0
Canada
Message 887375 - Posted: 22 Apr 2009, 20:27:12 UTC - in response to Message 887363.  

This thread is starting to teach me a few things about computing that I dont know. I guess its making me want to learn more and consider upgrading/trying an optimized app. Im a rookie at that kind of thing (Hell rookies would know more) so I guess Im asking where to read more about it? Ive read the sticky thread on optimized apps and as it states there optimized apps are for advanced users only so I guess Im looking for the Optimizing Apps for Dummies Handbook! Any suggestions or am I an old dog whos just Pipe Dreaming?

Thanks
Rick
**************************
ID: 887375 · Report as offensive
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 9 · Next

Message boards : Number crunching : To Whomever this concerns: Backoffs and error -6


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.