AP Optimized r555 vs r1797

Message boards : Number crunching : AP Optimized r555 vs r1797
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1353290 - Posted: 4 Apr 2013, 14:59:41 UTC

I installed r1797 over the hiatus of the last couple of days; on my machine (AMD phenom II x6 1055T) with an empty (0 byte) cmdline.txt file it appears to be only about 5-10% faster than the old r555 I was running. Is this reasonable? Or are there parameters I could be feeding the app that would speed it up significantly?

Thanks for any help!
Jon
ID: 1353290 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1353300 - Posted: 4 Apr 2013, 15:05:47 UTC - in response to Message 1353290.  

I installed r1797 over the hiatus of the last couple of days; on my machine (AMD phenom II x6 1055T) with an empty (0 byte) cmdline.txt file it appears to be only about 5-10% faster than the old r555 I was running. Is this reasonable? Or are there parameters I could be feeding the app that would speed it up significantly?

Thanks for any help!
Jon


OpenCL ReadMe studied already?
We at Lunatics spent huge amount of time to collect best usage tips, params explanations and so on there. So RTFM first ;)

SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1353300 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1353305 - Posted: 4 Apr 2013, 15:10:14 UTC - in response to Message 1353290.  
Last modified: 4 Apr 2013, 15:11:23 UTC

I installed r1797 over the hiatus of the last couple of days; on my machine (AMD phenom II x6 1055T) with an empty (0 byte) cmdline.txt file it appears to be only about 5-10% faster than the old r555 I was running. Is this reasonable? Or are there parameters I could be feeding the app that would speed it up significantly?

Thanks for any help!
Jon


Ah, you speaking about CPU version... No speedup expected, it's maintenance release cause r555 not available for download now.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1353305 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1353394 - Posted: 4 Apr 2013, 19:16:51 UTC - in response to Message 1353305.  

Ah, you speaking about CPU version... No speedup expected, it's maintenance release cause r555 not available for download now.


OK - thanks - I hadn't known that.
I did notice that in Task Manager, R1797 uses a LOT less RAM/instance than R555.

I haven't worked up the nerve to try the GPU version yet - I did look at the README and it was a little intimidating, frankly. Maybe I should wait for the next Installer?

Any idea when that might happen?
ID: 1353394 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1353765 - Posted: 5 Apr 2013, 17:08:03 UTC - in response to Message 1353394.  

....I haven't worked up the nerve to try the GPU version yet - I did look at the README and it was a little intimidating, frankly. Maybe I should wait for the next Installer?

Any idea when that might happen?

I have just set up a test machine for AP crunching. This one.

I found it very easy, after pasting the required files into my SAH project directory. It was just a matter of cutting and pasting the required entries from the supplied .aistub files into my app_info.xml file. My entries in the ap_cmdline line file were staight out of the readme. It worked straight off as an AP only on the GPU, AP + MB on the CPU machine.

I have been taking it slowly, first I ran MB on the CPU only to make sure the machine worked, then added the AP CPU app, then the NVidia GPU app running one task and finally going to two GPU tasks. It was all pretty straight forward with no real hassles. Mostly it's just cut and paste.

The next step is to add the x41zc MB GPU app into the mix. This machine is for experiments and testing, once I get things stable it all gets transferred to my main cruncher.

Take no notice of the errors on the machine above, they were all my fault as I was trying different driver versions, different apps etc. Most were caused by typos in the app_info file as I swapped back and forth :(.

One tip. I found you definitely need a <flops> entry in the AP GPU section of the app_info file. Without it the calculated ETA's were around 150 hours, even after 20 units had been processed (crunching time 35 minutes) and this was stopping BOINC from requesting new units.

T.A.

ID: 1353765 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1354911 - Posted: 9 Apr 2013, 5:54:59 UTC - in response to Message 1353765.  
Last modified: 9 Apr 2013, 6:07:45 UTC

One tip. I found you definitely need a <flops> entry in the AP GPU section of the app_info file. Without it the calculated ETA's were around 150 hours, even after 20 units had been processed (crunching time 35 minutes) and this was stopping BOINC from requesting new units.

After receiving a couple of PM's on this subject, may I point out that for Astropulse the flops entry has be in scientific notation format. i.e XXXXe0x, where x is the number of zeros after the integer eg, 9 for Gigaflops, 8 for 100's of Megaflops etc.

Thus the entry for my GTX470 (1120GF)is...
<flops>1120e09</flops>

For a GTX550Ti (486GF) it would be
<flops>486e09</flops>

for a GTX 580 (1679GF)
<flops>1679e09</flops>

For a low powered card such as a GTS250 (756MF IIRC) (not recommended for AP work.)
the entry would be something like
<flops>756e08</flops>

and so on.

The flops value can be found at the top of the BOINC messages tab where the boot up details are.

This information is available in other threads, but it's buried pretty deep.

T.A.

Edit:
@ Raistmer, may I suggest that this information be added to the r1761 Readme.txt file.
ID: 1354911 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1355011 - Posted: 9 Apr 2013, 13:41:02 UTC - in response to Message 1354911.  


@ Raistmer, may I suggest that this information be added to the r1761 Readme.txt file.

Done. Not for r1761 of course but for current rev.
If someone can propose adequate values for ATi cards or Intel GPU I would add such info in corresponding readmes.

SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1355011 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1355020 - Posted: 9 Apr 2013, 14:09:22 UTC - in response to Message 1355011.  


@ Raistmer, may I suggest that this information be added to the r1761 Readme.txt file.

Done. Not for r1761 of course but for current rev.
If someone can propose adequate values for ATi cards or Intel GPU I would add such info in corresponding readmes.

What exactly have you written? There seems to be scope for confusion here (not least, if people are sending TA advice by PM - where it isn't subject to peer review).

From what I remember of writing advice of how to set Flops entries back in 2009/10, before the advice was made redundant by the self-calibrating APR server, the format was irrelevant - you could use either a long string of digits, or exponential/scientific format, entirely to taste: whatever fits better with your early-years mathematical training.

The important thing, whichever style you choose, is to get the order of magnitude of the value right. Remember that the figure is FLOPS - not kiloflops, megaflops, gigaflops, or any other cultural collective like lakhs or crores of flops.

I'm guessing that the anonymous helpers were simply pointing out an easy way of keeping track of the numbers: there is certainly no way that a particular format could be needed just for Astropulse and not for setiathome_enhanced, since both values are being read and used by the same BOINC client.
ID: 1355020 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1355022 - Posted: 9 Apr 2013, 14:14:12 UTC - in response to Message 1355020.  
Last modified: 9 Apr 2013, 14:16:56 UTC

Richard, just look svn. Committed.
If you have better wording you are welcomed.
The real issue not 1e9 or 1000000, real issue is completely inadequate BOINC time estimation. And we see such estimations again and again, and again, and again... no matter how newest BOINC's algorithm is.

EDIT:
self-calibrating APR server
we see on beta how such calibration misbehaves each new release. And sometimes it misbehaves TOO much to complete any task w/o BOINC aborting task.
SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1355022 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1355024 - Posted: 9 Apr 2013, 14:23:04 UTC - in response to Message 1355022.  

Richard, just look svn. Committed.
If you have better wording you are welcomed.
The real issue not 1e9 or 1000000, real issue is completely inadequate BOINC time estimation. And we see such estimations again and again, and again, and again... no matter how newest BOINC's algorithm is.

Yes, I saw your checkin - where your quote suggests that the real issue is "... has [to] be in scientific notation format ..." - the opposite of what you've just said here. And the noun is 'advice', BTW.
ID: 1355024 · Report as offensive
Profile Raistmer
Volunteer developer
Volunteer tester
Avatar

Send message
Joined: 16 Jun 01
Posts: 6325
Credit: 106,370,077
RAC: 121
Russia
Message 1355168 - Posted: 10 Apr 2013, 3:38:19 UTC - in response to Message 1355024.  

If you experience problems with time to completion estimations from BOINC you could try this advise


IMHO quite clear when this advice should apply :)
Will try to re-formulate text below too though.

SETI apps news
We're not gonna fight them. We're gonna transcend them.
ID: 1355168 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1355229 - Posted: 10 Apr 2013, 6:59:29 UTC - in response to Message 1355020.  
Last modified: 10 Apr 2013, 7:17:46 UTC

From what I remember of writing advice of how to set Flops entries back in 2009/10, before the advice was made redundant by the self-calibrating APR server, the format was irrelevant - you could use either a long string of digits, or exponential/scientific format, entirely to taste: whatever fits better with your early-years mathematical training.

As I said, the information on setting flops values for AP was about, but it was deeply buried. The entry was required because the self calibration wasn't "self calibrating", as I said above, even after 20 completed units the ETA was still around 150 hours for GPU units that were only taking 35 minutes to complete.

I forget where I saw that info about entering the flops value in scientific notation (I looked at a lot of pages that night), it might have been here or over at Lunatics, but I did find that <flops>1120e09</flops> worked but <flops>1120000000000</flops> didn't.

The people who PM'ed me also had experience playing with flops values in app_info files and they couldn't get the long notation entries working either, hence my post above.

T.A.

Edit: BTW the PM's were asking me how I did it after reading this entry in a previous post of mine
One tip. I found you definitely need a <flops> entry in the AP GPU section of the app_info file. Without it the calculated ETA's were around 150 hours, even after 20 units had been processed (crunching time 35 minutes) and this was stopping BOINC from requesting new units.
ID: 1355229 · Report as offensive
Sleepy
Volunteer tester
Avatar

Send message
Joined: 21 May 99
Posts: 219
Credit: 98,947,784
RAC: 28,360
Italy
Message 1355243 - Posted: 10 Apr 2013, 8:01:42 UTC - in response to Message 1355229.  

The people who PM'ed me also had experience playing with flops values in app_info files and they couldn't get the long notation entries working either, hence my post above.


I am one of the people who asked TA about the flops.
I have been working with flops through the years (my app_info file was already scattered with flops for various projects and items), but this time it was behaving strangely.
Anyway, I now have put flops in scientific format and I am waiting for the first AP to be downloaded (no AP splitting at the moment) to see how it works.
The various tests have caused some WU loss in the process, but now everything is running smoothly again and I hope I can fine tune the flops value as soon as I get an AP WU.

In the meantime, many thanks to TA for helping in this process.

Sleepy
ID: 1355243 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1355283 - Posted: 10 Apr 2013, 11:52:05 UTC - in response to Message 1355229.  

I forget where I saw that info about entering the flops value in scientific notation (I looked at a lot of pages that night), it might have been here or over at Lunatics, but I did find that <flops>1120e09</flops> worked but <flops>1120000000000</flops> didn't.

The people who PM'ed me also had experience playing with flops values in app_info files and they couldn't get the long notation entries working either, hence my post above.

T.A.

I'm having real difficulty getting my head round this one. In common with most 'real world' programming projects, BOINC makes extensive use of subroutines and library functions - small pieces of standardised code, which are used and reused again and again.

Getting some digits out of an XML file and interpreting the result as a number is one of those little chores that programmers have to do over and over again - so it's given to a subroutine. FLOPS is just another place where a string (up to 256 characters) is converted to a double-precision number.

BOINC has to handle numbers far larger than your 1,120,000,000,000 (13-digit) flops - I have a workunit with <rsc_fpops_bound> 7,000,000,000,000,000,000,000 (22 digits - not at this project). If the subroutine can't handle 13 digits, then there are much more significant problems to be found and cured down the line.

So, I'd really like to work out what's going wrong here, and cure it at source: putting a small note in an obscure readme file doesn't feel like an appropriate or adequate response.
ID: 1355283 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1355294 - Posted: 10 Apr 2013, 12:59:21 UTC - in response to Message 1355283.  

Sorry Richard, I can't help you there, I'm just a hacker (in it's original sense). I try something, if it works, problem solved, if it doesn't I try something else. All the time without really knowing the why's and wherefore's what I'm doing.

I've learned up bits here and there from picking the brains of of people such as yourself but when it comes to programming, I'm a "black box" technician. :)

T.A.
ID: 1355294 · Report as offensive
Horacio

Send message
Joined: 14 Jan 00
Posts: 536
Credit: 75,967,266
RAC: 0
Argentina
Message 1355347 - Posted: 10 Apr 2013, 16:43:27 UTC - in response to Message 1355283.  

Some memories:

Ive never used the scientific notation for flops and it allways worked on BOINC 6.10 and in BOINC 6.12, but, the longest number used was of 12 digits.

There was a lot of issues with the estimations not working on server side with ATI/AMD GPUS as their results were never counted as elegible for the estimations... and the only workaround was to use the FLOPS. But it works for NVIDIA GPUs.

ID: 1355347 · Report as offensive
Sleepy
Volunteer tester
Avatar

Send message
Joined: 21 May 99
Posts: 219
Credit: 98,947,784
RAC: 28,360
Italy
Message 1355569 - Posted: 11 Apr 2013, 7:11:33 UTC - in response to Message 1355347.  

I have downloaded an AP WU.
All is working fine now.
All was actually about the scientific notation.

Many many thanks to TA for pointing this out.

Happy crunching!

Sleepy


ID: 1355569 · Report as offensive
Profile William
Volunteer tester
Avatar

Send message
Joined: 14 Feb 13
Posts: 2037
Credit: 17,689,662
RAC: 0
Message 1355622 - Posted: 11 Apr 2013, 11:57:10 UTC - in response to Message 1355294.  
Last modified: 11 Apr 2013, 12:11:52 UTC

Sorry Richard, I can't help you there, I'm just a hacker (in it's original sense). I try something, if it works, problem solved, if it doesn't I try something else. All the time without really knowing the why's and wherefore's what I'm doing.

I've learned up bits here and there from picking the brains of of people such as yourself but when it comes to programming, I'm a "black box" technician. :)

T.A.

Ok, if you say it 'works' with scientific notation and 'does not work' when typing out the digits how exactly do you define 'work'?

Edit: I'm with Richard on this one. It shouldn't bloody matter which notation you use'. I've used non-scientific notation and it did its job.
The bloody flops arrive in non-scientific notation from the server, for God's sake. If you provide a setting in app_info.xml you just replace the server generated figure.
[And as Joe has pointed out on occasion, runtime estimate are not purely governed by the app_info.xml <flops> setting but by the server generated APR as well. I forgot the exact formula.]
If there are cases where that assumption turn out to be untrue it needs to be dissected very carefully.
NB scientific notation is 'easier' to use because it's so easy to miscount the number of '0' you need... For that reasdon scientific notation might be preferable but they should BOTH work.
A person who won't read has no advantage over one who can't read. (Mark Twain)
ID: 1355622 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1355693 - Posted: 11 Apr 2013, 14:44:56 UTC - in response to Message 1355622.  

Ok, if you say it 'works' with scientific notation and 'does not work' when typing out the digits how exactly do you define 'work'?

In my case, once the flops value was entered in the format XXXXe0x it brought the ETA down from ~150 Hrs to 38 minutes with nothing else being touched. BOINC immediately downloaded more AP units for the GPU instead of waiting till the running unit completed before requesting more units and only being given one.

Fellas please. Give me some credit for not being a complete idiot !

I can find my way around an app_info file, I can count to 9 without using my fingers and I do make sure of my facts before before posting.

In the past I've some some good wins, which include finding the reason for a quirk in the use of the original Rescheduling program and (not SAH related) a work around for a bug in the Fedora installation program which had all the "gurus" stumped. There are others, but I can't recall them atm.

I agree it should not make any difference what format the flops value is entered in but evidently it does and I'm not the only one to find this.

I've used non-scientific notation and it did its job.

So have I ! But in this case it didn't work. Do you really think I would have posted if it did ?

Because I'm not a programmer, I can't fix it. So I'm passing it on to those who's area of expertise is in that domain.

So stop inferring I'm a f***wit and if something needs to be fixed, fix it.

T.A.

ID: 1355693 · Report as offensive
Terror Australis
Volunteer tester

Send message
Joined: 14 Feb 04
Posts: 1817
Credit: 262,693,308
RAC: 44
Australia
Message 1355716 - Posted: 11 Apr 2013, 15:41:32 UTC
Last modified: 11 Apr 2013, 15:45:13 UTC

After my outburst above, here is some information that might prove useful.

The ETA's for GPU units on my rig were currently sitting at 43 minutes.

I stopped the rig and edited the app_info file, entering the flops value in the long format. On restart the GPU ETA's were 50 minutes.

I then removed the flops entry completely and the ETA's blew out to 258 hours. Nearly 100 Hours more than the original estimate.

However, when I fired up the NV_r1761 app for the first time, the ETA's were ~160 hours. I entered the flops value in long format and the ETA's did not change.

I double checked my app_info file and the flops entry was in the correct position and had the correct number of zeros.

I then went looking, both here and on Lunatics because I vaguely remembered reading something that the flops value for AP was calculated differently than it was for MB. It was during this search that I found the reference that said for AP the flops entry had to be in scientific notation.

I then entered the flops value this way and on a restart the ETA's were within five minutes of the actual crunching time.

Since then the rig has completed around 400 GPU units. So any server side calculations would now have had a chance to stabilise and under these conditions the long format entry works.

Maybe this problem only occurs on new installs of the app ?

@ Sleepy. Since you would have only completed a few units. Could you please repeat the experiment I did and report what you find ?

Edited for clarity

T.A.
ID: 1355716 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : AP Optimized r555 vs r1797


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.