Wisdom.sah now persistent.

Message boards : News : Wisdom.sah now persistent.
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48241 - Posted: 3 Dec 2013, 2:22:19 UTC

I'm modified the result template to (I hope) make the FFTW wisdom file a persistent file. This may cause unexpected problems with uploads, downloads or app starts. Let me know if does.

ID: 48241 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 29 May 06
Posts: 1037
Credit: 8,439,427
RAC: 0
United Kingdom
Message 48246 - Posted: 3 Dec 2013, 11:01:15 UTC - in response to Message 48241.  

I'm modified the result template to (I hope) make the FFTW wisdom file a persistent file. This may cause unexpected problems with uploads, downloads or app starts. Let me know if does.

Is that on any particular app version, or all?

Claggy
ID: 48246 · Report as offensive
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48254 - Posted: 4 Dec 2013, 1:25:33 UTC - in response to Message 48246.  

All apps. But apparently this is yet another BOINC feature that doesn't work as advertised, so I may have to undo it.
ID: 48254 · Report as offensive
WTBroughton
Volunteer tester

Send message
Joined: 3 Dec 05
Posts: 2
Credit: 442,920
RAC: 0
United Kingdom
Message 48265 - Posted: 4 Dec 2013, 9:41:42 UTC - in response to Message 48254.  

Getting the following error on all WU's.

<core_client_version>7.2.28</core_client_version>
<![CDATA[
<message>
upload failure: <file_xfer_error>
<file_name>wisdom.sah</file_name>
<error_code>-161</error_code>
</file_xfer_error>

</message>
]]>


ID: 48265 · Report as offensive
jason_gee
Volunteer tester

Send message
Joined: 11 Dec 08
Posts: 198
Credit: 658,573
RAC: 0
Australia
Message 48266 - Posted: 4 Dec 2013, 11:52:39 UTC
Last modified: 4 Dec 2013, 11:54:43 UTC

Interesting side effect there with it bailing on Cudas as well, even though the Cuda MB builds don't use fftw or its wisdom file.
ID: 48266 · Report as offensive
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48270 - Posted: 4 Dec 2013, 16:12:43 UTC - in response to Message 48266.  

Yeah, I'm manually granting credit for these. Eventually (today, I think) these should work through the queue and we should get back to normal ones.

David is looking at the issues I'm having.
ID: 48270 · Report as offensive
SusieQ
Volunteer tester

Send message
Joined: 12 Nov 10
Posts: 1115
Credit: 29,410,246
RAC: 467
United Kingdom
Message 48271 - Posted: 4 Dec 2013, 16:29:08 UTC

Not sure if it's related but I've been getting the following error this afternoon - times are UTC

04/12/2013 13:22:33 | SETI@home Beta Test | Sending scheduler request: To fetch work.
04/12/2013 13:22:33 | SETI@home Beta Test | Reporting 1 completed tasks
04/12/2013 13:22:33 | SETI@home Beta Test | Requesting new tasks for CPU
04/12/2013 13:22:35 | SETI@home Beta Test | [error] Can't parse file info in scheduler reply: unexpected XML tag or syntax
04/12/2013 13:22:35 | SETI@home Beta Test | [error] No close tag in scheduler reply
ID: 48271 · Report as offensive
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48273 - Posted: 4 Dec 2013, 16:33:29 UTC - in response to Message 48271.  

Probably is. I'll check it out.
ID: 48273 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 48275 - Posted: 4 Dec 2013, 19:51:42 UTC - in response to Message 48254.  
Last modified: 4 Dec 2013, 19:52:42 UTC

All apps. But apparently this is yet another BOINC feature that doesn't work as advertised, so I may have to undo it.


Eric, wisdom file is persitent for all GPU builds and for all CPU opt build since long time ago already. Just check how it's implemented in GPU build, it has almost nothing to do with BOINC and runs on known BOINC versions just OK.
ID: 48275 · Report as offensive
Josef W. Segur
Volunteer tester

Send message
Joined: 14 Oct 05
Posts: 1137
Credit: 1,848,733
RAC: 0
United States
Message 48284 - Posted: 5 Dec 2013, 4:56:52 UTC - in response to Message 48275.  

All apps. But apparently this is yet another BOINC feature that doesn't work as advertised, so I may have to undo it.


Eric, wisdom file is persitent for all GPU builds and for all CPU opt build since long time ago already. Just check how it's implemented in GPU build, it has almost nothing to do with BOINC and runs on known BOINC versions just OK.

That uses the project path as specified by BOINC in init_data.xml to facilitate file operations. Although I think that's the best way, I doubt if adding that kind of code and issuing new applications is practical at this point. Perhaps it should go on a todo list for whenever new applications are needed for other reasons.

@Eric - The reason your approach failed is that the generated_locally and upload_when_present tags were removed by changeset 8296968 in July 2011 as part of the changes to allow distributed storage. Current code only recognizes them enough to avoid an unparsed XML error.

What I think *would* work is akin to the workaround for cmdline.txt files for the OpenCL applications. The server could send out an empty file named wisdom_v7.sah or such, and the file_ref would use <open_name>wisdom.sah</open_name> so the application could read and write the file. However, that essentially relies on an undocumented feature of BOINC and it might be sensible to have David bless it.
                                                                  Joe
ID: 48284 · Report as offensive
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48285 - Posted: 5 Dec 2013, 5:00:05 UTC - in response to Message 48275.  
Last modified: 5 Dec 2013, 5:01:46 UTC

I ended up implementing something that's probably similar. I get the project directory from the APP_INIT_DATA structure, and opens "wisdom.sah" there, unless (at some point in the future) it gets fixed in which case it will open "wisdom.sah" through a BOINC soft link.

Didn't see Joe's message until after I posted. Insert something about thinking alike here.
ID: 48285 · Report as offensive
Profile Raistmer
Volunteer tester
Avatar

Send message
Joined: 18 Aug 05
Posts: 2423
Credit: 15,878,738
RAC: 0
Russia
Message 48634 - Posted: 23 Dec 2013, 7:28:16 UTC - in response to Message 48285.  

Eric, our last findings in FFTW wisdom area that planning is redone when library detects switch from x86 to x64 build. That is, to be useful in mixed x64/x86 environment (at least under Windows) files for x86 and x64 builds should have different names (to avoid unneeded replannings).
It will be implemented for opt builds maybe worth to do the same for CPU stock too.
ID: 48634 · Report as offensive
Profile Eric J Korpela
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 15 Mar 05
Posts: 1547
Credit: 26,825,924
RAC: 623
United States
Message 48644 - Posted: 23 Dec 2013, 16:54:41 UTC - in response to Message 48634.  

Thanks. I'll implement that.
ID: 48644 · Report as offensive

Message boards : News : Wisdom.sah now persistent.


 
©2019 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.