Is there a per-task stats API

Message boards : Number crunching : Is there a per-task stats API
Message board moderation

To post messages, you must log in.

AuthorMessage
wujj123456

Send message
Joined: 5 Sep 04
Posts: 40
Credit: 20,877,975
RAC: 219
China
Message 1970481 - Posted: 15 Dec 2018, 16:31:41 UTC
Last modified: 15 Dec 2018, 16:53:33 UTC

I've been looking for this for a while now. It seems that other than WorldCommunityGrid, almost all BOINC projects just provide API for aggregated per-user or per-host data, but not on per-task level. I am aware that I can check my own tasks page to see task progress, but I am looking for an API so I can do some interesting things with the data, like plotting the trend and checking if various configurations I've been trying is paying off. I am looking for something providing similar level of information as https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=api.

The most detailed thing I find is https://setiathome.berkeley.edu/stats/. None of these give me per task view. I know scrapping web pages is frowned upon, but since information is definitely here, maybe there is some way for me to query it properly?
ID: 1970481 · Report as offensive
Profile Tom M
Volunteer tester

Send message
Joined: 28 Nov 02
Posts: 5124
Credit: 276,046,078
RAC: 462
Message 1970504 - Posted: 15 Dec 2018, 18:49:33 UTC - in response to Message 1970481.  

I've been looking for this for a while now. It seems that other than WorldCommunityGrid, almost all BOINC projects just provide API for aggregated per-user or per-host data, but not on per-task level. I am aware that I can check my own tasks page to see task progress, but I am looking for an API so I can do some interesting things with the data, like plotting the trend and checking if various configurations I've been trying is paying off. I am looking for something providing similar level of information as https://www.worldcommunitygrid.org/help/viewTopic.do?shortName=api.

The most detailed thing I find is https://setiathome.berkeley.edu/stats/. None of these give me per task view. I know scrapping web pages is frowned upon, but since information is definitely here, maybe there is some way for me to query it properly?


I believe (trusting memory so I could be confused) that one of the most useful reports out there apparently does use "scrapping" to get the data. So he doesn't run the report on a routine basis. Only after he thinks there is a change in the gpus running at Seti.

https://setiathome.berkeley.edu/forum_thread.php?id=81962

Tom
A proud member of the OFA (Old Farts Association).
ID: 1970504 · Report as offensive
Harri Liljeroos
Avatar

Send message
Joined: 29 May 99
Posts: 4092
Credit: 85,281,665
RAC: 126
Finland
Message 1970559 - Posted: 15 Dec 2018, 23:19:27 UTC

There are tools for gathering per task information when you do the crunching. Google the BoincTasks or SETIspirit. BoincTasks is a boinc manager replacement and SETIspirit is an Addon to tell you more about Seti tasks.
ID: 1970559 · Report as offensive
wujj123456

Send message
Joined: 5 Sep 04
Posts: 40
Credit: 20,877,975
RAC: 219
China
Message 1970601 - Posted: 16 Dec 2018, 5:31:26 UTC - in response to Message 1970559.  

There are tools for gathering per task information when you do the crunching. Google the BoincTasks or SETIspirit. BoincTasks is a boinc manager replacement and SETIspirit is an Addon to tell you more about Seti tasks.

Thanks for the info! SETISpirit is interesting. Reading the FAQ indicates that it analyzes boinc client logs to track WUs. That's certainly something I didn't think of, which is actually quite easy to implement by polling logs locally. However, this also means it can only get local data, which excludes the final points granted to the WU.

What I really want to get, is a per app breakdown of points per task, including average, deviation to assess if whatever config I am doing is helping and compare across hosts. I guess if I assume same type of app yields roughly same points, I could go with the log analysis path with enough number of WUs.
ID: 1970601 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1970603 - Posted: 16 Dec 2018, 5:36:17 UTC - in response to Message 1970601.  

What I really want to get, is a per app breakdown of points per task, including average, deviation to assess if whatever config I am doing is helping and compare across hosts.

Credit is not a good indicator of performance, the best indicator of performance is the processing time of WUs of the same Angle Range.
Grant
Darwin NT
ID: 1970603 · Report as offensive
wujj123456

Send message
Joined: 5 Sep 04
Posts: 40
Credit: 20,877,975
RAC: 219
China
Message 1970615 - Posted: 16 Dec 2018, 6:20:39 UTC - in response to Message 1970603.  

What I really want to get, is a per app breakdown of points per task, including average, deviation to assess if whatever config I am doing is helping and compare across hosts.

Credit is not a good indicator of performance, the best indicator of performance is the processing time of WUs of the same Angle Range.

Good point. I usually just use points as an approximate, and I need a large number of WUs to cut down the variance given points granted depend on the other computer of each WU as well. Looks like there is a more direct way to assess performance for SETI.

Regarding angle range, I didn't find any boinccmd that would print out the full task content unless I am missing something. The true_angle_range field is indeed in the WU file itself. It's pretty random though. It seems that I would need a large number of WUs in order to get a few in the same range anyway. ¯\_(ツ)_/¯

Can the angle range be queried on the host other than reading the WU file directly? BOINC is isolated to its own user on my setup (distro default), and I don't want to change that. While I know how to grant permission so that the same boinc user can run the collection scripts, that would be unnecessary if other users can query WU content directly.
ID: 1970615 · Report as offensive

Message boards : Number crunching : Is there a per-task stats API


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.