Running asteroids@home as well as seti@home has caused 100 seti@home projects to be abandoned.,

Message boards : Number crunching : Running asteroids@home as well as seti@home has caused 100 seti@home projects to be abandoned.,
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1822772 - Posted: 8 Oct 2016, 19:12:04 UTC

Hello, everyone.

I started a second project using asteroids@home. The computer I'm running this on has been doing seti@home projects for a couple of months. Under computing settings I have "Switch between applications every 60 minutes set." Since starting asteroids@home, no seti@home tasks have run. All of the asteroids@home tasks show "Running, high priority" under status. There are now 287 tasks in the queue for asteroids. Just today I had 100 seti@home tasks expire.

I realize that the 60 minutes setting does not mean that it will only run a task for 60 minutes. I'm wondering why asteroids@home has not hijacked BOINC and is no longer allowing seti@home to run?
ID: 1822772 · Report as offensive
Profile Ghan-buri-Ghan Mike

Send message
Joined: 27 Dec 15
Posts: 123
Credit: 92,602,985
RAC: 172
United States
Message 1822863 - Posted: 9 Oct 2016, 0:12:31 UTC - in response to Message 1822772.  

Did you allocate the resource use between the two? I run four projects on a 30/30/20/20 basis. If you had a large backlog of SETI tasks and did not allocate resources when you added asteroids, I think it defaulted to 50-50 allocation. The system is now trying to "even out" computational time, hence asteroids sucking down your available time.

Anyone out there with a different read?
ID: 1822863 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1822899 - Posted: 9 Oct 2016, 4:15:50 UTC - in response to Message 1822863.  

Under Research Share it shows:

seti@home 100(50%)
asteroids@home 100(50%)

Should I change the resource share on each to 50? I assumed that since each showed 50% I would be ok. But BOINC is refusing to let seti run at all and they're just all going past the due date and being abandoned.
ID: 1822899 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1822905 - Posted: 9 Oct 2016, 5:08:30 UTC - in response to Message 1822899.  

Unfortunately the Replica database is offline at the moment, and that's what we need to be able to see what's been happening.
However from the information that is available there your system abandoned the WUs well before they were due. For some reason it appears it dumped all of the work in your cache on the 4th of October.

Whatever happened it has nothing to do with resource share, or deadline dates.
No issues with the date on the computer on that date?
Grant
Darwin NT
ID: 1822905 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22203
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1822920 - Posted: 9 Oct 2016, 7:33:20 UTC

Asteroids at home tends to run very short deadlines, so when running in parallel with SETI does tend to run at high priority. A couple of years ago I tried running both projects on the same computer, and found that one way to prevent Asteroids dominating the computer was to significantly reduce its priority to about 10% that of SETI. At that time doing this reduced the number of Asteroids tasks being delivered to me to below that needed for the cache, instead of being substantially above what could be run before their deadlines.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1822920 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1822971 - Posted: 9 Oct 2016, 14:51:48 UTC
Last modified: 9 Oct 2016, 14:54:24 UTC

BOINC tries to allocate resources to projects as best it can but sometimes I feel it needs a bit of help. One method that can be employed is using an app_config.xml to limit the number of takes a project runs at once.

You could using a simple app_config for asteroids like this. Which would always leave one free thread open on your CPU to run SET@home.
<app_config>
   <project_max_concurrent>3</project_max_concurrent>
</app_config>

The downside to this method is that if your systems had 0 SETI@home tasks it would still only run 3 asteroids tasks.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1822971 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1822977 - Posted: 9 Oct 2016, 15:21:36 UTC - in response to Message 1822971.  

That's quite helpful, Hal. Thank you.
ID: 1822977 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823017 - Posted: 9 Oct 2016, 19:01:28 UTC - in response to Message 1822977.  
Last modified: 9 Oct 2016, 19:13:37 UTC

Found out that the app_config.xml must be place in that project's directory. For asteroids@home on my machine it is:
/var/lib/boinc-client/projects/asteroidsathome.net_boinc

I just restarted the boinc client and we'll see how it goes when the next task completes.

Although I'd like to get some seti@home running on this machine, asteroids@home provides much more credit. I've had a few PCs and a few PIs running seti@home since August 20th. I started asteroids@home on this one machine on October 4th and I've already earned 47,520 credits compared to having my "farm" running on seti@home and receiving 69,550 credits. Now all I need is to find the latest BOINC catalogue to see what I can buy with all of these credits. ;)
ID: 1823017 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22203
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1823019 - Posted: 9 Oct 2016, 19:11:10 UTC
Last modified: 9 Oct 2016, 19:16:11 UTC

No doubt there are bugs, but one thing that a lot of folks don't realise is that BOINC resource shares are based on long term averages, not, as one might expect, "instant" averages. Based on observation the time base for the average is several weeks.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1823019 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823021 - Posted: 9 Oct 2016, 19:15:03 UTC - in response to Message 1823019.  

Quite so. It's too easy to think of the BOINC project only as it applies to us individually. I also found out where the .xml file needs to go, so I think that's going to solve my issue. Not a bug at all, just having to place it properly.
ID: 1823021 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34748
Credit: 261,360,520
RAC: 489
Australia
Message 1823024 - Posted: 9 Oct 2016, 19:18:34 UTC - in response to Message 1822899.  

Under Research Share it shows:

seti@home 100(50%)
asteroids@home 100(50%)

Should I change the resource share on each to 50? I assumed that since each showed 50% I would be ok. But BOINC is refusing to let seti run at all and they're just all going past the due date and being abandoned.

Seeing as you're treating both projects equally you should find that once your asteroids@home total credit matches your SETI credit the work should get more evenly distributed between both projects, but ATM asteroids@home is in catch up mode.

Cheers.
ID: 1823024 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823036 - Posted: 9 Oct 2016, 19:41:57 UTC - in response to Message 1823024.  

Ok, that makes sense, too. Thank you. I'll watch that and see how it changes when the credits match.
ID: 1823036 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1823204 - Posted: 10 Oct 2016, 6:22:48 UTC - in response to Message 1822772.  

Just today I had 100 seti@home tasks expire.

Anyone got any theories as to why his system dumped 100 tasks on the 4th of Oct?
Grant
Darwin NT
ID: 1823204 · Report as offensive
Profile BilBg
Volunteer tester
Avatar

Send message
Joined: 27 May 07
Posts: 3720
Credit: 9,385,827
RAC: 0
Bulgaria
Message 1823224 - Posted: 10 Oct 2016, 7:43:33 UTC - in response to Message 1823204.  

Just today I had 100 seti@home tasks expire.

Anyone got any theories as to why his system dumped 100 tasks on the 4th of Oct?

- if he "Remove SETI@home project" then "Add" it again?
- if new hostid is created?
- if the same BOINC Data directory is Copied to another computer and both used at the same time?

(I think in all those cases the tasks will show as "Abandoned" (not "expired") but I don't know if anything of this happened)
 


- ALF - "Find out what you don't do well ..... then don't do it!" :)
 
ID: 1823224 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823543 - Posted: 11 Oct 2016, 14:17:46 UTC - in response to Message 1822905.  

No issues on that date.
ID: 1823543 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823544 - Posted: 11 Oct 2016, 14:22:16 UTC - in response to Message 1822920.  

Asteroids at home tends to run very short deadlines, so when running in parallel with SETI does tend to run at high priority. A couple of years ago I tried running both projects on the same computer, and found that one way to prevent Asteroids dominating the computer was to significantly reduce its priority to about 10% that of SETI. At that time doing this reduced the number of Asteroids tasks being delivered to me to below that needed for the cache, instead of being substantially above what could be run before their deadlines.


Thanks, Bob. I will try this.

Now that asteroids@home has surpassed seti@home (71,690 credit for Seti; 76,320 for Asteroids) and having the xml file limiting asteroids to 3 tasks at one, it still is dominating the task list. There are 282 tasks pending for asteroids (it uses only one computer) and 537 for seti (which uses 6 computers).
ID: 1823544 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823545 - Posted: 11 Oct 2016, 14:28:14 UTC - in response to Message 1823024.  

Under Research Share it shows:

seti@home 100(50%)
asteroids@home 100(50%)

Should I change the resource share on each to 50? I assumed that since each showed 50% I would be ok. But BOINC is refusing to let seti run at all and they're just all going past the due date and being abandoned.

Seeing as you're treating both projects equally you should find that once your asteroids@home total credit matches your SETI credit the work should get more evenly distributed between both projects, but ATM asteroids@home is in catch up mode.

Cheers.


asteroids is now ahead of seti with a credit of 76,320 vs seti at 71,690. Asteroids still dominates my task list.

I just tried what Bob Smith recommended, that is setting the asteroids resource to 10.
ID: 1823545 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823625 - Posted: 12 Oct 2016, 2:46:25 UTC - in response to Message 1823545.  

No luck. Asteroids is set to to have a resource share of 10 with set having 90. Asteroids continues to dominate the tasks.
ID: 1823625 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22203
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1823650 - Posted: 12 Oct 2016, 5:01:58 UTC

The average used by BOINC is a LONG TERM average, so it will take several days for any sort of balance to be established. The first thing it has to do is process all the stupidly short deadline Asteroids tasks so it can start to work on SETI's much longer deadline tasks.
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1823650 · Report as offensive
john Wilson

Send message
Joined: 20 Aug 16
Posts: 25
Credit: 172,426
RAC: 0
Canada
Message 1823700 - Posted: 12 Oct 2016, 11:32:57 UTC - in response to Message 1823650.  

I'll leave it and see how it goes. There are 262 asteroid tasks in the queue so it may take a while then.

Thanks.
ID: 1823700 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : Running asteroids@home as well as seti@home has caused 100 seti@home projects to be abandoned.,


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.