Posts by HAL9000

21) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1894748)
Posted 12 Oct 2017 by Profile HAL9000
Post:
There's Tools -> Retry pending transfers in Manager and "--network_available" in boinccmd.

Thanks, but I don't use GUI part at all for this endeavor and editing XML once would be preferable than to introduce boinccmd.

One way could be to use PowerShell.
Something along the lines of:
[xml]$cli_state = Get-Content D:\Temp\state.xml
$project = $cli_state.client_state.project | where {$_.master_url -eq 'http://setiathome.berkeley.edu/'}
$set1 = $project.rsc_backoff_time | where {$_.name -eq 'CPU'}
$set1.value = "0.0"
$set2 = $project.rsc_backoff_interval | where {$_.name -eq 'CPU'}
$set2.value = "0.0"
$set3 = $project.rsc_backoff_time | where {$_.name -eq 'ATI'}
$set3.value = "0.0"
$set4 = $project.rsc_backoff_interval | where {$_.name -eq 'ATI'}
$set4.value = "0.0"
$cli_state.Save("D:\Temp\state.xml")


That is just for the project backoffs. Tasks could have backoff times too, but I don't have any in my client_state.xml to look at for examples right now.
Probably using some for loops to run through all of the projects and the CPU GPUs would be a more efficient way to go than my specific example, but I'm not that good at PowerShell yet.
22) Message boards : Number crunching : 16 GPUs? For real? (Message 1894711)
Posted 11 Oct 2017 by Profile HAL9000
Post:
I think there is a problem with doing that on his systems. They have been trying to figure out how to run multiple clients from the command line in the "BOINC portable" for Windows hosts thread.

Running multiple instances of BOINC at once and controlling them is rather straight forward.
Currently I have a few hosts that run 100's of BOINC instances for goofygrid. As it only has NCI apps at this time.
Having BOINC report more GPUs than exist in the system is also pretty easy & doesn't require modifying any code. Just tweaking some configs.
23) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1894427)
Posted 9 Oct 2017 by Profile HAL9000
Post:

And if it's offline? The reporting requests will go into extended backoff, and take no time at all.

So,when data directory will be taken to internet host - would that backoff remain? Or re-launching boinc.exe on internet host will trigger immediate connection attempt again?

Project communication deferrals are kept when restarting BOINC. I would guess that file transfers and other backoff times are retained as well.
If you don't want to use boinccmd -project url update
It looks like you could update <rsc_backoff_time> and <rsc_backoff_interval> in the client_state.xml for each project.
File transfer backoff timers would likely be similar. I imagine some kind of script could be run to reset all of the xml values.
24) Message boards : Number crunching : Panic Mode On (107) Server Problems? (Message 1893154)
Posted 4 Oct 2017 by Profile HAL9000
Post:
I think I am going to have to set the max_task_reported tag. I updated all the crunchers after the project came back up and the log said all were successful. I then took down Numbskull for the rebuild but now that I have checked the hosts, I see that the reported tasks for it didn't take.

I also had something strange occur again on the Linux cruncher. I've seen it one time before. If a task is unsuccessful in downloading and the log says either task * was supposed to be 720XXX bytes and it got 0 bytes or the task is missing its header, then BOINC crashes the machine and it reboots. Anybody else see that? Is this a known bug or is it something that has to be reported?

I had to enable it for another project and never bothered to unset it for most of my hosts.
25) Message boards : Number crunching : Windows 10 - Yea or Nay? (Message 1893153)
Posted 4 Oct 2017 by Profile HAL9000
Post:
I hate windows 10!

WhY?

I wasted several days to turn off all WU drivers, as they have been coming without OpenCL support, which crashes Win10 when using SETi@home.
Really, check here: https://www.facebook.com/photo.php?fbid=10156690669169502&set=a.484349584501.266111.719424501&type=3&theater#
:D

This may be a desired configuration to prevent GPU driver updates for those with Enterprise or Pro versions.
https://www.howtogeek.com/263851/how-to-prevent-windows-from-automatically-updating-specific-drivers/
I had to do this on my work machine to prevent the iGPU drivers from being updated to ones that conflicted with the video driver my docking station uses.
26) Message boards : Number crunching : Panic Mode On (107) Server Problems? (Message 1893088)
Posted 4 Oct 2017 by Profile HAL9000
Post:
. . I am surprised this thread is not full of messages since the outrage. All three machines "No Tasks Available". Maybe I am the only one getting this ??

Stephen

??

You're not the only 1 this time, but at least my caches got very near full before that happened. ;-)

Cheers.

Mine went from getting the maintenance message to reporting and filling up.
10/3/2017 6:21:21 PM	SETI@home	Project is temporarily shut down for maintenance
10/3/2017 6:47:09 PM	SETI@home	Sending scheduler request: To report completed tasks.
10/3/2017 6:47:09 PM	SETI@home	Reporting 50 completed tasks
10/3/2017 6:47:09 PM	SETI@home	Requesting new tasks for CPU
10/3/2017 6:47:12 PM	SETI@home	Scheduler request completed: got 50 new tasks

Maybe having max_tasks_reported set to 50 has something to do with my hosts high success rate?
I did have on host report 46 and only receive 38. It did get 8 tasks on the next request 5 min later, but otherwise nothing to odd for me.
27) Message boards : Number crunching : Dual E5-2670 vs. Threadripper 16 core ?? (Message 1892614)
Posted 30 Sep 2017 by Profile HAL9000
Post:
Given the Ryzen 7 1700X has a base clock of 3.4GHz, which is about 13% higher that my host, most of the performance gain looks to be from a higher clock. Given Ryzen is 5 years newer this is the source of my disappointment.

You need to look at Ryzen in comparison to what it replaced- it is a massive improvement over the previous architecture.

No, Ryzen doesn't match the current Intel CPUs for IPC (Instructions Per Clock), but it comes pretty close- which is a monumental improvement. With a year or 2 of data of real world usage, I personally expect Ryzen2 to come very close to matching the Intel CPUs at that time. Improved Ryzen hardware, and improved compiler options.

As it stands, you can buy a high end Intel system, with it's much higher IPC, or you can buy a Ryzen system for half the price (or less) that is only slightly behind the Intel CPU in performance, or actually beats it for multi-threaded applications.
The very latest release of Intel CPUs takes back the performance crown for even mutli-threaded workloads, but you will pay at least 2.5 times the price just for the CPU compared to a Ryzen based CPU. And that doesn't include the much higher pricing for the motherboard suitable to run those CPUs compared to the motherboard required for a Ryzen based system.

I have the feeling OP is looking for a reason to justify upgrading one of their dual E5-2670 systems with a Threadripper. So I don't think comparing the performance of AMDs previous offing is relevant.
For someone with an AMD system Ryzen/Threadripper are obvious choices to upgrade.
Personally my plan is to upgrade my E5-2670 systems with v2 CPUs before I look to replace them.

I don't see the massive cost difference some seem to be making up between the two. The only two components that would be different in building a new system are the MB & CPU for a system.
If I compare two similar MBs with nearly the same features they have the same list and retail price of $160.
GIGABYTE AORUS GA-AX370-Gaming K5 vs GIGABYTE AORUS GA-Z270X-Gaming K5
I wasn't able to find Z370 MBs on retail sites yet, but they have the same list price as their Z270 version.

6c/12t Ryzen 5 1600X 3.6GHz $249 vs 6c/12t Core i7 8700K 3.7GHz $359
4c/4t Ryzen 3 1300X 3.5GHz $129 vs 4c/4t Core i3 8350K 4.0GHz $168
Similar CPUs do have a gap but really isn't that much for the total cost of the system. However it makes for a reasonable cost to performance comparison.

Getting back to the thread topic.
BOINCStats says we have 39 hosts with Threadripper CPUs.
I did find one 8322358 with a Threadripper 1950X.
It was running stock but gives some point of reference.
28) Message boards : Number crunching : Dual E5-2670 vs. Threadripper 16 core ?? (Message 1892274)
Posted 29 Sep 2017 by Profile HAL9000
Post:
I took a look at your E5-2670. It is not all that impressive in regard to your APR or number of tasks per day validated. I don't know which Ryzen7 1800X systems you are comparing it too. Could you link the hosts of your comparison. I'm curious. I also wonder if those systems are stock or have been overclocked to what they are capable of.
Your Host 8130144
Astropulse (anonymous platform, CPU)
Number of tasks completed 269
Max tasks per day 573
Number of tasks today 0
Consecutive valid tasks 540
Average processing rate 58.15 GFLOPS
Average turnaround time 0.59 days

SETI@home v8 (anonymous platform, CPU)
Number of tasks completed 92853
Max tasks per day 32391
Number of tasks today 64
Consecutive valid tasks 32359
Average processing rate 20.85 GFLOPS
Average turnaround time 0.30 days

My Ryzen7 1700X Host 8030022
Astropulse (anonymous platform, CPU)
Number of tasks completed 62
Max tasks per day 156
Number of tasks today 0
Consecutive valid tasks 123
Average processing rate 75.89 GFLOPS
Average turnaround time 1.75 days

SETI@home v8 (anonymous platform, CPU)
Number of tasks completed 52827
Max tasks per day 5165
Number of tasks today 153
Consecutive valid tasks 5133
Average processing rate 79.59 GFLOPS
Average turnaround time 0.45 days

I don't know of anyone running BOINC on Threadripper yet. As expected it is running into some of the same early issues of the Ryzen AM4 platform with CPU and memory overclocks being difficult to stabilize. But progress is being made and much faster compared to Ryzen since Ryzen cleared the path already on a lot of issues. After all TR is barely a month old and Ryzen is over 6 months old.

Comparing APR values is not very useful. It is even less useful for a hosts with a lot of CPU tasks rescheduled to a GPU. As it causes the APR values to be artificially inflated.
At the moment your host is displaying SETI@home v8 (anonymous platform, CPU) Average processing rate 90.64 GFLOPS but it doesn't seem to be completing CPU tasks 4.5 times faster than my E5-2670 host. That is just to point out how useless APR is for comparison.

A somewhat more accurate way to compare hosts is by run time of similar tasks. Arecibo tasks with a normal AR or GBT VLAR tasks are normally good to compare.
It looks like your host is completing CPU tasks about 30% faster that the current #28 host 8295687. Which is also a Ryzen 7 1700X running the AVX app. Based on the run times I would guess they are running closer to stock clocks and you are a bit higher? Host 8295687 is completing similar CPU about 20% faster than my E5-2670 @ 3.0GHz.
Given the Ryzen 7 1700X has a base clock of 3.4GHz, which is about 13% higher that my host, most of the performance gain looks to be from a higher clock. Given Ryzen is 5 years newer this is the source of my disappointment.

The number of concurrent tasks can also have an effect on task run times. I have all 32 CPU threads running tasks since I'm not currently feeding any GPUs on my host. Once I put a pair of 1050 ti or1060 3GB GPUs in the system I expect the CPU run times to be slightly reduced.
29) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1892180)
Posted 28 Sep 2017 by Profile HAL9000
Post:
And now my "portable boinc" experiment has new bottleneck - time to put data from internet host to flash drive.
Estimated as ~16 minutes... Will be inconvenient on regular usage.
But cause I move whole data directory all executables/binary caches are moven back and forth too - quite considerable share of whole data transfer actually.
Here some optimisation should be possible....

I had used something like export.bat and import.bat on mine. Which only copied over project data and BOINC .xml files.
I don't recall exactly what I used but perhaps xcopy /exclude *.exe or something like that
30) Message boards : Number crunching : Dual E5-2670 vs. Threadripper 16 core ?? (Message 1892178)
Posted 28 Sep 2017 by Profile HAL9000
Post:
Comparing some of the Ryzen 7 1800X systems to my E5-2670 I have been a bit disappointed in the performance of of the Ryzen systems.
With a about 1GHz higher clock and DDR4 memory I would expected much greater performance.
Maybe the Threadripper version will be better.
31) Message boards : Number crunching : SETI@home preferences (Fail) (Message 1892174)
Posted 28 Sep 2017 by Profile HAL9000
Post:
When i will handle the separately preferences e.g. home/school etc the appears this message on all tasks:

Unable to handle request
Link has timed out. Please click Back, refresh the page, and try again.

i have switch the browser - but this was not the solution.

Please fix it - thankyou

I checking mine right now and it was ok. Maybe servers were just in a bad mood.
32) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1892170)
Posted 28 Sep 2017 by Profile HAL9000
Post:
Oh, thanks for such detailed confirmation of my observations! Very good to know it's repeatable issue. So I will report it to BOINC devs then.

Just one clarification - did you see 100% CPU usage on host with reduced files set or on absolutely normal BOINC installation?

Reduced file set. I have not used a standard installation of BOINC since about 2010.
33) Message boards : Number crunching : Panic Mode On (107) Server Problems? (Message 1892080)
Posted 27 Sep 2017 by Profile HAL9000
Post:
Another consideration is the maximum number of tasks sent per request can be set on the sever.
Several years ago the max number of AP tasks per request was reduced so it would be harder for users to stockpile them.
It went from being able to get 100 at a time to ~7.
34) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1892079)
Posted 27 Sep 2017 by Profile HAL9000
Post:
I just tested using --no_gui_rpc on one of my normal hosts.
boinc.exe --skip_cpu_benchmarks --no_gui_rpc --detach
start boincmgr.exe /s

As expected BOINC Manager didn't connect to the BOINC client. I would guess they used "gui" in the switch name because of the BOINC Manager GUI?
Using boinccmd was also not successful.
	boinccmd --get_tasks
	can't connect to local host

Additionally boinc.exe was using a full CPU. Which it does not normally do.
I saw nothing in the stdoutdae.txt that looked odd. Other than no mention of the no_gui_rpc switch being used. Other logs like stderrgui.txt, stderrdae.txt, & stdoutgui.txt were empty.
Perhaps some kind of bug? I also tried boinc.exe --no_gui_rpc with the same results.

Similar to you I cut out some of the BOINC files for my hosts. I am sure there are a few more files I could get rid of but here are the ones I keep.
Z:\BOINC versions\Boinc 7.6.x\7.6.33\x64\
boinc.exe
boinccmd.exe
boincsvcctrl.exe
ca-bundle.crt
libcurl.dll
libeay32.dll
LiberationSans-Regular.ttf
msvcp100.dll
msvcr100.dll
sqlite3.dll
ssleay32.dll
zlib1.dll
35) Message boards : News : Arecibo Status (Message 1891932)
Posted 27 Sep 2017 by Profile HAL9000
Post:
Had a read of a few articles. It doesn't sound great for anyone down there right now.
http://www.sciencemag.org/news/2017/09/hurricane-damage-threatens-arecibo-observatory-s-future
http://news.nationalgeographic.com/2017/09/arecibo-radio-telescope-damaged-puerto-rico-hurricane-maria-science/
36) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1891915)
Posted 26 Sep 2017 by Profile HAL9000
Post:
Over commit of internet host resources can be an issue. I don't recall exactly what I used in the past.
If I was setting up offline hosts today I would use a shutdown and start up script. Which would suspend processing before shutting down and resume after starting.

startup.bat
boinc.exe --skip_cpu_benchmarks --detach
timeout 5
boinccmd --set_run_mode auto

shutdown.bat
boinccmd --set_run_mode never
timeout 5
boinccmd --quit

If you wan to handle the suspending resume of BOINC on the internet host then it could be done easily.

BM Start.bat
@ECHO OFF & cls & pushd %~dp0
set desc1=Starting BOINC Client
set pass=password
set doffset1=0
set doffset2=10
set prt=31416
set /a prt=%prt%+%doffset1%
:loopy
set /a nn=%nn%+1
@ECHO %desc1% %nn% %prt%
boinc.exe --gui_rpc_port %prt% --dir %~dp0Data%nn%\ --detach
timeout 10
boinccmd --host localhost:%prt% --passwd %pass% --set_run_mode never
set /a prt=%prt%+1
if %nn% LSS %doffset2% goto loopy

BM Stop.bat
@ECHO OFF & cls & pushd %~dp0
set desc1=Stopping BOINC Client
set pass=password
set doffset1=0
set doffset2=10
set prt=31416
set /a prt=%prt%+%doffset1%
:loopy
set /a nn=%nn%+1
@ECHO %desc1% %nn% %prt%
boinccmd --host localhost:%prt% --passwd %pass% --set_run_mode auto
timeout 5

boinccmd --host localhost:%prt% --passwd %pass% --quit
timeout 1
set /a prt=%prt%+1
if %nn% LSS %doffset2% goto loopy
timeout 20
taskkill /im boinc.exe /t /f
taskkill /im boincmgr.exe /t /f
del job_log*.* /s /q
del *.old /s /q
The timeout value needed will depend on host. I normally start with a high value like 30 seconds and make smaller until I find the lowest that works.

Another option could be to use --start_delay N on starting. A value longer than the time needed to finish upload, reporting, fetch new tasks, and close BOINC could be used.
boinc.exe --gui_rpc_port %prt% --dir %~dp0Data%nn%\ --detach --start_delay 7200
I don't know how large the delay can be. I have only used to 600 seconds for a 10 min delay.

To avoid starting a BOINC client when there is no data directory I would probably use if exist when starting and look for an important file like client_state.xml.
if exist %~dp0Data%nn%\client_state.xml boinc.exe --gui_rpc_port %prt% --dir %~dp0Data%nn%\ --detach
37) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1891832)
Posted 25 Sep 2017 by Profile HAL9000
Post:
BM Start.bat
@ECHO OFF & cls & pushd %~dp0
set desc1=Starting BOINC Client
set doffset1=0
set doffset2=10
set prt=31416
set /a prt=%prt%+%doffset1%
:loopy
set /a nn=%nn%+1
@ECHO %desc1% %nn% %prt%
boinc.exe --gui_rpc_port %prt% --dir %~dp0Data%nn%\ --detach
set /a prt=%prt%+1
if %nn% LSS %doffset2% goto loopy


BM Stop.bat
@ECHO OFF & cls & pushd %~dp0
set desc1=Stopping BOINC Client
set pass=password
set doffset1=0
set doffset2=10
set prt=31416
set /a prt=%prt%+%doffset1%
:loopy
set /a nn=%nn%+1
@ECHO %desc1% %nn% %prt%
boinccmd --host localhost:%prt% --passwd %pass% --quit
timeout 1
set /a prt=%prt%+1
if %nn% LSS %doffset2% goto loopy
timeout 20
taskkill /im boinc.exe /t /f
taskkill /im boincmgr.exe /t /f
del job_log*.* /s /q
del *.old /s /q
38) Message boards : Number crunching : "BOINC portable" for Windows hosts (Message 1891758)
Posted 25 Sep 2017 by Profile HAL9000
Post:
Looks like value in script for gui_rpc_auth.cfg password does not match. The 2nd line set pass=password needs to be the same.
My folder structure is like this:
C:\BOINC\
	boinc.exe
	boinccmd.exe
	boincupdate.bat
C:\BOINC\Data1\
	cc_config.xml
	client_state.xml
	gui_rpc_auth.cfg
C:\BOINC\Data2\
	cc_config.xml
	client_state.xml
	gui_rpc_auth.cfg
C:\BOINC\Data3\
	cc_config.xml
	client_state.xml
	gui_rpc_auth.cfg


Looks like I didn't include my start up script. It launches BOINC for each data directory. Along the lines of
boinc ----gui_rpc_port 31416 --dir Data1  --detach
boinc ----gui_rpc_port 31417 --dir Data2  --detach
boinc ----gui_rpc_port 31418 --dir Data3  --detach

I can copy/paste it once I return home from work in a few hours.

Each data folder has a cc_config.xml with at least these values set.
<allow_multiple_clients>1</allow_multiple_clients>
<allow_remote_gui_rpc>1</allow_remote_gui_rpc>
39) Message boards : Number crunching : RAC falling dramatically (Message 1891140)
Posted 21 Sep 2017 by Profile HAL9000
Post:
RAC for the past few weeks has been relatively flat or on a slight uptick across my systems.
40) Message boards : Number crunching : Multicore smartphones - how to use their full potential (Message 1891000)
Posted 20 Sep 2017 by Profile HAL9000
Post:
Perhaps it resembles my issue. "switchedoff" CPU is on lowest possible frequency and keeps that freq no matter that phone has 2 active background tasks.

Interesting, if SETI would run on normal priority there - will it chenge?

BTW, what app did you use on screenshot?

It could be. Probably different phone manufactures implement power saving differently.
The app is System Info for Android.


Previous 20 · Next 20


 
©2017 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.