Lunatics Experience

Message boards : Number crunching : Lunatics Experience
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1640772 - Posted: 12 Feb 2015, 17:12:17 UTC

I thought I might increase my RAC if switched to Lunatics optimized apps. This did not go well and I am back to stock apps.

First when I downloaded lunatics_win64_v0.43a_setup.exe Symantec scanned the download and immediately deleted it. It was removed for having a bad reputation. That is lots of Symantec users had reported issues with the file.
The developers may want to submit the app to Symantec for whitelisting at

https://submit.symantec.com/whitelist/

Second. Figuring this is problem with small not widely used app, I ignored the warnings and restored the download and ran it. Installation went smoothly. Only changed one suggested setting use Cuda50 rather than Cuda32, as the stock apps had been using cuda50. Brought up Bonic and noticed that all waiting tasks now had run times of hours not minutes. Noticed in task manager the GPU apps had the notation for 32 bit apps. Watched things run for a short while and it appeared the predicted runs times were real. Instead of GPU tasks running in 7 minutes they were 4 hours.

This was just too much that was not right. Time to uninstall and regroup.

Attempted to run the Lunatics uninstaller and of course Symantec promptly deleted the file. So I reset the Seti Project in Bonic and immediately shutdown before it could reload. Then uninstalled Bonic, cleaned out all the files to get rid of Lunatics files. Then reinstalled Bonic. It recognized the old machine profile immediately and started downloading the old tasks.
ID: 1640772 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34255
Credit: 79,922,639
RAC: 80
Germany
Message 1640784 - Posted: 12 Feb 2015, 17:34:08 UTC
Last modified: 12 Feb 2015, 17:34:45 UTC

You would at least benefit from the 64 bit CPU apps on your Systems running the Lunatics apps.
GPU apps are nearly the same so its hard to believe you are getting that much slow down in run times.
But i`m no cuda expert.


With each crime and every kindness we birth our future.
ID: 1640784 · Report as offensive
rob smith Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer moderator
Volunteer tester

Send message
Joined: 7 Mar 03
Posts: 22188
Credit: 416,307,556
RAC: 380
United Kingdom
Message 1640795 - Posted: 12 Feb 2015, 17:42:20 UTC

Firstly, welcome to the boards.

A question - which download source did you use?
There are three genuine sources for the Lunatics applications, first is KWSN/Lunatics, second is Crunchers Anonymous, and third, Mikes World.
(I see Mike has chipped in while I've been typing)

Performance? like Mike I'm very surprised at the run times you are quoting - I've been running their offerings over a number of years, and have found their current offering to be slightly faster than the stock option.
Name looking like a 32bit - yes, so do mine (on the GPUs), but I'm not having any performance issues.

I'm just thinking, maybe the rejection by Symantic upset your GPUs into thinking they should run at some reduced clock speed?
Bob Smith
Member of Seti PIPPS (Pluto is a Planet Protest Society)
Somewhere in the (un)known Universe?
ID: 1640795 · Report as offensive
Profile petri33
Volunteer tester

Send message
Joined: 6 Jun 02
Posts: 1668
Credit: 623,086,772
RAC: 156
Finland
Message 1640850 - Posted: 12 Feb 2015, 19:02:46 UTC - in response to Message 1640772.  

The Symantec antivirus may be scanning your boinc and seti directories and the executable in memory and its file writes/reads etc.
To overcome Heisenbergs:
"You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones
ID: 1640850 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1640999 - Posted: 12 Feb 2015, 23:57:07 UTC - in response to Message 1640772.  
Last modified: 13 Feb 2015, 0:43:46 UTC

Brought up Bonic and noticed that all waiting tasks now had run times of hours not minutes. Noticed in task manager the GPU apps had the notation for 32 bit apps. Watched things run for a short while and it appeared the predicted runs times were real. Instead of GPU tasks running in 7 minutes they were 4 hours.

This was just too much that was not right. Time to uninstall and regroup.

Attempted to run the Lunatics uninstaller and of course Symantec promptly deleted the file. So I reset the Seti Project in Bonic and immediately shutdown before it could reload. Then uninstalled Bonic, cleaned out all the files to get rid of Lunatics files. Then reinstalled Bonic. It recognized the old machine profile immediately and started downloading the old tasks.

The times are estimates, once you're completed 11 validation of the anonymous platform planclasses (that aren't outliers, ie full length tasks that don't exit early), then the estimates should be right,

The wild difference in times is because of a difference in how the project/Boinc supplies the app's <flops> values between Stock and Anonymous platform.

The GPU apps are 32bit apps, having apps that address 64bit address space slows them down, so the GPU apps are 32bit with a 64Bit Boinc compatible app_info,
Some of the CPU apps are 64Bit, they do get a speedup, again they have a 64bit Boinc compatible app_info.

Claggy
ID: 1640999 · Report as offensive
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1641009 - Posted: 13 Feb 2015, 0:34:26 UTC - in response to Message 1640850.  

It was scanning the download. It was clearly referencing the downloaded executable.
ID: 1641009 · Report as offensive
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1641018 - Posted: 13 Feb 2015, 0:45:48 UTC - in response to Message 1640795.  

A question - which download source did you use?
There are three genuine sources for the Lunatics applications, first is KWSN/Lunatics, second is Crunchers Anonymous, and third, Mikes World.
(I see Mike has chipped in while I've been typing)

I'm just thinking, maybe the rejection by Symantic upset your GPUs into thinking they should run at some reduced clock speed?


I downloaded from both Crunchers Anonymous and from Mikes World. Followed the links posted in pinned thread for Lunatics. Same result for both. Also did the download on two different machines, same results. Found a download from sometime ago, never acted to install. Scanned it, same result.

Can see no logical reason that the GPU's (MSI GTX 750 ti x 2) would even know about what my End Point protection is doing. Symantec took it's time with the "scan". It was clearly preparing an hash and sending to Symantec's database for information. Symantec has the file flagged as bad because it has been reported by users to be dangerous. This is the modern world of reputation based protection. One more attempt to keep up with the bad guys. I would sure the authors can submit to Symantec and they will tell them what is going on. McAfee (Intel Security) runs an identical service so they should be contacted also.
ID: 1641018 · Report as offensive
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1641020 - Posted: 13 Feb 2015, 0:49:03 UTC - in response to Message 1640999.  


The times are estimates, once you're completed 11 validation of the anonymous platform planclasses (that aren't outliers, ie full length tasks that don't exit early), then the estimates should be right,

The wild difference in times is because of a difference in how the project/Boinc supplies the app's <flops> values between Stock and Anonymous platform.

The GPU apps are 32bit apps, having apps that address 64bit address space slows them down, so the GPU apps are 32bit with a 64Bit Boinc compatible app_info,
Some of the CPU apps are 64Bit, they do get a speedup, again they have a 64bit Boinc compatible app_info.

Claggy


Ok so this stuff that freaked me out maybe normal. Will download again and give it another try.

Thanks
ID: 1641020 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1641026 - Posted: 13 Feb 2015, 1:06:29 UTC - in response to Message 1641020.  

Herb,

Have you thought about adding lunatics, boinc and seti to the no scan list of your anti-virus?

If it's scanning it as it downloads it, why not just prevent it from scanning it in the first place?

My 2 cents. I run lunatics on all my machines except the MACs.


Zalster
ID: 1641026 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13727
Credit: 208,696,464
RAC: 304
Australia
Message 1641113 - Posted: 13 Feb 2015, 6:30:26 UTC - in response to Message 1640772.  

Only changed one suggested setting use Cuda50 rather than Cuda32, as the stock apps had been using cuda50.

CUDA50 is the one to use other wise you will get very poor crunching times & probably processing errors (depending on your driver version).
I'm running CUDA50 on my GTX 750Tis with no issues.
I also don't run programmes such as Norton as they are well know for bringing even the fastest systems to their knees.
Grant
Darwin NT
ID: 1641113 · Report as offensive
qbit
Volunteer tester
Avatar

Send message
Joined: 19 Sep 04
Posts: 630
Credit: 6,868,528
RAC: 0
Austria
Message 1641343 - Posted: 13 Feb 2015, 17:55:51 UTC

A few days ago I (once again) set up my laptop for crunching and I got an alert from Avast also. It was about the lunatics uninstaller. I ignored it because I already had heard about false positives regarding the lunatics installer. I was just wondering why it is still not whitelisted at Avast.
ID: 1641343 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1641400 - Posted: 13 Feb 2015, 19:45:50 UTC - in response to Message 1641343.  

A few days ago I (once again) set up my laptop for crunching and I got an alert from Avast also. It was about the lunatics uninstaller. I ignored it because I already had heard about false positives regarding the lunatics installer. I was just wondering why it is still not whitelisted at Avast.

I think it was during one of the more recent Lunatics releases it was mentioned, by Richard?, that the installer could be submitted to the various AV makers to be whitelisted. That give gives them extra work to do. I expect it is much easier to just tell users that they may need to adjust their AV settings. Much like it is advised to do with BOINC in general.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1641400 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1641439 - Posted: 13 Feb 2015, 21:28:15 UTC

Something's afoot. I downloaded the file from Crunchers Anonymous and then uploaded and reran it through VirusTotal. Outcome: Detection ratio: 7 / 57.

Ikarus 	                Win32.SuspectCrc 
Jiangmin 	        Backdoor.Win32.Yoddos.an 
McAfee 	                Artemis!060E0553B4E7 
Norman 	                Suspicious_Gen5.AWBHN 
Qihoo-360 	        Win32/Trojan.75f
Symantec 	        WS.Reputation.1 
TrendMicro-HouseCall 	Suspicious_GEN.F47V1208 

ID: 1641439 · Report as offensive
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1641850 - Posted: 14 Feb 2015, 14:53:26 UTC

On the topic of the End Point protection. I spent my last 5 years before retirement running the end point protection for Fortune 500 company. The bad guys are smart. The bad guys are relentless. They are often a few steps ahead of the good guys. What was safe yesterday may not be safe tomorrow. And no site or source can guarantee they will never become a problem.

That said you want to run protection as high as you can. Draw your exceptions as narrow as possible to keep performance acceptable. Notice I did not say maximized. All downloads get scanned, no exceptions. If you make a real time scanning exception, do NOT make the same exception for scheduled scans.

As for the submission process for white listing, it is fairly simple. Go the vendors page. Follow instructions which are normally give your contact info and upload a clean copy of the file. Expect a response in 48 to 72 workday hours.

The post by Ageless is also troubling. All of the big three for large commercial protection are reporting. Both Symantec and McAfee with their reputation based systems. I will be watching my outbound firewall traffic for anything abnormal after I install.
ID: 1641850 · Report as offensive
Herb Smith
Volunteer tester

Send message
Joined: 28 Jan 07
Posts: 76
Credit: 31,615,205
RAC: 0
United States
Message 1641853 - Posted: 14 Feb 2015, 15:03:00 UTC

Based on prior batch of comments and the leap of faith that download package is clean I have reinstalled Lunatics on one my machines ID 7448424. The run time, as predicted, are good and the predicted times become more believable.

It looks like the MB GPU work is slower than with stock while CPU is faster. In looking at the Average Processing Rate for CPU it is 11.40 Gflops for stock and 15.66 for Lunatics. However for GPU stock is 167.63 versus 123.85 for default Lunatics.

Are there some adjustments to the config files that should be making?

Thanks
ID: 1641853 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1641856 - Posted: 14 Feb 2015, 15:21:20 UTC - in response to Message 1641853.  
Last modified: 14 Feb 2015, 15:22:06 UTC

It looks like the MB GPU work is slower than with stock while CPU is faster. In looking at the Average Processing Rate for CPU it is 11.40 Gflops for stock and 15.66 for Lunatics. However for GPU stock is 167.63 versus 123.85 for default Lunatics.

APR varies with the mix of available work, especially on GPUs, doing VLARs on the GPU will cause the APR to fall because pulse finding is inefficient especially on the Cuda apps,
doing VHARs will also cause the APR to fall because autocorrelation is also inefficient, and VHARs are dominated with autocorrelation processing,

So compare runtimes instead, and compare runtimes of Wu's of comparible Angle Ranges.

Claggy
ID: 1641856 · Report as offensive
Profile BilBg
Volunteer tester
Avatar

Send message
Joined: 27 May 07
Posts: 3720
Credit: 9,385,827
RAC: 0
Bulgaria
Message 1641870 - Posted: 14 Feb 2015, 16:16:27 UTC - in response to Message 1641850.  

All of the big three ...

:D You consider those "big three" as good Antiviruses??

The most false of all detections:
McAfee Artemis
Symantec WS.Reputation
TrendMicro Suspicious_GEN

99% of files 'marked' with such "detections" are good, why some people use those "big three" is beyond me.


Both Symantec and McAfee with their reputation based systems ...

I never seen any real malware detected as "bad reputation" (on VirusTotal ), real malware will not show as just 'a guess'
"bad reputation" means just ... nothing


I will be watching my outbound firewall traffic for anything abnormal after I install.

You expect "outbound traffic" from SETI@home applications? :D
 


- ALF - "Find out what you don't do well ..... then don't do it!" :)
 
ID: 1641870 · Report as offensive
Richard Haselgrove Project Donor
Volunteer tester

Send message
Joined: 4 Jul 99
Posts: 14650
Credit: 200,643,578
RAC: 874
United Kingdom
Message 1641898 - Posted: 14 Feb 2015, 17:08:26 UTC

The trouble with virus-checking an installer is that there are two separate classes of executable code that the virus-checker has to take into account.

1) The code which runs directly (just once) to perform the installation task. We use NSIS (Nullsoft Scriptable Install System), because it's free and open source.

2) The application programs it's designed to install - 23 of them, at the last count. They can be extracted manually if desired - which means that any decent virus checker will scan them too.

With these 'generic', 'heuristic', or 'reputation' detections, it's probably the behaviour of the outer wrapper which triggers the report. Consider what an installer does: asks your permission to run as an administrator, and then distributes executable binaries to protected areas like Program Files (if you took the default BOINC installation location). By contrast, a virus does ... exactly the same (except it doesn't ask permission first). And a virus writer could use NSIS to deliver their payload too, for the same reasons that we do. It's very hard to tell us apart from a virus writer.

I did look into the possibility of whitelisting when this question was raised after the release of v0.43 last year. It turned out to require considerably more identity and security checks than opening a bank or PayPal business account, and I found I couldn't possibly qualify in any event (I don't run a personal website with my home address checkable through a WhoIs lookup on the domain name).

So, sorry folks, you'll just have to put up with the minor inconvenience of wrestling with the virus product of your choice. We supply, and I maintain, the Lunatics Installer free of charge as a voluntary hobby. I do my best to verify that the payload packages I include (but which are supplied by several other independent developers) are free from viruses, but we cannot offer any guarantees. Use it, if you wish, at your own risk, and use your own judgement about the honesty and reliability of the source - just as you would before opening any email from a stranger.
ID: 1641898 · Report as offensive
Profile BilBg
Volunteer tester
Avatar

Send message
Joined: 27 May 07
Posts: 3720
Credit: 9,385,827
RAC: 0
Bulgaria
Message 1642787 - Posted: 16 Feb 2015, 8:40:03 UTC - in response to Message 1641898.  
Last modified: 16 Feb 2015, 8:58:37 UTC

...
1) The code which runs directly (just once) to perform the installation task...
...
With these 'generic', 'heuristic', or 'reputation' detections, it's probably the behaviour of the outer wrapper which triggers the report.

It is funny to look into this "behaviour" ;)

A) "They" consider the 32-bit code 'less-bad'
Lunatics_Win32_v0.43a_setup.exe (4 / 57)
https://www.virustotal.com/en/file/a28bae036aa64d9c59c14fc20d3c9a4ee1b6acfd996a8e0932ad98f690b8ad32/analysis/

Lunatics_Win64_v0.43a_setup.exe (7 / 57)
https://www.virustotal.com/en/file/68df9f695e36c1803c92a40f09bf17e0ce5182aaa2ab34de702a3abb10fd2a57/analysis/


B) Some of "them" do not scan the internals (the included .exe .dll files) the same way when in NSIS installer and in .7z (despite almost the same compression method is used)
I extracted Lunatics_Win64_v0.43a_setup.exe (by 7-Zip) and re-compressed the resulting directory by 7-Zip (the .7z file is 17 MB - 'Solid')

Lunatics_Win64_v0.43a_setup.7z (9 / 52)
https://www.virustotal.com/en/file/65a3e4c98b0656ec4cf0475e5e5e8ce6352a88c55a27557fd02b0188b7aaf166/analysis/

All the 6 "Gen:Variant.Fosniw" are caused by BitDefender engine/signatures (which are used by the listed 6 Antiviruses)


Info on compression:

---------------------------
Properties
---------------------------
Size: 0
Packed Size: 25 323 101
Folders: 6
Files: 129
----------------------------
Path: ...\Lunatics_Win64_v0.43a_setup.exe
Type: Nsis
Method: LZMA:23
Solid: -


---------------------------
Properties
---------------------------
Size: 163 244 711
Packed Size: 17 261 062
Folders: 7
Files: 129
----------------------------
Path: ...\Lunatics_Win64_v0.43a_setup.7z
Type: 7z
Method: LZMA BCJ
Solid: +
Blocks: 2


EDIT:

C) Another strange thing - how many different versions of Lunatics_Win64_v0.43a_setup.exe exist?

Link from the post by Ageless:
http://setiathome.berkeley.edu/forum_thread.php?id=76719&postid=1641439#1641439

... and the file I have do not have the same checksums:

SHA256: 1fc2d9144c3e2074a377f0a4e4c8ef9bfc03e4c68571958e9582f95841b17ff2
https://www.virustotal.com/en/file/1fc2d9144c3e2074a377f0a4e4c8ef9bfc03e4c68571958e9582f95841b17ff2/analysis/

SHA256: 68df9f695e36c1803c92a40f09bf17e0ce5182aaa2ab34de702a3abb10fd2a57
https://www.virustotal.com/en/file/68df9f695e36c1803c92a40f09bf17e0ce5182aaa2ab34de702a3abb10fd2a57/analysis/

 
 


- ALF - "Find out what you don't do well ..... then don't do it!" :)
 
ID: 1642787 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1642889 - Posted: 16 Feb 2015, 14:59:18 UTC - in response to Message 1642787.  

LOL, upping the ante.
Using 7-zip, I unpacked all files from the Lunatics_Win64_v0.43a_setup.exe archive.
I then put them all back into a 7-zip archive, and set SFX on (Self-extracting archive). Named this 15.9MB (16,326KB) version also Lunatics_Win64_v0.43a_setup.exe and uploaded that into Virustotal: Detection ratio: 3 / 57.
ID: 1642889 · Report as offensive
1 · 2 · Next

Message boards : Number crunching : Lunatics Experience


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.