HOW-TO: make your own optimized Linux Seti@Home app!


log in

Advanced search

Message boards : Number crunching : HOW-TO: make your own optimized Linux Seti@Home app!

1 · 2 · 3 · 4 · Next
Author Message
Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 342979 - Posted: 20 Jun 2006, 5:53:35 UTC
Last modified: 20 Jun 2006, 6:02:08 UTC

Since the forum here does not lend itself to formatted text very well, here's a link to detailed instructions on how to get your very own optimized client for Linux compiled.

Instructions

If you should decide to compile your own client based on these instructions or have questions, feel free to post here.

Any changes and updates will be announced here.
This page includes download links to Seti@Home enhanced 5.15 sources that are known to compile.

I will outline all code changes done in a later post in this thread. Right now I need a break :o)

Regards and good luck,
Simon
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

1mp0£173
Volunteer tester
Send message
Joined: 3 Apr 99
Posts: 8423
Credit: 356,897
RAC: 0
United States
Message 343553 - Posted: 20 Jun 2006, 20:14:41 UTC - in response to Message 342979.



Instructions


This is very cool. We should all pitch in and get you a nice shrubbery.

____________

Gecko
Volunteer tester
Send message
Joined: 17 Nov 99
Posts: 440
Credit: 6,062,469
RAC: 652
United States
Message 343572 - Posted: 20 Jun 2006, 20:43:43 UTC - in response to Message 342979.
Last modified: 20 Jun 2006, 20:48:26 UTC

Since the forum here does not lend itself to formatted text very well, here's a link to detailed instructions on how to get your very own optimized client for Linux compiled.

Instructions

If you should decide to compile your own client based on these instructions or have questions, feel free to post here.

Any changes and updates will be announced here.
This page includes download links to Seti@Home enhanced 5.15 sources that are known to compile.

I will outline all code changes done in a later post in this thread. Right now I need a break :o)

Regards and good luck,
Simon


Great work Simon!
Going to be on vacation starting Friday for a couple of weeks, w/ some time to indulge myself.
I think I'll give it a whack and see how it goes.

BTW, my offer to Beta-test your Windows build still stands if you can use a tester later.
You can e-mail me here: ppcg47455@hotmail.com
Regards.
____________

Profile boog
Avatar
Send message
Joined: 28 Apr 03
Posts: 57
Credit: 1,146,634
RAC: 0
United States
Message 344268 - Posted: 21 Jun 2006, 10:52:07 UTC - in response to Message 342979.

Since the forum here does not lend itself to formatted text very well, here's a link to detailed instructions on how to get your very own optimized client for Linux compiled.

Instructions

If you should decide to compile your own client based on these instructions or have questions, feel free to post here.

Any changes and updates will be announced here.
This page includes download links to Seti@Home enhanced 5.15 sources that are known to compile.

I will outline all code changes done in a later post in this thread. Right now I need a break :o)

Regards and good luck,
Simon


Dude, that is an awesome writeup!

I'm going to try it as soon as I get a chance!

Awesome job!!
____________

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 344275 - Posted: 21 Jun 2006, 11:00:20 UTC - in response to Message 343553.
Last modified: 21 Jun 2006, 11:00:51 UTC



Instructions


This is very cool. We should all pitch in and get you a nice shrubbery.

Then I'll just have to ask for.....another shrubbery! I have a tree to fell, as well...:o)

Thanks for the comments people, I've already changed and updated a few minor things concerning the Intel lib installation.
Right now I'm playing with the Windows version as well as figuring out a few things concerning SSE and MMX. Package and scripts will be updated also.

I'll be filling that URL with more than just a static HTML page, probably either install a portal or a front page that links to Windows/Linux/whatever sub-pages.

Oh yeah, should you have looked at www.zadra.org directly, that ain't me, but my Dad...nice beard, eh.

Regards,
Simon
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile Beach Bum
Volunteer tester
Send message
Joined: 13 Nov 05
Posts: 178
Credit: 611,717
RAC: 0
United States
Message 344303 - Posted: 21 Jun 2006, 11:52:21 UTC

I'll be filling that URL with more than just a static HTML page, probably either install a portal or a front page that links to Windows/Linux/whatever sub-pages.


Can I suggest the Xayara CMS system. If you are looking to have something you can drop additions and other things into with little time involved. Well at least as little as possible once you get used to the system. You can look into it here. It has many modules. You will need access to a database server and have PHP 4.4 (double check this, may be lower) or higher installed on the Web Server. But with the loadable modules, you could have a forum board, news section and other interesting things installed. Could grow into a small community in itself.
____________

Beach Bums Current Stats:


Come Join us at Hawaiian Beach Bums

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 344313 - Posted: 21 Jun 2006, 12:09:20 UTC

Thanks, but no thanks -

I actively develop a portal system that's on Sourceforge already.
http://www.lunabyte.net
http://sourceforge.net/projects/lunabyte

Enough of that now :o)
I've found some things in the build scripts that could be improved, so that's what I'll be doing later on.

There will be a new downloadable package (same name) so the link will still work.

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile Lord_Vader
Avatar
Send message
Joined: 7 May 05
Posts: 217
Credit: 1,188,863
RAC: 1,301
United States
Message 344538 - Posted: 21 Jun 2006, 16:53:34 UTC

Way cool! Thanks!
____________


Fear will keep the local systems in line. Fear of this battle station. - Grand Moff Tarkin

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 345379 - Posted: 22 Jun 2006, 14:17:30 UTC
Last modified: 22 Jun 2006, 14:18:08 UTC

Whoa :o)

284 hits on the Linux How-To - M-O-O-N, that spells "success" ;o)
18 downloads of the tarball so far, so I can only guess there are some people out there trying things for themselves.

Please post links to your test hosts if you manage to get your own client to work!

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Ned Slider
Send message
Joined: 12 Oct 01
Posts: 668
Credit: 4,375,315
RAC: 0
United Kingdom
Message 345895 - Posted: 22 Jun 2006, 23:03:57 UTC

Real nice job on the writeup Simon :)

^^ ha - just you wait till it takes off. Last year, at it's peak, I was getting roughly 80,000 hits from about 10,000 visits per month on my seti pages. I still got 22,000 hits from 2000 visits last month (including 250 downloads of the depreciated seti clients!) despite my site now being totally out of date. Hope you got plenty of bandwidth ;)

If it's OK with you, I'd like to link your writeup from my site :)

Regards,

Ned

____________
*** My Guide to Compiling Optimised BOINC and SETI Clients ***
*** Download Optimised BOINC and SETI Clients for Linux Here ***

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 345926 - Posted: 22 Jun 2006, 23:35:53 UTC
Last modified: 22 Jun 2006, 23:39:20 UTC

Hi Ned,

Thanks! You sure are welcome to do that.

Be advised I'll be filling it with a portal, most probably, but the link to writeups will be right smack dab in the middle.

Today I got fed up with sharing my main work system with several other OSes on VMWare, so I bought a Pentium-D 805 (which is 64-Bit SSE3 capable). The whole system cost 384€ (about 450 USD) with 1 GB Corsair DDR2-667, so that was quite okay. Can only recommend it for the budget cruncher.

So I'll extend the writeup and the scripts for 64-bit and SSE3.

That puter now has 4 operating systems - Windows XP 32/64, Debian Sarge 32/64. Bit of work, but worth it. Now I can do real comparable testing on the same hardware.

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Pepperammi
Send message
Joined: 3 Apr 99
Posts: 200
Credit: 737,775
RAC: 0
United Kingdom
Message 346398 - Posted: 23 Jun 2006, 11:24:36 UTC - in response to Message 345926.
Last modified: 23 Jun 2006, 11:29:31 UTC

@KWSN- Chicken of Angnor

Can't remember if it was the 805 or the 825 but there was an internet article somewhere about some of them ocing to ridiculus speeds with stock cooling or improved(4Ghz+ with water cooling) because of strange multiplier value or something. depends if your into that stuff and want the risk :)

Anyway sorry for off topic.

[EDIT]
Found one the articles. Theres others
http://tomshardware.co.uk/2006/05/10/dual_41_ghz_cores_uk/

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 346437 - Posted: 23 Jun 2006, 12:55:30 UTC

Yup,

I'm aware of that :o) However, I'll be needing a better board for that. This one doesn't allow any VCore adjustments, sadly. It does however take an AGP and a PCIe card at the same time as well as either DDR or DDR2, which makes it pretty okay in my book (board cost around 50 bucks).

Any sort of OC-friendly board was around 100-150 bucks for the board alone, which was over my budget there. It goes to about 3 GHz without VCore adjustment for me, not real far, so I've kept it at default for now.

I'll be getting myself a Conroe when they come out (and an OC-ready platform), and then we're gonna see ;o) No sense in spending too much money now.

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile spacemeat
Avatar
Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 346594 - Posted: 23 Jun 2006, 15:47:56 UTC

Seems I have problems installing the RPM's from Intel and their error log doesn't help a bit. I have ICC/IPP installed successfully on an older machine when I was trying to help harold and crunch3r optimize but it's a BIG step down in speed. I'd much rather build on a 2000+ athlon than a 400MHz P3. Did you use alien, rpm, or rpm2cpio?

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 346599 - Posted: 23 Jun 2006, 15:52:14 UTC
Last modified: 23 Jun 2006, 15:54:03 UTC

I put that in the How-To, actually :o)

I used alien. It's really really nice for RPMs - also, you can uninstall packages again cleanly that way, and with your distro's package manager, too.
Plus, the name is just too fitting to be ignored...

So basically, I had that error because my RPM binary was 4.0, and only 4.1+ supports installation into non-default directories.

In the How-To, under the first requirements section (base build environment), I put an apt-get command that had alien and associated libs in it for exactly that purpose. In a later paragraph on installing the libs, I showed how to use alien to make a Debian package and install it.

Hope that helps :o)

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile spacemeat
Avatar
Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 346611 - Posted: 23 Jun 2006, 16:07:26 UTC

I'm using gentoo with RPM 4.2 so the .deb won't work and I don't have the default directory problem (I'm leaving it default anyway).

I can unpack with both rpm and alien no problem it appears.

Basically the install script doesn't seem to be able to find the files that were just unpacked so it craps out.

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 346615 - Posted: 23 Jun 2006, 16:13:36 UTC

Hm,

haven't had that problem yet (but then, I haven't tried gentoo).

The library packages only come in .rpm.
I didn't use the install script that came with the rpms (in the same dir) but alien and the rpm directly (but then I guess that's what you're doing, just for clarification).

For me, there were (per lib package) two rpms to install. I always installed the *base* package first, not sure whether that matters. Also, I always put it all in /opt/intel, which works well on Debian and Fedora Core (you said you did too).

Really not much of an idea, but - you can put this on Intel's support board (when you click on a download link, they always offer you free support - take 'em up on it!), maybe they have a suggestion. They're pretty quick to answer usually.

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile UBT - PaulT
Volunteer tester
Send message
Joined: 17 Dec 00
Posts: 25
Credit: 173,834
RAC: 0
United Kingdom
Message 346643 - Posted: 23 Jun 2006, 17:19:42 UTC

When I enter "make lib32" I get this error

make build_obj IE=i D=_results/lib32_intel
make[1]: Entering directory `/opt/intel/mkl/8.0.2/examples/fftw2mkl'
mkdir -p _results/lib32_intel
icc -w -D_LINUX -I../../include -c wrappers/fftw_cleanup.c -o _results/lib32_intel/fftw_cleanup.o
make[1]: icc: Command not found
make[1]: *** [fftw_cleanup.o] Error 127
make[1]: Leaving directory `/opt/intel/mkl/8.0.2/examples/fftw2mkl'
make: *** [lib32] Error 2


I've got everything installed that is required. Using Ubuntu 5.1

Any idea what I'm doing wrong?

Thanks in advance for any help

____________

Profile KWSN - Chicken of Angnor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 9 Jul 99
Posts: 1199
Credit: 6,615,780
RAC: 0
Austria
Message 346665 - Posted: 23 Jun 2006, 17:44:57 UTC

Yup,

check out the content of this script -

/opt/intel/cc/9.0/bin/iccvars.sh

From your error message


make[1]: icc: Command not found

it looks like you didn't logout and back in since installing (since iccvars.sh should run in your profile if the installer did its thing right).

Try doing that, and then try this:

root@compilatrix:~# set | grep PATH

One of the resulting lines should now have this at the front:

PATH=/opt/intel/cc/9.0/bin


Hope that helps!

I'll put that you should relogin into the instructions. Totally forgot that since my environment was already setup before. Thanks for noticing :o)

Regards,
Simon.
____________
Donate to SETI@Home via PayPal!

Optimized SETI@Home apps + Information

Profile spacemeat
Avatar
Send message
Joined: 4 Oct 99
Posts: 239
Credit: 8,425,288
RAC: 0
United States
Message 346824 - Posted: 23 Jun 2006, 20:20:56 UTC

Bah, now I remember what I did. Gentoo has a masked ebuild for ICC 9.0.030 (9.0.021 when I did it before). I need to install it that way.

As far as mkl and ipp, I found my old post on the gentoo forums.
what also worked instead of rpm is the following:

# alien -t -v filename.rpm
# tar -xzvf filename.tgz -C /

This may be useful for your howto because the -d flag you list is only good for debian. -t makes tarballs which should be good for everybody.

I may have to manually link the libraries because all that does is unzip the files but at least I know they are there.

1 · 2 · 3 · 4 · Next

Message boards : Number crunching : HOW-TO: make your own optimized Linux Seti@Home app!

Copyright © 2014 University of California