Bruno Back (Feb 01 2011)


log in

Advanced search

Message boards : Technical News : Bruno Back (Feb 01 2011)

1 · 2 · Next
Author Message
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar
Send message
Joined: 1 Mar 99
Posts: 1389
Credit: 74,079
RAC: 0
United States
Message 1073248 - Posted: 2 Feb 2011, 0:13:35 UTC

So bruno is back, and synergy is free to get back to bashing on it with some actual science analysis stuff. We'll still keep a constant rsync of the result uploads happening in the background from bruno to synergy, so synergy can be a "hot backup" for bruno if it comes to that again.

Today during the usual outage we took care of that swap, but I also attempted to get thumper converted (as I mentioned yesterday) to its new role as internal-use mega file server. However, this system has funny disk controllers which renumber the drives upon every boot, making installing an OS quite difficult, being as there are 48 drives in the system and it's hard to tell which ones are the boot drives.

By the way, the lab-wide outage tomorrow (which I also mentioned yesterday) will indeed affect all traffic including uploads/downloads, so expect an hour or two of silence from us in the morning.

- Matt

____________
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude

ClaggyProject donor
Volunteer tester
Send message
Joined: 5 Jul 99
Posts: 4141
Credit: 33,604,363
RAC: 27,640
United Kingdom
Message 1073256 - Posted: 2 Feb 2011, 0:26:55 UTC - in response to Message 1073248.

Thanks for the update Matt,

Claggy

Profile Black Squirrel Prime
Send message
Joined: 29 Jul 07
Posts: 8
Credit: 11,418,579
RAC: 7,623
United States
Message 1073280 - Posted: 2 Feb 2011, 2:14:16 UTC - in response to Message 1073248.

thanks matt!

Profile kaseychief
Avatar
Send message
Joined: 3 Dec 07
Posts: 1643
Credit: 416,781
RAC: 0
United States
Message 1073281 - Posted: 2 Feb 2011, 2:19:45 UTC

Thanks Matt, and everyone else that helped.
____________

Profile RottenMutt
Avatar
Send message
Joined: 15 Mar 01
Posts: 992
Credit: 207,654,737
RAC: 0
United States
Message 1073312 - Posted: 2 Feb 2011, 4:36:12 UTC - in response to Message 1073248.

...
Today during the usual outage we took care of that swap, but I also attempted to get thumper converted (as I mentioned yesterday) to its new role as internal-use mega file server. However, this system has funny disk controllers which renumber the drives upon every boot, making installing an OS quite difficult, being as there are 48 drives in the system and it's hard to tell which ones are the boot drives.
...
- Matt


don't boot off a raid array. attach a drive to the native controller on the MB.
____________

Profile ML1
Volunteer tester
Send message
Joined: 25 Nov 01
Posts: 8499
Credit: 4,193,243
RAC: 1,727
United Kingdom
Message 1073522 - Posted: 2 Feb 2011, 19:43:01 UTC - in response to Message 1073312.
Last modified: 2 Feb 2011, 19:44:48 UTC

don't boot off a raid array. attach a drive to the native controller on the MB.


Boot off a USB memory stick. By far the easiest and you can easily change it. Just take care that whatever leads don't dislodge it!

You likely already know this... Also, assign all your mounts by LABEL or UUID. Then it doesn't matter what gets moved around onto what array. (It also lets you deliberately move things around without having to worry about the mounts!)

Good luck,
Martin
____________
See new freedom: Mageia4
Linux Voice See & try out your OS Freedom!
The Future is what We make IT (GPLv3)

Profile Jeff Mercer
Send message
Joined: 14 Aug 08
Posts: 90
Credit: 162,139
RAC: 0
United States
Message 1073662 - Posted: 3 Feb 2011, 1:35:47 UTC

Thanks for the update ! Glad to hear that things are working out. Hope that all goes well Friday !!!

Profile Andy Lee Robinson
Avatar
Send message
Joined: 8 Dec 05
Posts: 615
Credit: 42,694,049
RAC: 27,679
Hungary
Message 1073669 - Posted: 3 Feb 2011, 1:54:44 UTC - in response to Message 1073522.
Last modified: 3 Feb 2011, 1:59:22 UTC

Seconded. I boot my 6x1TB raid 10 from a cheap 1GB pendrive.
It works beautifully, but an old machine like Thumper may not support booting
from USB in its BIOS, so this little avenue of joy would be closed off...

Another option is to make a 500Mb boot partition on all drives, and create a
48-way mirror with them.. then all and any of the drives become boot drives, and quick! :-)

DJStarfox
Send message
Joined: 23 May 01
Posts: 1045
Credit: 560,168
RAC: 442
United States
Message 1073818 - Posted: 3 Feb 2011, 15:18:19 UTC - in response to Message 1073669.

Another option is to make a 500Mb boot partition on all drives, and create a 48-way mirror with them.. then all and any of the drives become boot drives, and quick! :-)


I'm not sure they can afford to be out 24GB of space.

Profile Andy Lee Robinson
Avatar
Send message
Joined: 8 Dec 05
Posts: 615
Credit: 42,694,049
RAC: 27,679
Hungary
Message 1073837 - Posted: 3 Feb 2011, 16:26:02 UTC - in response to Message 1073818.

500Mb is a bit generous - 200Mb would be enough for 2 or 3 kernels,
and tiny in comparison.
I'd go for the usb stick or even a custom live cd, and have all the disk space.

Cheopis
Send message
Joined: 17 Sep 00
Posts: 139
Credit: 11,313,300
RAC: 7,942
United States
Message 1073859 - Posted: 3 Feb 2011, 18:39:41 UTC
Last modified: 3 Feb 2011, 18:51:45 UTC

Looking at the stats on Bruno, I'm not 100% sure the machine will support booting from a USB device. I'm looking at this through the eyes of someone who knows mostly personal PC's. My experience with servers is slight. I'm not sure whether BIOS boot configurations on servers would be typically more or less robust than personal computers.

Bruno's old. With a decent RAID array, there are many personal computers these days that would have the same, if not more capacity. It's a dual single-core machine. 2.66G individual cores is technology that predates USB2.0 if I recall correctly. This is why I am unsure if it will take USB as a boot source.

Having said that, a boot CD would almost certainly be doable.

Profile arkaynProject donor
Volunteer tester
Avatar
Send message
Joined: 14 May 99
Posts: 3691
Credit: 48,729,757
RAC: 6,264
United States
Message 1073874 - Posted: 3 Feb 2011, 19:08:58 UTC - in response to Message 1073859.

Looking at the stats on Bruno, I'm not 100% sure the machine will support booting from a USB device. I'm looking at this through the eyes of someone who knows mostly personal PC's. My experience with servers is slight. I'm not sure whether BIOS boot configurations on servers would be typically more or less robust than personal computers.

Bruno's old. With a decent RAID array, there are many personal computers these days that would have the same, if not more capacity. It's a dual single-core machine. 2.66G individual cores is technology that predates USB2.0 if I recall correctly. This is why I am unsure if it will take USB as a boot source.

Having said that, a boot CD would almost certainly be doable.


This is not Bruno though, it is Thumper: Sun Fire X4500 (2 x dual-core 2.6GHz Opteron, 16 GB RAM). Slightly newer.
____________

Profile ML1
Volunteer tester
Send message
Joined: 25 Nov 01
Posts: 8499
Credit: 4,193,243
RAC: 1,727
United Kingdom
Message 1073884 - Posted: 3 Feb 2011, 19:43:42 UTC - in response to Message 1073669.

Seconded. I boot my 6x1TB raid 10 from a cheap 1GB pendrive.
It works beautifully, but an old machine like Thumper may not support booting
from USB in its BIOS, so this little avenue of joy would be closed off...

Another option is to make a 500Mb boot partition on all drives, and create a
48-way mirror with them.. then all and any of the drives become boot drives, and quick! :-)


Ooooo... Now that is a sneaky work-around! Very good apart from the x48 wasted space...

As others have mentioned, you don't need much diskspace for a Linux boot. I usually allocate a mere 64MBytes for a boot partition. Of that, typically only a few MBytes actually gets used.

So why a full 64MBytes?... That's so I can upload/install a small Linux distro in its entirety into the boot partition for whatever emergency if I need something a bit more than just Grub after a remote reboot!


Keep searchin',
Martin


____________
See new freedom: Mageia4
Linux Voice See & try out your OS Freedom!
The Future is what We make IT (GPLv3)

Profile Andy Lee Robinson
Avatar
Send message
Joined: 8 Dec 05
Posts: 615
Credit: 42,694,049
RAC: 27,679
Hungary
Message 1073942 - Posted: 3 Feb 2011, 22:45:57 UTC - in response to Message 1073884.
Last modified: 3 Feb 2011, 22:49:33 UTC

[quote]So why a full 64MBytes?... That's so I can upload/install a small Linux distro in its entirety into the boot partition for whatever emergency if I need something a bit more than just Grub after a remote reboot!


Martin, my speciality is Fedora. yum keeps a configurable number of previous kernels in /boot after a kernel update to avoid burning bridges, so need the extra space.

Having identical partitions on n drives becomes easy to administer when adding replacement drives to the array

I don't have 48 drives to play with, but in theory, make source partition layout on /dev/sda, then copy partition table to all drives:

for d in {a..z} a{a..v}; do
sfdisk -d /dev/sda | sfdisk --force /dev/sd$d
done;

create 48x mirror on small partition 1:
mdadm --create --raid-devices=48 --chunk=64 --level=mirror /dev/sd[a-z]1 /dev/sda[a-v]1

create raid6 on big partition 2:
mdadm --create --raid-devices=48 --chunk=64 --level=raid6 /dev/sd[a-z]2 /dev/sda[a-v]2

replacing drive sdx:
mdadm /dev/md0 --fail /dev/sdx1
mdadm /dev/md1 --fail /dev/sdx2
mdadm /dev/md0 --remove /dev/sdx1
mdadm /dev/md1 --remove /dev/sdx2

[swap in new drive]
sfdisk -d /dev/sda | sfdisk --force /dev/sdx
mdadm /dev/md0 --add /dev/sdx1
mdadm /dev/md1 --add /dev/sdx2
and then
watch -n30 cat /proc/mdstat

or something like this...
works great with a USB2 hub stuffed with cheap pendrives! :-)

Robert Ribbeck
Avatar
Send message
Joined: 7 Jun 02
Posts: 644
Credit: 5,283,174
RAC: 0
United States
Message 1073956 - Posted: 3 Feb 2011, 23:11:14 UTC

Sos they post what they want us to know
Service is WELL ??? it is what it is
It's down again
at least they can't say its equipment any more
or will they
____________

Cheopis
Send message
Joined: 17 Sep 00
Posts: 139
Credit: 11,313,300
RAC: 7,942
United States
Message 1074004 - Posted: 4 Feb 2011, 2:09:58 UTC - in response to Message 1073874.

Looking at the stats on Bruno, I'm not 100% sure the machine will support booting from a USB device. I'm looking at this through the eyes of someone who knows mostly personal PC's. My experience with servers is slight. I'm not sure whether BIOS boot configurations on servers would be typically more or less robust than personal computers.

Bruno's old. With a decent RAID array, there are many personal computers these days that would have the same, if not more capacity. It's a dual single-core machine. 2.66G individual cores is technology that predates USB2.0 if I recall correctly. This is why I am unsure if it will take USB as a boot source.

Having said that, a boot CD would almost certainly be doable.


This is not Bruno though, it is Thumper: Sun Fire X4500 (2 x dual-core 2.6GHz Opteron, 16 GB RAM). Slightly newer.


O.o

I feel silly to some degree at least. Still an older machine, but nowhere near as old. I'd bet it can take a USB source for booting, but it's still a bit in the grey area of age for that particular feature I think. Wouldn't take more than a couple minutes in BIOS to say for sure though.

Profile Link
Avatar
Send message
Joined: 18 Sep 03
Posts: 828
Credit: 1,571,750
RAC: 248
Germany
Message 1074315 - Posted: 5 Feb 2011, 10:07:35 UTC - in response to Message 1073859.

Looking at the stats on Bruno, I'm not 100% sure the machine will support booting from a USB device. (...)
2.66G individual cores is technology that predates USB2.0 if I recall correctly. This is why I am unsure if it will take USB as a boot source.

Can't say much about Bruno's mainboard and how old it is, but my both AthlonXP boards (1x ASRock, 1x ESC -> Low-End 2002 or 2003) have USB 2.0 ports and IIRC can boot from USB.
____________
.

Profile Siran d'Vel'nahr
Volunteer tester
Avatar
Send message
Joined: 23 May 99
Posts: 5690
Credit: 4,791,086
RAC: 2,425
United States
Message 1074742 - Posted: 6 Feb 2011, 15:41:32 UTC - in response to Message 1073956.

Sos they post what they want us to know
Service is WELL ??? it is what it is
It's down again
at least they can't say its equipment any more
or will they

Why do you act like they owe you something? They don't owe any of us anything! WE are volunteers here. No one is twisting your arm to make you stay here. If you're that unhappy, Robert, I suggest going to another project and complain there. See ya in PM, I would imagine. It seems to be your M.O.

Keep on BOINCing...! :)

____________
CAPT Siran d'Vel'nahr XO
USS Vre'kasht NCC-33187

Siran's website: [ ONLINE! ]

Profile Chris SProject donor
Volunteer tester
Avatar
Send message
Joined: 19 Nov 00
Posts: 32100
Credit: 13,779,896
RAC: 25,165
United Kingdom
Message 1074752 - Posted: 6 Feb 2011, 16:05:52 UTC

Hi Siran!

Most of us here know, that the poster you referred to, gets his kicks from making deliberately provocative posts, and then basking in the attention that he gets from it. If no-one replied to him he would probably get bored and stop.

Back on topic, Bruno does seem to be a bit of a liablilty, but as I have said elsewhere, with three new servers in the setup, the next levels down the chain are going to get stressed. The lads will get it sorted out as soon as they can.

Keep on Boincing!

____________
Damsel Rescuer, Uli Devotee, Julie Supporter, ES99 Admirer,
Raccoon Friend, Anniet fan, didn't take pot advice!


John McLeod VII
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 15 Jul 99
Posts: 24694
Credit: 522,659
RAC: 19
United States
Message 1074922 - Posted: 7 Feb 2011, 1:33:12 UTC - in response to Message 1074752.

Hi Siran!

Most of us here know, that the poster you referred to, gets his kicks from making deliberately provocative posts, and then basking in the attention that he gets from it. If no-one replied to him he would probably get bored and stop.

Back on topic, Bruno does seem to be a bit of a liablilty, but as I have said elsewhere, with three new servers in the setup, the next levels down the chain are going to get stressed. The lads will get it sorted out as soon as they can.

Keep on Boincing!

In other words, don't feed the trolls.
____________


BOINC WIKI

1 · 2 · Next

Message boards : Technical News : Bruno Back (Feb 01 2011)

Copyright © 2014 University of California