Multipathing with iSCSI and Ubuntu 10.10

After alot of blood sweat and tears, I finally have this working. For some reason, I cant find some of what is below anywhere in any google search combo that I use. Oh well. So I am going off a new Ubuntu 10.10 server install with no extra packages installed and assuming that you have done your apt-get update, apt-get upgrade and properly secured your environment. Also, a properly configured iSCSI environment (such as a seperate iSCSI network, proper stacked iSCSI switches, configured ports and such), if you don’t, please HAMMER DON’T HURT’EM!

My setup that we are working off of is an Ubuntu 10.10 x86_64 Server install with the default packages upgraded using apt. We will be attaching to a Nexsan SATABeast (GO NEXSAN!) with 4 iSCSI ports in the All Ports All Luns port config.

 

media_1305809479204.png

We need to install the multipath tools as well as the iscsi initiator and tools.

 

media_1305810106237.png

I am assuming that you want all of these disks scanned an set up each time you boot. If not, find your answers elsewhere. ;P
We need to modify the following values in the iscsid.conf file, the should be as follows:

node.startup = automatic

Make sure you comment out the line with node.startup = manual.
I also add the line so I dont have to add it into each command.:

node.conn[0].startup = automatic

 

media_1305820033182.png

Your two interfaces will look different from an IP perspective, but the last three lines are needed for each interface.

media_1305819935903.png

You need to comment out two lines of this file… see what it should look like:

#net.ipv4.conf.default.rp_filter=1
#net.ipv4.conf.all.rp_filter=1

media_1305819979410.png

Now we need to gather our MAC addresses so we can create our iSCSI interfaces. In the above, eth0 is my main networking interface and eth1 and eth2 are my ports on the iSCSI network.

media_1305820344390.png

With our MAC addys handy, we create the iSCSI ifaces and associate them to their respective MACs. Pretty straignt forward.

media_1305820393656.png

Commands to discover on each iSCSI port of the Nexsan SATABeast

media_1305820446659.png

lets log into all of the targets and set them to automatic.

media_1305820478684.png

making sure all looks good.

media_1305820602567.png

It was nice of them to not include the multipath.conf file.

media_1305820656638.png

Lets modify that file now.

media_1305820698026.png

Here is what your /etc/multipath.conf file should look like… EXCEPT for your blacklist. Please blacklist the disks that are not multipathed… such as floppies, cdroms and local scsi disks.

media_1305820732782.png

I found a problem in the /etc/init.d/open-iscsi file where it is looking for a file called default that isn’t there.

media_1305820823290.png

Replace the word default in the highlighted lines above with an astrisk.

media_1305820850060.png

Reboot that sucka!

media_1305820883743.png

and BOOM! Now you can format, add to your fstab and have fun. YAY TACO!

 

{ 1 comment… add one }

Leave a Comment