Setting up HA iSCSI with CTDB
You can use CTDB to create a HA iSCSI Target.
Since the iSCSI Target is not clusterized nor integrated with CTDB in the same sense Samba is, this implementation will only create a HA solution for iSCSI where each public address is assinged its own iscsi target name and the LUNs that are created are only accessible through one specific target (i.e. one public address at a time).
! This feature ONLY works when public addresses are used. It is not supported, nor does it work, if you use the LVS feature to present the entire cluster as one single ip address. !
PrereqsConfigure CTDB as above and set it up to use public ipaddresses.
Verify that the CTDB cluster works.
Install the iSCSI target software on all nodesOn RHEL5 this package is called "scsi-target-utils" and it needs to be installed on all nodes in the cluster. The easiest way to install this package is by using :
onnode all yum install scsi-target-utils -yMake sure that the service is not started automatically when booting, we want CTDB to start/stop this service :
onnode all chkconfig tgtd off
/etc/sysconfig/iscsiCreate this file and add the following three lines to it :
/etc/sysconfig/ctdbAdd the following line to /etc/sysconfig/ctdb :
CTDB_MANAGES_ISCSI=yes just tells CTDB event script for iSCSI that CTDB should start and stop the iSCSI target service as required.
Example: create a LUN that will be hosted on public ip address 10.1.1.1
Before you cna export a LUN you must create it as a file in the shared filesystem. When doing so, make sure you create it as a real file and not a sparse file!
dd if=/dev/zero of=/gpfs/iscsi/10.1.1.1.lun.1 bs=1024 count=102400
to create a 100MByte file to export as an iSCSI LUN.
This example shellscript is used to configure the iscsi target that is hosted onthe public address 10.1.1.1
#!/bin/sh # script to set up the iscsi target and luns hosted by public address # 10.1.1.1 #create a target tgtadm --lld iscsi --op new --mode target --tid 1 -T iqn.2007-11.com.ctdb:iscsi.target.10.1.1.1 #attach a lun tgtadm --lld iscsi --op new --mode logicalunit --tid 1 --lun 1 -b /gpfs/iscsi/10.1.1.1.lun.1 # no security, allow everyone to access this lun tgtadm --lld iscsi --op bind --mode target --tid 1 -I ALL
iqn.2007-11.com.ctdb:iscsi.target.10.1.1.1 in the example above is the iscsi name that is assigned to the target. Dont use this name, pick your own name!
See the documentation for the tgtadm command for more information on how you want to set up your environment.
Perform a ctdb recovery to start the iscsi service