IBM SDDRDAC work together supports HP Serviceguard cluser for Linux.docx
《IBM SDDRDAC work together supports HP Serviceguard cluser for Linux.docx》由会员分享，可在线阅读，更多相关《IBM SDDRDAC work together supports HP Serviceguard cluser for Linux.docx（41页珍藏版）》请在冰点文库上搜索。
IBMSDDRDACworktogethersupportsHPServiceguardcluserforLinux
IBMSDD,RDACworktogethersupportsHPServiceGuard
Preface2
Purpose2
Revision2
OperatingSystem2
Conventions3
ClusterArchitecture3
StorageandHostConfiguration3
OnDS50003
OnDS60004
OnSwitch5
OnClusterNode5
TestingontheServiceGuardCluster16
HowtoMonitortheCluster?
16
TestCaseDemonstration.16
ClusterNodeReboot.16
ManualSwitchtheClusterService19
ClusterProcessFailure20
ClusterLUNAccessLoss22
ControllerOfflineOnline26
Issues27
Preface
Thisprefacecontainsthefollowingtopics:
●Purpose
●Revision
●OperatingSystem
●Conventions
Purpose
Thisfileexplainshowtoinstall,configure,testServiceGuardonRedHat4U532bitovertwonodesx3550Servers.Additionally,DS6800andDS5100areinvolved,applicationofNFSServerisconfiguredonClusterandtestcasesdemoarepresentedontheclient.
Revision
Revision
Date
Author
Contributor
SummaryofChanges
0.1
2008-11-31
ZiZiAi
XinZhang
Createthedocument
OperatingSystem
●ServerSide
2*IBMx3550servers.
●ClusterNode
HPServiceGuardclusterforLinux
HPNFSToolkit
InstallthisOSRedHatEnterpriseLinuxESrelease4（NahantUpdate5）32bitoneachnode.
●ClientSide
RedHatEnterpriseLinuxASrelease4（NahantUpdate4）32bit
●StorageSide
DS6800,DS5100
●Others
CrossoverEthernetcableisusedforHeartbeatconnection.
OnevirtualIPaddress
TwoprivateIPaddresses,oneforeachnode.
Conventions
Belowisusedforgivingsomeinformation.
[Recommend]
Giverecommendation
[Warning]
Showwarning
[Attention]
Needattention
ClusterArchitecture
StorageandHostConfiguration
OnDS5000,
CreateLUNs:
Createhostgroupandhosts:
[Attention]
3LUNswithsize5GBforeachcreatedasfutureLVMtestingdisks,1LUNwith0.5GBcreatedasfutureclusterdetectLUN,andthelastLUNwith1GBcreatedasLOCKLUN.
MaptheLUNstocreatedhostgroup:
OnDS6000
CreateFBvolumes:
CreateVolumeGroup:
Createhostconnections:
OnSwitch
Createtwozoningsasbelow:
OnClusterNode
●ChecktheEthernetconfiguratoiononeachnode:
[root@arcx3550gxvf8~]#ifconfig
eth0Linkencap:
EthernetHWaddr00:
1A:
64:
12:
F8:
01
inetaddr:
9.11.111.83Bcast:
9.11.111.255Mask:
255.255.254.0
eth1Linkencap:
EthernetHWaddr00:
1A:
64:
12:
F8:
03
inetaddr:
192.168.111.83Bcast:
192.168.111.255Mask:
255.255.254.0
[root@archs21mwah0~]#ifconfig
eth0Linkencap:
EthernetHWaddr00:
1A:
64:
4E:
6E:
78
inetaddr:
9.11.113.121Bcast:
9.11.113.255Mask:
255.255.254.0
eth1Linkencap:
EthernetHWaddr00:
1A:
64:
4E:
6E:
7A
inetaddr:
192.168.113.121Bcast:
192.255.255.255Mask:
255.0.0.0
●EnsuretheinternalEthernetconnectivitybetweentwonodesworksgood.
[root@arcx3550gxvg0~]#ping192.168.111.83
PING192.168.111.83（192.168.111.83）56（84）bytesofdata.
64bytesfrom192.168.111.83:
icmp_seq=0ttl=64time=0.148ms
64bytesfrom192.168.111.83:
icmp_seq=1ttl=64time=0.126ms
64bytesfrom192.168.111.83:
icmp_seq=2ttl=64time=0.127ms
---192.168.111.83pingstatistics---
3packetstransmitted,3received,0%packetloss,time2000ms
rttmin/avg/max/mdev=0.126/0.133/0.148/0.016ms,pIPe2
[root@arcx3550gxvf8~]#ping192.168.111.82
PING192.168.111.82（192.168.111.82）56（84）bytesofdata.
64bytesfrom192.168.111.82:
icmp_seq=0ttl=64time=0.152ms
64bytesfrom192.168.111.82:
icmp_seq=1ttl=64time=0.133ms
64bytesfrom192.168.111.82:
icmp_seq=2ttl=64time=0.126ms
---192.168.111.82pingstatistics---
3packetstransmitted,3received,0%packetloss,time1999ms
rttmin/avg/max/mdev=0.126/0.137/0.152/0.011ms,pIPe2
●Createmountdirectories,setappropriatepermissionforthem.
[root@arcx3550gxvf8~]mkdir/har_1
[root@arcx3550gxvf8~]mkdir/har_2
[root@arcx3550gxvf8~]mkdir/har_3
[root@arcx3550gxvf8~]chmod–R755/har_*
[root@arcx3550gxvg0~]mkdir/har_1
[root@arcx3550gxvg0~]mkdir/har_2
[root@arcx3550gxvg0~]mkdir/har_3
[root@arcx3550gxvg0~]chmod–R755/har_*
●Checkthehostsfileoneachnode:
[root@archs21mwah0~]#cat/etc/hosts
#Donotremovethefollowingline,orvariousprograms
#thatrequirenetworkfunctionalitywillfail.
127.0.0.1localhost.localdomainlocalhost
:
:
1localhost6.localdomain6localhost6
9.11.113.121archs21mwah0
9.11.113.114archs21mxhh9
[root@arcx3550gxvf8~]#cat/etc/hosts
#Donotremovethefollowingline,orvariousprograms
#thatrequirenetworkfunctionalitywillfail.
127.0.0.1localhost.localdomainlocalhost
192.168.111.83arcx3550gxvf8
192.168.111.82arcx3550gxvg0
●DownloadIBMRDACandSDDmulti-pathsoftwaretoolfromtheirofficiallinks:
SDD:
RDAC:
Uncompressandinstallthemseparately.
●DownloadHPServiceGuardsoftwaretoolandHPNFStoolkitfromitsofficialwebsite.
%20for%20Linux
Uncompressandinstallthemseparately.
●VerifyingHPServiceGuardinstallation
ServiceGuardusesaspecialfile,cmcluster.conf,todefinethelocationsforconfigurationandlogfileswithintheLinuxfilesystem.Thedifferentdistributionsmayusedifferentlocations.ThefollowingareexamplelocationsforaRedHatdistribution:
##############################cmcluster.conf###########################
#HighlyAvailableClusterfilelocations
#Thisfilemustnotbeedited
#########################################################################
SGROOT=/usr/local/cmclusters#SGrootdirectory
SGCONF=/usr/local/cmcluster/conf#configurationfiles
SGSBIN=/usr/local/cmcluster/bin#binaries
SGLBIN=/usr/local/cmcluster/bin#binaries
SGLIB=/usr/local/cmcluster/lib#libraries
SGRUN=/usr/local/cmcluster/run#locationofcoredumpsfromdaemons
SGAUTOSTART=/usr/local/cmcluster/conf/cmcluster.rc#SGAutostartfile
Makesuretherootuser’spathincludestheServiceguardexecutables.Thiscanbedonebyaddingthefollowingenvironmentvariabledefinitionstotherootuser’sprofileforRedHat:
PATH=$PATH:
/usr/local/cmcluster/bin
./etc/cmcluster.conf
Afterit,issuefollowingcommandtocheckwhetherittakeseffect:
#cd$SGCONF
●Createcmclnodelistfileunderdirectory$SGCONFonclusternodes
Thecmclnodelistfileisnotcreatedbydefaultinnewinstallations.Ifadministratorswanttocreatethisbootstrapfiletheyshouldaddacommentsuchasthefollowing:
###########################################################
#DoNotEditThisFile
#Thisisonlyatemporaryfiletobootstrapanunconfigured
#nodewithServiceguardversionA.11.16
#Onceaclusteriscreated,Serviceguardwillnotconsult
#thisfile.
###########################################################
arcx3550gxvf8root#Cluster1,Node1
arcx3550gxvg0root#Cluster1,Node2
●VerifyingtheSDDinstallationandConfigureSDD
TheSDDinstallationinstallsthedevicedriveranditsutilitiesinthe/opt/IBMsdddirectory.ThetableliststheSDDdriveranditsmajorcomponentfiles.
[root@arcx3550gxvf8~]#cfgvpath
c---------1rootroot251,0Nov1903:
59/dev/IBMsdd
WARNING:
vpathapathsdbhasalreadybeenconfigured.
WARNING:
vpathbpathsdchasalreadybeenconfigured.
WARNING:
vpathcpathsddhasalreadybeenconfigured.
WARNING:
vpathdpathsdehasalreadybeenconfigured.
WARNING:
vpathepathsdfhasalreadybeenconfigured.
WARNING:
vpathfpathsdghasalreadybeenconfigured.
WARNING:
vpathapathsdhhasalreadybeenconfigured.
WARNING:
vpathbpathsdihasalreadybeenconfigured.
WARNING:
vpathcpathsdjhasalreadybeenconfigured.
WARNING:
vpathdpathsdkhasalreadybeenconfigured.
WARNING:
vpathepathsdlhasalreadybeenconfigured.
WARNING:
vpathfpathsdmhasalreadybeenconfigured.
Writingoutnewconfigurationtofile/etc/vpath.conf
[root@arcx3550gxvf8~]#cat/etc/vpath.conf
vpatha600507630efffe280000000000001510
vpathb600507630efffe280000000000001511
vpathc600507630efffe280000000000001512
vpathd600507630efffe280000000000001513
vpathe600507630efffe280000000000001514
vpathf600507630efffe280000000000001515
vpathg600507630efffe280000000000001520
vpathh600507630efffe280000000000001521
[root@arcx3550gxvf8~]#sddrestart
StoppingIBMsdd:
[OK]
StartingIBMsdddriverload:
[OK]
Issuingkillallsddsrvtotriggerrespawn...
StartingIBMsddconfiguration:
[OK]
[root@arcx3550gxvf8~]#fdisk-l
Disk/dev/vpatha:
2147MB,2147483648bytes
Disk/dev/vpathb:
2147MB,2147483648bytes
Disk/dev/vpathc:
2147MB,2147483648bytes
Disk/dev/vpathd:
2147MB,2147483648bytes
Disk/dev/vpathe:
2147MB,2147483648bytes
●VerifyingtheRDACinstallationandConfigureRDAC.
[root@arcx3550gxvg0~]#cat/boot/grub/menu.lst
#grub.confgeneratedbyanaconda
default=0
timeout=5
splashimage=（hd0,0）/grub/splash.xpm.gz
hiddenmenu
titleRedHatLinux（2.6.9-55.ELsmp）withMPPsupport
root（hd0,0）
kernel/vmlinuz-2.6.9-55.ELsmproroot=/dev/VolGroup00/LogVol00rhgbquiet
initrd/mpp-2.6.9-55.ELsmp.img
titleRedHatEnterpriseLinuxAS（2.6.9-55.ELsmp）
root（hd0,0）
kernel/vmlinuz-2.6.9-55.ELsmproroot=/dev/VolGroup00/LogVol00rhgbquiet
initrd/initrd-2.6.9-55.ELsmp.img
titleRedHatEnterpriseLinuxAS-up（2.6.9-55.EL）
root（hd0,0）
kernel/vmlinuz-2.6.9-55.ELroroot=/dev/VolGroup00/LogVol00rhgbquiet
initrd/initrd-2.6.9-55.EL.img
[root@arcx3550gxvg0~]#mppUtil-S
H4C0T0ActiveActiveARCDS5
升级会员 