如何在oracle 集群中更换私有网络的网卡。
今天是2014-03-17，目前学习进度也正在紧锣密鼓的进行着，今天把一小部分实验在做一下记录一下笔记。
我们知道RAC网络有私有网络和公用网络，公用网络提供客户访问请求，私用网络提供oracle 的cache fusion和节点心跳等作用，因为在11G R2可以执行4个private network 进行cache fusion。
但在刚刚开始安装的时候进行了忽略，那么安装之后如何修改呢？且该环节可以模拟oracle RAC怎么添加私用网卡，如果替换损坏网卡等真实环节。
另外对于网络调整无非有、更改私用主机名啊、不改变网段和掩码改变私用地址啊、改变私有网络的mtu啊、改变私有网卡子网或是掩码，这么几种情况。
今天就谈如何改变私网网卡。那么这时候需要使用一个工具叫oracle interface configuration assistant(oifcfg).
在11G r2之前，oracle在ocr中存储网络接口名称和子网信息，那么使用oifcfg即可完成修改：
1、增加和删除私网接口
增加一个私网接口
$ORA_CRS_HOME/bin/oifcfg setif -global <if_name>/<subnet>:cluster_interconnect
删除一个私网接口
$ORA_CRS_HOME/bin/oifcfg delif -global <if_name>/<subnet>
2、查看网卡改变情况
$ORA_CRS_HOME/bin/oifcfg getif
3、重启集群
crsctl stop crs
crsctl start crs
那么对于oracle 11G R2或是更高版本，如何修改私网呢？
在11.2gi中，私有网络配置不在保存在ocr中，而是保存在gpnp profile文件中，该文件是一个xml文件，不推荐使用手动编辑，在进行配置私网之前
首先需要备份该文件，进而进行后续操作。由于我的实验环境正好是11.2.0.4，因此随即记录真实修改过程。
1、备份gpnp profile 文件（每个节点都要备份）。
节点一：
[root@rac-one cdgi]# su - grid [grid@rac-one ~]$ cd /u01/app/11.2.0/grid/gpnp/rac-one/profiles/peer/ [grid@rac-one peer]$ ls -l total 12 -rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old -rw-r--r-- 1 grid oinstall 1830 Feb 13 02:51 profile_orig.xml -rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml [grid@rac-one peer]$ cp profile.xml profile.xml_bak [grid@rac-one peer]$ ls -ltr total 16 -rw-r--r-- 1 grid oinstall 1830 Feb 13 02:51 profile_orig.xml -rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old -rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml -rw-r--r-- 1 grid oinstall 1896 Mar 17 17:47 profile.xml_bak [grid@rac-one peer]$
节点二：
[root@rac-two ~]# su - grid [grid@rac-two ~]$ cd /u01/app/11.2.0/grid/gpnp/rac-two/profiles/peer/ [grid@rac-two peer]$ ls -l total 12 -rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old -rw-r--r-- 1 grid oinstall 1830 Feb 13 02:27 profile_orig.xml -rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml [grid@rac-two peer]$ cp profile.xml profile.xml_bak [grid@rac-two peer]$ ls -ltr total 16 -rw-r--r-- 1 grid oinstall 1830 Feb 13 02:27 profile_orig.xml -rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old -rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml -rw-r--r-- 1 grid oinstall 1896 Mar 17 17:48 profile.xml_bak [grid@rac-two peer]$
2、查看目前节点私网信息
节点二：
[grid@rac-two peer]$ oifcfg getif eth0 192.168.4.0 global public eth3 192.168.2.0 global cluster_interconnect [grid@rac-two peer]$ oifcfg iflist -p -n eth0 192.168.4.0 PRIVATE 255.255.255.0 eth3 192.168.2.0 PRIVATE 255.255.255.0 eth3 169.254.0.0 UNKNOWN 255.255.0.0 eth1 192.168.1.0 PRIVATE 255.255.255.0 eth2 192.168.1.0 PRIVATE 255.255.255.0 [grid@rac-two peer]$
节点一：
[grid@rac-one peer]$ oifcfg getif eth0 192.168.4.0 global public eth3 192.168.2.0 global cluster_interconnect [grid@rac-one peer]$ oifcfg iflist -p -n eth0 192.168.4.0 PRIVATE 255.255.255.0 eth1 192.168.1.0 PRIVATE 255.255.255.0 eth2 192.168.1.0 PRIVATE 255.255.255.0 eth3 192.168.2.0 PRIVATE 255.255.255.0 eth3 169.254.0.0 UNKNOWN 255.255.0.0 [grid@rac-one peer]$
目前可以知道集群内部连接私有网络设备名为eth3，所需要做的是将集群内部私有网络设备名由eth3改变为eth1和eth2.
3、增加新的集群内部连接
[grid@rac-one peer]$ oifcfg setif -global eth1/192.168.1.0:cluster_interconnect [grid@rac-one peer]$ oifcfg setif -global eth2/192.168.1.0:cluster_interconnect [grid@rac-one peer]$
4、验证
节点一：
[grid@rac-one peer]$ oifcfg getif eth0 192.168.4.0 global public eth3 192.168.2.0 global cluster_interconnect eth1 192.168.1.0 global cluster_interconnect eth2 192.168.1.0 global cluster_interconnect [grid@rac-one peer]$
节点二：
[grid@rac-two peer]$ oifcfg getif eth0 192.168.4.0 global public eth3 192.168.2.0 global cluster_interconnect eth1 192.168.1.0 global cluster_interconnect eth2 192.168.1.0 global cluster_interconnect [grid@rac-two peer]$
5、删除192.168.2.0这个集群内部连接：
[grid@rac-two peer]$ oifcfg delif -global eth3/192.168.2.0
[grid@rac-two peer]$
6、在所有节点关闭集群和禁用crs服务且重启
节点一：
root@rac-one cdgi]# ./crsctl stop crs CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.crsd‘ on ‘rac-one‘ CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.GIDG.dg‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.registry.acfs‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.DATADG.dg‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.scan1.vip‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.LISTENER.lsnr‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.rac-one.vip‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.DATADG.dg‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.scan1.vip‘ on ‘rac-one‘ succeeded CRS-2672: Attempting to start ‘ora.scan1.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.registry.acfs‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.rac-one.vip‘ on ‘rac-one‘ succeeded CRS-2672: Attempting to start ‘ora.rac-one.vip‘ on ‘rac-two‘ CRS-2676: Start of ‘ora.scan1.vip‘ on ‘rac-two‘ succeeded CRS-2672: Attempting to start ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-two‘ CRS-2676: Start of ‘ora.rac-one.vip‘ on ‘rac-two‘ succeeded CRS-2676: Start of ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.GIDG.dg‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.asm‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.asm‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.ons‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.ons‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.net1.network‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.net1.network‘ on ‘rac-one‘ succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘rac-one‘ has completed CRS-2677: Stop of ‘ora.crsd‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.mdnsd‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.crf‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.ctssd‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.evmd‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.asm‘ on ‘rac-one‘ CRS-2673: Attempting to stop ‘ora.drivers.acfs‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.mdnsd‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.crf‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.evmd‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.asm‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.ctssd‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.cluster_interconnect.haip‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.cssd‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.cssd‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.gipcd‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.drivers.acfs‘ on ‘rac-one‘ succeeded CRS-2677: Stop of ‘ora.gipcd‘ on ‘rac-one‘ succeeded CRS-2673: Attempting to stop ‘ora.gpnpd‘ on ‘rac-one‘ CRS-2677: Stop of ‘ora.gpnpd‘ on ‘rac-one‘ succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘rac-one‘ has completed CRS-4133: Oracle High Availability Services has been stopped. [root@rac-one cdgi]# crsctl disable crs -bash: crsctl: command not found [root@rac-one cdgi]# ./crsctl disable crs CRS-4621: Oracle High Availability Services autostart is disabled. [root@rac-one cdgi]# ./crsctl enable crs CRS-4622: Oracle High Availability Services autostart is enabled. [root@rac-one cdgi]# ./crsctl start crs CRS-4123: Oracle High Availability Services has been started.
节点二：
[root@rac-two ~]# cd /u01/app/11.2.0/grid/bin/ [root@rac-two bin]# ./crsctl stop crs CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.crsd‘ on ‘rac-two‘ CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN3.lsnr‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.GIDG.dg‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.registry.acfs‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.DATADG.dg‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.cvu‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.oc4j‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.LISTENER.lsnr‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.LISTENER_SCAN2.lsnr‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.rac-two.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.scan1.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.cvu‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.LISTENER.lsnr‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.LISTENER_SCAN3.lsnr‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.scan3.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.LISTENER_SCAN2.lsnr‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.scan2.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.DATADG.dg‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.rac-two.vip‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.rac-one.vip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.registry.acfs‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.scan1.vip‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.scan3.vip‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.scan2.vip‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.rac-one.vip‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.GIDG.dg‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.asm‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.oc4j‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.asm‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.ons‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.ons‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.net1.network‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.net1.network‘ on ‘rac-two‘ succeeded CRS-2792: Shutdown of Cluster Ready Services-managed resources on ‘rac-two‘ has completed CRS-2677: Stop of ‘ora.crsd‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.drivers.acfs‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.crf‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.ctssd‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.evmd‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.asm‘ on ‘rac-two‘ CRS-2673: Attempting to stop ‘ora.mdnsd‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.crf‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.evmd‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.mdnsd‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.asm‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.cluster_interconnect.haip‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.ctssd‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.cluster_interconnect.haip‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.cssd‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.drivers.acfs‘ on ‘rac-two‘ succeeded CRS-2677: Stop of ‘ora.cssd‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.gipcd‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.gipcd‘ on ‘rac-two‘ succeeded CRS-2673: Attempting to stop ‘ora.gpnpd‘ on ‘rac-two‘ CRS-2677: Stop of ‘ora.gpnpd‘ on ‘rac-two‘ succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on ‘rac-two‘ has completed CRS-4133: Oracle High Availability Services has been stopped. [root@rac-two bin]# ./crsctl enable crs CRS-4622: Oracle High Availability Services autostart is enabled. [root@rac-two bin]# ./crsctl start crs CRS-4123: Oracle High Availability Services has been started. [root@rac-two bin]#
7、验证
[grid@rac-two ~]$ crsctl status resource -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATADG.dg
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.GIDG.dg
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.LISTENER.lsnr
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.asm
ONLINE ONLINE rac-one Started
ONLINE ONLINE rac-two Started
ora.gsd
OFFLINE OFFLINE rac-one
OFFLINE OFFLINE rac-two
ora.net1.network
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.ons
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.registry.acfs
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac-two
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac-one
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac-one
ora.cvu
1 ONLINE ONLINE rac-one
ora.oc4j
1 ONLINE ONLINE rac-one
ora.rac-one.vip
1 ONLINE ONLINE rac-one
ora.rac-two.vip
1 ONLINE ONLINE rac-two
ora.rac.db
1 OFFLINE OFFLINE Instance Shutdown
2 OFFLINE OFFLINE Instance Shutdown
ora.scan1.vip
1 ONLINE ONLINE rac-two
ora.scan2.vip
1 ONLINE ONLINE rac-one
ora.scan3.vip
1 ONLINE ONLINE rac-one
[grid@rac-two ~]$
[grid@rac-two ~]$ oifcfg getif
eth0 192.168.4.0 global public
eth1 192.168.1.0 global cluster_interconnect
eth2 192.168.1.0 global cluster_interconnect
[grid@rac-two ~]$ oifcfg iflist -p -n
eth0 192.168.4.0 PRIVATE 255.255.255.0
eth3 192.168.2.0 PRIVATE 255.255.255.0
eth1 192.168.1.0 PRIVATE 255.255.255.0
eth1 169.254.0.0 UNKNOWN 255.255.128.0
eth2 192.168.1.0 PRIVATE 255.255.255.0
eth2 169.254.128.0 UNKNOWN 255.255.128.0
[grid@rac-two ~]$
至此完成修改。
That‘s all! （283684.1）