1.[root@linuxrac1 ~]# /u01/app/oraInventory/orainstRoot.sh

2.[root@linuxrac2 ~]# /u01/app/oraInventory/orainstRoot.sh

3.[root@linuxrac1 ~]# /u01/app/11.2.0/grid/root.sh

4.[root@linuxrac2 ~]# /u01/app/11.2.0/grid/root.sh

安装集群软件时，没有按上述步骤在两个节点执行相同的脚本，而是采用了下面错误的顺序：

1. [root@linuxrac1 ~]# /u01/app/oraInventory/orainstRoot.sh

2. [root@linuxrac1 ~]# /u01/app/11.2.0/grid/root.sh

3. [root@linuxrac2 ~]# /u01/app/oraInventory/orainstRoot.sh

4. [root@linuxrac2 ~]# /u01/app/11.2.0/grid/root.sh

导致集群安装失败

1. 先恢复配置：恢复配置Grid Infrastructure 并不会移除已经复制的二进制文件，仅仅是回复到配置crs之前的状态

a) 使用root用户登录，并执行下面的命令(所有节点，但 最后一个节点除外)

#perl /u01/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -force

[root@linuxrac1 ~]#perl /u01/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -force

2014-10-16 00:20:37: Parsing the host name

2014-10-16 00:20:37: Checking for super user privileges

2014-10-16 00:20:37: User has super user privileges

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

PRCR-1035 : Failed to look up CRS resource ora.cluster_vip.type for 1

PRCR-1068 : Failed to query resources

Cannot communicate with crsd

PRCR-1070 : Failed to check if resource ora.gsd is registered

Cannot communicate with crsd

PRCR-1070 : Failed to check if resource ora.ons is registered

Cannot communicate with crsd

PRCR-1070 : Failed to check if resource ora.eons is registered

Cannot communicate with crsd

ADVM/ACFS is not supported on centos-release-5-4.el5.centos.1

ACFS-9201: Not Supported

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'linuxrac1'

CRS-2673: Attempting to stop 'ora.crsd' on 'linuxrac1'

CRS-4548: Unable to connect to CRSD

CRS-2675: Stop of 'ora.crsd' on 'linuxrac1' failed

CRS-2679: Attempting to clean 'ora.crsd' on 'linuxrac1'

CRS-4548: Unable to connect to CRSD

CRS-2678: 'ora.crsd' on 'linuxrac1' has experienced an unrecoverable failure

CRS-0267: Human intervention required to resume its availability.

CRS-2795: Shutdown of Oracle High Availability Services-managed resources on 'linuxrac1' has failed

CRS-4687: Shutdown command has completed with error(s).

CRS-4000: Command Stop failed, or completed with errors.

You must kill crs processes or reboot the system to properly

cleanup the processes started by Oracle clusterware

Successfully deconfigured Oracle clusterware stack on this node

b)        、同样使用root用户在最后一个节点执行下面的命令。该命令将清空ocr配置和voting disk

#perl /u01/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -force

[root@linuxrac2 ~]#perl /u01/app/11.2.0/grid/crs/install/rootcrs.pl -verbose -deconfig -force

2014-10-16 00:25:37: Parsing the host name

2014-10-16 00:25:37: Checking for super user privileges

2014-10-16 00:25:37: User has super user privileges

Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

VIP exists.:linuxrac1

VIP exists.: /linuxrac1-vip/10.10.97.181/255.255.255.0/eth0

GSD exists.

ONS daemon exists. Local port 6100, remote port 6200

eONS daemon exists. Multicast port 18049, multicast IP address 234.241.229.252, listening port 2016

PRKO-2439 : VIP does not exist.

PRKO-2313 : VIP linuxrac2 does not exist.

ADVM/ACFS is not supported on centos-release-5-4.el5.centos.1

ACFS-9201: Not Supported

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.crsd' on 'linuxrac2'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.OCR_VOTE.dg' on 'linuxrac2'

CRS-2677: Stop of 'ora.OCR_VOTE.dg' on 'linuxrac2' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'linuxrac2'

CRS-2677: Stop of 'ora.asm' on 'linuxrac2' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'linuxrac2' has completed

CRS-2677: Stop of 'ora.crsd' on 'linuxrac2' succeeded

CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.ctssd' on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.evmd' on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.asm' on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'linuxrac2'

CRS-2677: Stop of 'ora.cssdmonitor' on 'linuxrac2' succeeded

CRS-2677: Stop of 'ora.evmd' on 'linuxrac2' succeeded

CRS-2677: Stop of 'ora.mdnsd' on 'linuxrac2' succeeded

CRS-2677: Stop of 'ora.asm' on 'linuxrac2' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'linuxrac2' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'linuxrac2'

CRS-2677: Stop of 'ora.cssd' on 'linuxrac2' succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on 'linuxrac2'

CRS-2673: Attempting to stop 'ora.diskmon' on 'linuxrac2'

CRS-2677: Stop of 'ora.gpnpd' on 'linuxrac2' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'linuxrac2'

CRS-2677: Stop of 'ora.gipcd' on 'linuxrac2' succeeded

CRS-2677: Stop of 'ora.diskmon' on 'linuxrac2' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'linuxrac2' has completed

CRS-4133: Oracle High Availability Services has been stopped.

Successfully deconfigured Oracle clusterware stack on this node

c)   如果使用了ASM磁盘，继续下面的操作以使得ASM重新作为候选磁盘(清空所有的ASM磁盘组)

[root@linuxrac1 ~]#dd if=/dev/zero of=/dev/sdb1 bs=1024 count=10000

10000+0 records in

10000+0 records out

10240000 bytes (10M) copied, 0.002998 seconds, 34.2 MB/s

[root@linuxrac2 ~]#dd if=/dev/zero of=/dev/sdb1 bs=1024 count=10000

10000+0 records in

10000+0 records out

10240000 bytes (10M) copied, 0.00289 seconds, 35.4 MB/s

[root@linuxrac1 /]#etc/init.d/oracleasm deletedisk OCR_VOTE /dev/sdb1

Removing ASM disk "OCR_VOTE":                              [  OK  ]

[root@linuxrac2 /]#etc/init.d/oracleasm deletedisk OCR_VOTE /dev/sdb1

Removing ASM disk "OCR_VOTE":                              [  OK  ]

[root@linuxrac1 /]#etc/init.d/oracleasm createdisk OCR_VOTE /dev/sdb1

[root@linuxrac2 /]#oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

Instantiating disk "OCR_VOTE"

[root@linuxrac2 /]# oracleasm listdisks

DATA

DATA2

FRA

OCR_VOTE

2.彻底删除Grid Infrastructure

11G R2 Grid Infrastructure 也提供了彻底卸载的功能，deinstall该命令取代了使用OUI方式清除clusterware以及ASM，回复到安装grid之前的环境。

该命令将停止集群，移除二进制文件及其相关的所有配置信息。

命令位置：$GRID_HOME/deinstall

下面该命令操作的具体事例，操作期间，需要提供一些交互信息，以及在新的session以root身份。

[root@ linuxrac1/ ]# cd /u01/app/11.2.0/grid/

[root@ linuxrac1/ ]# cd bin

[root@ linuxrac1 bin]# ./crsctl check crs

CRS-4047: No Oracle Clusterware components configured.

CRS-4000: Command Check failed, or completed with errors.

[root@ linuxrac1 bin]# cd ../deinstall/

[root@ linuxrac1 deinstall]# pwd

[root@ linuxrac1 deinstall]# su grid

[grid@ linuxrac1 deinstall]# ./deinstall

Checking for required files and bootstrapping ...

Please wait ...

Location of logs /tmp/deinstall2014-10-16_06-18-10-PM/logs/

############ ORACLE DEINSTALL & DECONFIG TOOL START ############

######################## CHECK OPERATION START ########################

Install check configuration START

Checking for existence of the Oracle home location /u01/app/11.2.0/grid

Oracle Home type selected for de-install is: CRS

Oracle Base selected for de-install is: /u01/app/grid

Checking for existence of central inventory location /u01/app/oraInventory

Checking for existence of the Oracle Grid Infrastructure home

The following nodes are part of this cluster: linuxrac1,linuxrac2

Install check configuration END

Traces log file: /tmp/deinstall2014-10-16_06-18-10-PM/logs//crsdc.log

Enter an address or the name of the virtual IP used on node "linuxrac1"[linuxrac1-vip]

>

The following information can be collected by running ifconfig -a on node "linuxrac1"

Enter the IP netmask of Virtual IP "10.10.97.181" on node "linuxrac1"[255.255.255.0]

>

Enter the network interface name on which the virtual IP address "10.10.97.181" is active

>

Enter an address or the name of the virtual IP used on node "linuxrac2"[linuxrac2-vip]

>

The following information can be collected by running ifconfig -a on node "linuxrac2"

Enter the IP netmask of Virtual IP "10.10.97.183" on node "linuxrac2"[255.255.255.0]

>

Enter the network interface name on which the virtual IP address "10.10.97.183" is active

>

Enter an address or the name of the virtual IP[]

>

Network Configuration check config START

Network de-configuration trace file location: /tmp/deinstall2014-10-16_06-18-10-PM/logs/netdc_check4793051808580150519.log

Specify all RAC listeners that are to be de-configured [LISTENER,LISTENER_SCAN1]:

Network Configuration check config END

Asm Check Configuration START

ASM de-configuration trace file location: /tmp/deinstall2014-10-16_06-18-10-PM/logs/asmcadc_check1638223369054710711.log

ASM configuration was not detected in this Oracle home. Was ASM configured in this Oracle home (y|n) [n]: y

Enter the OCR/Voting Disk diskgroup name []:

Specify the ASM Diagnostic Destination [ ]:

Specify the diskgroups that are managed by this ASM instance []:

######################### CHECK OPERATION END #########################

####################### CHECK OPERATION SUMMARY #######################

Oracle Grid Infrastructure Home is:

The cluster node(s) on which the Oracle home exists are: (Please input nodes seperated by ",", eg: node1,node2,...)linuxrac1,linuxrac2

Oracle Home selected for de-install is: /u01/app/11.2.0/grid

Inventory Location where the Oracle home registered is: /u01/app/oraInventory

Following RAC listener(s) will be de-configured: LISTENER,LISTENER_SCAN1

ASM instance will be de-configured from this Oracle home

Do you want to continue (y - yes, n - no)? [n]: y

A log of this session will be written to: '/tmp/deinstall2014-10-16_06-18-10-PM/logs/deinstall_deconfig2014-10-16_06-18-44-PM.out'

Any error messages from this session will be written to: '/tmp/deinstall2014-10-16_06-18-10-PM/logs/deinstall_deconfig2014-10-16_06-18-44-PM.err'

######################## CLEAN OPERATION START ########################

ASM de-configuration trace file location: /tmp/deinstall2014-10-16_06-18-10-PM/logs/asmcadc_clean779346077107850558.log

ASM Clean Configuration START

ASM Clean Configuration END

Network Configuration clean config START

Network de-configuration trace file location: /tmp/deinstall2014-10-16_06-18-10-PM/logs/netdc_clean3314924901124092411.log

De-configuring RAC listener(s): LISTENER,LISTENER_SCAN1

De-configuring listener: LISTENER

Stopping listener: LISTENER

Warning: Failed to stop listener. Listener may not be running.

Listener de-configured successfully.

De-configuring listener: LISTENER_SCAN1

Stopping listener: LISTENER_SCAN1

Warning: Failed to stop listener. Listener may not be running.

Listener de-configured successfully.

De-configuring Naming Methods configuration file on all nodes...

Naming Methods configuration file de-configured successfully.

De-configuring Local Net Service Names configuration file on all nodes...

Local Net Service Names configuration file de-configured successfully.

De-configuring Directory Usage configuration file on all nodes...

Directory Usage configuration file de-configured successfully.

De-configuring backup files on all nodes...

Backup files de-configured successfully.

The network configuration has been cleaned up successfully.

Network Configuration clean config END

---------------------------------------->

Oracle Universal Installer clean START

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node : Done

Delete directory '/u01/app/11.2.0/grid' on the local node : Done

Delete directory '/u01/app/oraInventory' on the local node : Done

Delete directory '/u01/app/grid' on the local node : Done

Detach Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linuxrac2' : Done

Delete directory '/u01/app/11.2.0/grid' on the remote nodes 'linuxrac2' : Done

Delete directory '/u01/app/oraInventory' on the remote nodes 'linuxrac2' : Done

Delete directory '/u01/app/grid' on the remote nodes 'linuxrac2' : Done

Oracle Universal Installer cleanup was successful.

Oracle Universal Installer clean END

Oracle install clean START

Clean install operation removing temporary directory '/tmp/install' on node 'linuxrac1'

Clean install operation removing temporary directory '/tmp/install' on node 'linuxrac2'

Oracle install clean END

######################### CLEAN OPERATION END #########################

####################### CLEAN OPERATION SUMMARY #######################

ASM instance was de-configured successfully from the Oracle home

Following RAC listener(s) were de-configured successfully: LISTENER,LISTENER_SCAN1

Oracle Clusterware was already stopped and de-configured on node "linuxrac2"

Oracle Clusterware was already stopped and de-configured on node "linuxrac1"

Oracle Clusterware is stopped and de-configured successfully.

Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the local node.

Successfully deleted directory '/u01/app/11.2.0/grid' on the local node.

Successfully deleted directory '/u01/app/oraInventory' on the local node.

Successfully deleted directory '/u01/app/grid' on the local node.

Successfully detached Oracle home '/u01/app/11.2.0/grid' from the central inventory on the remote nodes 'linuxrac2'.

Successfully deleted directory '/u01/app/11.2.0/grid' on the remote nodes 'linuxrac2'.

Successfully deleted directory '/u01/app/oraInventory' on the remote nodes 'linuxrac2'.

Successfully deleted directory '/u01/app/grid' on the remote nodes 'linuxrac2'.

Oracle Universal Installer cleanup was successful.

Run 'rm -rf /etc/oraInst.loc' as root on node(s) 'linuxrac1,linuxrac2' at the end of the session.

Oracle install successfully cleaned up the temporary directories.

#######################################################################

############# ORACLE DEINSTALL & DECONFIG TOOL END #############