Oracle RAC -Node Addition

Oracle RAC -Node Addition


For DBA some time due to capacity or load requirements , We need to add additional node to oracle RAC cluster. In this blog , We will discuss and show how to add a node to existing cluster.

Following  are the  steps to add node to RAC cluster:

 Step (1) Verify the hardware and operating system installations with the Cluster Verification Utility (CVU). Add Node Precheck, Compare Node 1 to Node 3 for existing node on cluster


[oragrid@oraclerac01 bin]$ cluvfy comp peer -refnode oraclerac01 -n oraclerac03  -osdba dba -verbose

 

Verifying peer compatibility

 

Checking peer compatibility...

 

Compatibility check: Physical memory [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  7.7958GB (8174532.0KB)    7.7958GB (8174532.0KB)    matched

Physical memory check passed

 

Compatibility check: Available memory [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  7.6018GB (7971024.0KB)    6.2504GB (6553980.0KB)    mismatched

Available memory check failed

 

Compatibility check: Swap space [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  13.875GB (1.4548984E7KB)  13.875GB (1.4548984E7KB)  matched

Swap space check passed

 

Compatibility check: Free disk space for "/tmp" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4.4473GB (4663296.0KB)    2.1025GB (2204672.0KB)    mismatched

Free disk space check failed

 

Compatibility check: User existence for "oragrid" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  oragrid(1603)             oragrid(1603)             matched

User existence for "oragrid" check passed

 

Compatibility check: Group existence for "oinstall" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  does not exist            oinstall(1100)            mismatched

Group existence for "oinstall" check failed

 

Compatibility check: Group existence for "dba" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  dba(1000)                 dba(1000)                 matched

Group existence for "dba" check passed

 

Compatibility check: Group membership for "oragrid" in "oinstall (Primary)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  no                        no                        matched

Group membership for "oragrid" in "oinstall (Primary)" check passed

 

Compatibility check: Group membership for "oragrid" in "dba" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  yes                       yes                       matched

Group membership for "oragrid" in "dba" check passed

 

Compatibility check: Run level [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  3                         3                         matched

Run level check passed

 

Compatibility check: System architecture [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  x86_64                    x86_64                    matched

System architecture check passed

 

Compatibility check: Kernel version [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  2.6.18-308.13.1.el5       2.6.18-308.13.1.el5       matched

Kernel version check passed

 

Compatibility check: Kernel param "semmsl" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  250                       250                       matched

Kernel param "semmsl" check passed

 

Compatibility check: Kernel param "semmns" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  32000                     32000                     matched

Kernel param "semmns" check passed

 

Compatibility check: Kernel param "semopm" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  100                       100                       matched

Kernel param "semopm" check passed

 

Compatibility check: Kernel param "semmni" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  128                       128                       matched

Kernel param "semmni" check passed

 

Compatibility check: Kernel param "shmmax" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  68719476736               68719476736               matched

Kernel param "shmmax" check passed

 

Compatibility check: Kernel param "shmmni" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4096                      4096                      matched

Kernel param "shmmni" check passed

 

Compatibility check: Kernel param "shmall" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4294967296                4294967296                matched

Kernel param "shmall" check passed

 

Compatibility check: Kernel param "file-max" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  6815744                   6815744                   matched

Kernel param "file-max" check passed

 

Compatibility check: Kernel param "ip_local_port_range" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  9000 65500                9000 65500                matched

Kernel param "ip_local_port_range" check passed

 

Compatibility check: Kernel param "rmem_default" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  262144                    262144                    matched

Kernel param "rmem_default" check passed

 

Compatibility check: Kernel param "rmem_max" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4194304                   4194304                   matched

Kernel param "rmem_max" check passed

 

Compatibility check: Kernel param "wmem_default" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  262144                    262144                    matched

Kernel param "wmem_default" check passed

 

Compatibility check: Kernel param "wmem_max" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  1048576                   1048576                   matched

Kernel param "wmem_max" check passed

 

Compatibility check: Kernel param "aio-max-nr" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  1048576                   1048576                   matched

Kernel param "aio-max-nr" check passed

 

Compatibility check: Package existence for "make" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  make-3.81-3.el5           make-3.81-3.el5           matched

Package existence for "make" check passed

 

Compatibility check: Package existence for "binutils" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  binutils-2.17.50.0.6-20.el5_8.3  binutils-2.17.50.0.6-20.el5_8.3  matched

Package existence for "binutils" check passed

 

Compatibility check: Package existence for "gcc (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  gcc-4.1.2-52.el5_8.1 (x86_64)  gcc-4.1.2-52.el5_8.1 (x86_64)  matched

Package existence for "gcc (x86_64)" check passed

 

Compatibility check: Package existence for "libaio (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libaio-0.3.106-5 (x86_64),libaio-0.3.106-5 (i386)  libaio-0.3.106-5 (x86_64),libaio-0.3.106-5 (i386)  matched

Package existence for "libaio (x86_64)" check passed

 

Compatibility check: Package existence for "glibc (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-2.5-81.el5_8.7 (x86_64),glibc-2.5-81.el5_8.7 (i686)  glibc-2.5-81.el5_8.7 (x86_64),glibc-2.5-81.el5_8.7 (i686)  matched

Package existence for "glibc (x86_64)" check passed

 

Compatibility check: Package existence for "compat-libstdc++-33 (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  compat-libstdc++-33-3.2.3-61 (x86_64),compat-libstdc++-33-3.2.3-61 (i386)  compat-libstdc++-33-3.2.3-61 (x86_64),compat-libstdc++-33-3.2.3-61 (i386)  matched

Package existence for "compat-libstdc++-33 (x86_64)" check passed

 

Compatibility check: Package existence for "elfutils-libelf (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  elfutils-libelf-0.137-3.el5 (x86_64),elfutils-libelf-0.137-3.el5 (i386)  elfutils-libelf-0.137-3.el5 (x86_64),elfutils-libelf-0.137-3.el5 (i386)  matched

Package existence for "elfutils-libelf (x86_64)" check passed

 

Compatibility check: Package existence for "elfutils-libelf-devel" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.137-3.el5  matched

Package existence for "elfutils-libelf-devel" check passed

 

Compatibility check: Package existence for "glibc-common" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-common-2.5-81.el5_8.7  glibc-common-2.5-81.el5_8.7  matched

Package existence for "glibc-common" check passed

 

Compatibility check: Package existence for "glibc-devel (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-devel-2.5-81.el5_8.7 (x86_64),glibc-devel-2.5-81.el5_8.7 (i386)  glibc-devel-2.5-81.el5_8.7 (x86_64),glibc-devel-2.5-81.el5_8.7 (i386)  matched

Package existence for "glibc-devel (x86_64)" check passed

 

Compatibility check: Package existence for "glibc-headers" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-headers-2.5-81.el5_8.7  glibc-headers-2.5-81.el5_8.7  matched

Package existence for "glibc-headers" check passed

 

Compatibility check: Package existence for "gcc-c++ (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  gcc-c++-4.1.2-52.el5_8.1 (x86_64)  gcc-c++-4.1.2-52.el5_8.1 (x86_64)  matched

Package existence for "gcc-c++ (x86_64)" check passed

 

Compatibility check: Package existence for "libaio-devel (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  missing                   libaio-devel-0.3.106-3.2 (x86_64)  mismatched

Package existence for "libaio-devel (x86_64)" check failed

 

Compatibility check: Package existence for "libgcc (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libgcc-4.1.2-52.el5_8.1 (i386),libgcc-4.1.2-52.el5_8.1 (x86_64)  libgcc-4.1.2-52.el5_8.1 (i386),libgcc-4.1.2-52.el5_8.1 (x86_64)  matched

Package existence for "libgcc (x86_64)" check passed

 

Compatibility check: Package existence for "libstdc++ (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libstdc++-4.1.2-52.el5_8.1 (x86_64),libstdc++-4.1.2-52.el5_8.1 (i386)  libstdc++-4.1.2-52.el5_8.1 (x86_64),libstdc++-4.1.2-52.el5_8.1 (i386)  matched

Package existence for "libstdc++ (x86_64)" check passed

 

Compatibility check: Package existence for "libstdc++-devel (x86_64)" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libstdc++-devel-4.1.2-52.el5_8.1 (x86_64)  libstdc++-devel-4.1.2-52.el5_8.1 (x86_64)  matched

Package existence for "libstdc++-devel (x86_64)" check passed

 

Compatibility check: Package existence for "sysstat" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  sysstat-7.0.2-11.el5      sysstat-7.0.2-11.el5      matched

Package existence for "sysstat" check passed

 

Compatibility check: Package existence for "ksh" [reference node: oraclerac01]

  Node Name     Status                    Ref. node status          Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  ksh-20100621-5.el5_8.1    ksh-20100621-5.el5_8.1    matched

Package existence for "ksh" check passed

 

Verification of peer compatibility was unsuccessful.

Checks did not pass for the following node(s):

        oraclerac03

Step (2) Verify the integrity of the cluster and node3

oracleon oraclerac01

 

[oragrid@oraclerac01 bin]$ cluvfy stage -pre nodeadd -n oraclerac03 -verbose

 

Performing pre-checks for node addition

 

Checking node reachability...

 

Check: Node reachability from node "oraclerac01"

  Destination Node                      Reachable?

  ------------------------------------  ------------------------

  oraclerac03                         yes

Result: Node reachability check passed from node "oraclerac01"

 

 

Checking user equivalence...

 

Check: User equivalence for user "oragrid"

  Node Name                             Comment

  ------------------------------------  ------------------------

  oraclerac03                         passed

Result: User equivalence check passed for user "oragrid"

 

Checking node connectivity...

 

Checking hosts config file...

  Node Name     Status                    Comment

  ------------  ------------------------  ------------------------

  oraclerac02  passed

  oraclerac03  passed

  oraclerac01  passed

 

Verification of the hosts config file successful

 

 

Interface information for node "oraclerac03"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.125  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C0 1500

 eth1   10.131.238.4    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C1 1500

 eth1   10.131.238.4    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C1 1500

 eth2   10.1.1.7        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:C2 1500

 

 

Interface information for node "oraclerac01"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.48   172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.135  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.134  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.131  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth1   10.131.238.2    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   10.131.238.2    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   169.254.156.84  169.254.128.0   0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   169.254.98.80   169.254.0.0     0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth2   10.1.1.5        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:BD 1500

 

 

Interface information for node "oraclerac02"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.49   172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth0   172.17.120.132  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth0   172.17.120.133  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth1   10.131.238.3    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   10.131.238.3    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   169.254.171.41  169.254.128.0   0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   169.254.121.23  169.254.0.0     0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth2   10.1.1.6        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:BE 1500

 

 

Check: Node connectivity for interface "eth0"

  Source                          Destination                     Connected?

  ------------------------------  ------------------------------  ----------------

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.48]    yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.135]   yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.134]   yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.131]   yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.49]    yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.132]   yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.135]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.134]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.135]   oraclerac01[172.17.120.134]   yes

  oraclerac01[172.17.120.135]   oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.134]   oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.133]   yes

  oraclerac02[172.17.120.49]    oraclerac02[172.17.120.132]   yes

  oraclerac02[172.17.120.49]    oraclerac02[172.17.120.133]   yes

  oraclerac02[172.17.120.132]   oraclerac02[172.17.120.133]   yes

Result: Node connectivity passed for interface "eth0"

 

Result: Node connectivity check passed

 

 

Checking CRS integrity...

The Oracle Clusterware is healthy on node "oraclerac01"

The Oracle Clusterware is healthy on node "oraclerac02"

 

CRS integrity check passed

 

Checking shared resources...

 

Checking CRS home location...

The location "/g01/app/11.2.0/grid" is not shared but is present/creatable on all nodes

Result: Shared resources check for node addition passed

 

 

Checking node connectivity...

 

Checking hosts config file...

  Node Name     Status                    Comment

  ------------  ------------------------  ------------------------

  oraclerac02  passed

  oraclerac03  passed

  oraclerac01  passed

 

Verification of the hosts config file successful

 

 

Interface information for node "oraclerac03"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.125  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C0 1500

 eth1   10.131.238.4    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C1 1500

 eth1   10.131.238.4    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:C1 1500

 eth2   10.1.1.7        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:C2 1500

 

 

Interface information for node "oraclerac01"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.48   172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.135  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.134  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth0   172.17.120.131  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:B9 1500

 eth1   10.131.238.2    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   10.131.238.2    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   169.254.156.84  169.254.128.0   0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth1   169.254.98.80   169.254.0.0     0.0.0.0         172.17.120.1    00:50:56:01:01:BB 1500

 eth2   10.1.1.5        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:BD 1500

 

 

Interface information for node "oraclerac02"

 Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU

 ------ --------------- --------------- --------------- --------------- ----------------- ------

 eth0   172.17.120.49   172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth0   172.17.120.132  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth0   172.17.120.133  172.17.120.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BA 1500

 eth1   10.131.238.3    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   10.131.238.3    10.131.238.0    0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   169.254.171.41  169.254.128.0   0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth1   169.254.121.23  169.254.0.0     0.0.0.0         172.17.120.1    00:50:56:01:01:BC 1500

 eth2   10.1.1.6        10.1.1.0        0.0.0.0         172.17.120.1    00:50:56:01:01:BE 1500

 

 

Check: Node connectivity for interface "eth0"

  Source                          Destination                     Connected?

  ------------------------------  ------------------------------  ----------------

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.48]    yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.135]   yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.134]   yes

  oraclerac03[172.17.120.125]   oraclerac01[172.17.120.131]   yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.49]    yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.132]   yes

  oraclerac03[172.17.120.125]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.135]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.134]   yes

  oraclerac01[172.17.120.48]    oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.48]    oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.135]   oraclerac01[172.17.120.134]   yes

  oraclerac01[172.17.120.135]   oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.135]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.134]   oraclerac01[172.17.120.131]   yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.134]   oraclerac02[172.17.120.133]   yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.49]    yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.132]   yes

  oraclerac01[172.17.120.131]   oraclerac02[172.17.120.133]   yes

  oraclerac02[172.17.120.49]    oraclerac02[172.17.120.132]   yes

  oraclerac02[172.17.120.49]    oraclerac02[172.17.120.133]   yes

  oraclerac02[172.17.120.132]   oraclerac02[172.17.120.133]   yes

Result: Node connectivity passed for interface "eth0"

 

Check: Node connectivity for interface "eth1"

  Source                          Destination                     Connected?

  ------------------------------  ------------------------------  ----------------

  oraclerac03[10.131.238.4]     oraclerac03[10.131.238.4]     yes

  oraclerac03[10.131.238.4]     oraclerac01[10.131.238.2]     yes

  oraclerac03[10.131.238.4]     oraclerac01[10.131.238.2]     yes

  oraclerac03[10.131.238.4]     oraclerac02[10.131.238.3]     yes

  oraclerac03[10.131.238.4]     oraclerac02[10.131.238.3]     yes

  oraclerac03[10.131.238.4]     oraclerac01[10.131.238.2]     yes

  oraclerac03[10.131.238.4]     oraclerac01[10.131.238.2]     yes

  oraclerac03[10.131.238.4]     oraclerac02[10.131.238.3]     yes

  oraclerac03[10.131.238.4]     oraclerac02[10.131.238.3]     yes

  oraclerac01[10.131.238.2]     oraclerac01[10.131.238.2]     yes

  oraclerac01[10.131.238.2]     oraclerac02[10.131.238.3]     yes

  oraclerac01[10.131.238.2]     oraclerac02[10.131.238.3]     yes

  oraclerac01[10.131.238.2]     oraclerac02[10.131.238.3]     yes

  oraclerac01[10.131.238.2]     oraclerac02[10.131.238.3]     yes

  oraclerac02[10.131.238.3]     oraclerac02[10.131.238.3]     yes

Result: Node connectivity passed for interface "eth1"

 

Result: Node connectivity check passed

 

 

Check: Total memory

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  7.7958GB (8174532.0KB)    1.5GB (1572864.0KB)       passed

  oraclerac01  7.7958GB (8174532.0KB)    1.5GB (1572864.0KB)       passed

Result: Total memory check passed

 

Check: Available memory

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  7.6006GB (7969780.0KB)    50MB (51200.0KB)          passed

  oraclerac01  6.238GB (6540976.0KB)     50MB (51200.0KB)          passed

Result: Available memory check passed

 

Check: Swap space

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  13.875GB (1.4548984E7KB)  7.7958GB (8174532.0KB)    passed

  oraclerac01  13.875GB (1.4548984E7KB)  7.7958GB (8174532.0KB)    passed

Result: Swap space check passed

 

Check: Free disk space for "oraclerac03:/tmp"

  Path              Node Name     Mount point   Available     Required      Comment

  ----------------  ------------  ------------  ------------  ------------  ------------

  /tmp              oraclerac03  /tmp          4.4473GB      1GB           passed

Result: Free disk space check passed for "oraclerac03:/tmp"

 

Check: Free disk space for "oraclerac01:/tmp"

  Path              Node Name     Mount point   Available     Required      Comment

  ----------------  ------------  ------------  ------------  ------------  ------------

  /tmp              oraclerac01  /tmp          2.1025GB      1GB           passed

Result: Free disk space check passed for "oraclerac01:/tmp"

 

Check: User existence for "oragrid"

  Node Name     Status                    Comment

  ------------  ------------------------  ------------------------

  oraclerac03  exists(1603)              passed

  oraclerac01  exists(1603)              passed

 

Checking for multiple users with UID value 1603

Result: Check for multiple users with UID value 1603 passed

Result: User existence check passed for "oragrid"

 

Check: Run level

  Node Name     run level                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  3                         3,5                       passed

  oraclerac01  3                         3,5                       passed

Result: Run level check passed

 

Check: Hard limits for "maximum open file descriptors"

  Node Name         Type          Available     Required      Comment

  ----------------  ------------  ------------  ------------  ----------------

  oraclerac01     hard          65536         65536         passed

  oraclerac03     hard          65536         65536         passed

Result: Hard limits check passed for "maximum open file descriptors"

 

Check: Soft limits for "maximum open file descriptors"

  Node Name         Type          Available     Required      Comment

  ----------------  ------------  ------------  ------------  ----------------

  oraclerac01     soft          1024          1024          passed

  oraclerac03     soft          1024          1024          passed

Result: Soft limits check passed for "maximum open file descriptors"

 

Check: Hard limits for "maximum user processes"

  Node Name         Type          Available     Required      Comment

  ----------------  ------------  ------------  ------------  ----------------

  oraclerac01     hard          16384         16384         passed

  oraclerac03     hard          16384         16384         passed

Result: Hard limits check passed for "maximum user processes"

 

Check: Soft limits for "maximum user processes"

  Node Name         Type          Available     Required      Comment

  ----------------  ------------  ------------  ------------  ----------------

  oraclerac01     soft          2047          2047          passed

  oraclerac03     soft          2047          2047          passed

Result: Soft limits check passed for "maximum user processes"

 

Check: System architecture

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  x86_64                    x86_64                    passed

  oraclerac01  x86_64                    x86_64                    passed

Result: System architecture check passed

 

Check: Kernel version

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  2.6.18-308.13.1.el5       2.6.18                    passed

  oraclerac01  2.6.18-308.13.1.el5       2.6.18                    passed

Result: Kernel version check passed

 

Check: Kernel parameter for "semmsl"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  250                       250                       passed

  oraclerac01  250                       250                       passed

Result: Kernel parameter check passed for "semmsl"

 

Check: Kernel parameter for "semmns"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  32000                     32000                     passed

  oraclerac01  32000                     32000                     passed

Result: Kernel parameter check passed for "semmns"

 

Check: Kernel parameter for "semopm"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  100                       100                       passed

  oraclerac01  100                       100                       passed

Result: Kernel parameter check passed for "semopm"

 

Check: Kernel parameter for "semmni"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  128                       128                       passed

  oraclerac01  128                       128                       passed

Result: Kernel parameter check passed for "semmni"

 

Check: Kernel parameter for "shmmax"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  68719476736               4185360384                passed

  oraclerac01  68719476736               4185360384                passed

Result: Kernel parameter check passed for "shmmax"

 

Check: Kernel parameter for "shmmni"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4096                      4096                      passed

  oraclerac01  4096                      4096                      passed

Result: Kernel parameter check passed for "shmmni"

 

Check: Kernel parameter for "shmall"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4294967296                2097152                   passed

  oraclerac01  4294967296                2097152                   passed

Result: Kernel parameter check passed for "shmall"

 

Check: Kernel parameter for "file-max"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  6815744                   6815744                   passed

  oraclerac01  6815744                   6815744                   passed

Result: Kernel parameter check passed for "file-max"

 

Check: Kernel parameter for "ip_local_port_range"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  between 9000 & 65500      between 9000 & 65500      passed

  oraclerac01  between 9000 & 65500      between 9000 & 65500      passed

Result: Kernel parameter check passed for "ip_local_port_range"

 

Check: Kernel parameter for "rmem_default"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  262144                    262144                    passed

  oraclerac01  262144                    262144                    passed

Result: Kernel parameter check passed for "rmem_default"

 

Check: Kernel parameter for "rmem_max"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  4194304                   4194304                   passed

  oraclerac01  4194304                   4194304                   passed

Result: Kernel parameter check passed for "rmem_max"

 

Check: Kernel parameter for "wmem_default"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  262144                    262144                    passed

  oraclerac01  262144                    262144                    passed

Result: Kernel parameter check passed for "wmem_default"

 

Check: Kernel parameter for "wmem_max"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  1048576                   1048576                   passed

  oraclerac01  1048576                   1048576                   passed

Result: Kernel parameter check passed for "wmem_max"

 

Check: Kernel parameter for "aio-max-nr"

  Node Name     Configured                Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  1048576                   1048576                   passed

  oraclerac01  1048576                   1048576                   passed

Result: Kernel parameter check passed for "aio-max-nr"

 

Check: Package existence for "make-3.81( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  make-3.81-3.el5           make-3.81( x86_64)        passed

  oraclerac01  make-3.81-3.el5           make-3.81( x86_64)        passed

Result: Package existence check passed for "make-3.81( x86_64)"

 

Check: Package existence for "binutils-2.17.50.0.6( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  binutils-2.17.50.0.6-20.el5_8.3  binutils-2.17.50.0.6( x86_64)  passed

  oraclerac01  binutils-2.17.50.0.6-20.el5_8.3  binutils-2.17.50.0.6( x86_64)  passed

Result: Package existence check passed for "binutils-2.17.50.0.6( x86_64)"

 

Check: Package existence for "gcc-4.1.2 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  gcc-4.1.2-52.el5_8.1 (x86_64)  gcc-4.1.2 (x86_64)( x86_64)  passed

  oraclerac01  gcc-4.1.2-52.el5_8.1 (x86_64)  gcc-4.1.2 (x86_64)( x86_64)  passed

Result: Package existence check passed for "gcc-4.1.2 (x86_64)( x86_64)"

 

Check: Package existence for "libaio-0.3.106 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libaio-0.3.106-5 (x86_64)  libaio-0.3.106 (x86_64)( x86_64)  passed

  oraclerac01  libaio-0.3.106-5 (x86_64)  libaio-0.3.106 (x86_64)( x86_64)  passed

Result: Package existence check passed for "libaio-0.3.106 (x86_64)( x86_64)"

 

Check: Package existence for "glibc-2.5-24 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-2.5-81.el5_8.7 (x86_64)  glibc-2.5-24 (x86_64)( x86_64)  passed

  oraclerac01  glibc-2.5-81.el5_8.7 (x86_64)  glibc-2.5-24 (x86_64)( x86_64)  passed

Result: Package existence check passed for "glibc-2.5-24 (x86_64)( x86_64)"

 

Check: Package existence for "compat-libstdc++-33-3.2.3 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)( x86_64)  passed

  oraclerac01  compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)( x86_64)  passed

Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)( x86_64)"

 

Check: Package existence for "elfutils-libelf-0.125 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  elfutils-libelf-0.137-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)( x86_64)  passed

  oraclerac01  elfutils-libelf-0.137-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)( x86_64)  passed

Result: Package existence check passed for "elfutils-libelf-0.125 (x86_64)( x86_64)"

 

Check: Package existence for "elfutils-libelf-devel-0.125( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125( x86_64)  passed

  oraclerac01  elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125( x86_64)  passed

Result: Package existence check passed for "elfutils-libelf-devel-0.125( x86_64)"

 

Check: Package existence for "glibc-common-2.5( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-common-2.5-81.el5_8.7  glibc-common-2.5( x86_64)  passed

  oraclerac01  glibc-common-2.5-81.el5_8.7  glibc-common-2.5( x86_64)  passed

Result: Package existence check passed for "glibc-common-2.5( x86_64)"

 

Check: Package existence for "glibc-devel-2.5 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-devel-2.5-81.el5_8.7 (x86_64)  glibc-devel-2.5 (x86_64)( x86_64)  passed

  oraclerac01  glibc-devel-2.5-81.el5_8.7 (x86_64)  glibc-devel-2.5 (x86_64)( x86_64)  passed

Result: Package existence check passed for "glibc-devel-2.5 (x86_64)( x86_64)"

 

Check: Package existence for "glibc-headers-2.5( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  glibc-headers-2.5-81.el5_8.7  glibc-headers-2.5( x86_64)  passed

  oraclerac01  glibc-headers-2.5-81.el5_8.7  glibc-headers-2.5( x86_64)  passed

Result: Package existence check passed for "glibc-headers-2.5( x86_64)"

 

Check: Package existence for "gcc-c++-4.1.2 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  gcc-c++-4.1.2-52.el5_8.1 (x86_64)  gcc-c++-4.1.2 (x86_64)( x86_64)  passed

  oraclerac01  gcc-c++-4.1.2-52.el5_8.1 (x86_64)  gcc-c++-4.1.2 (x86_64)( x86_64)  passed

Result: Package existence check passed for "gcc-c++-4.1.2 (x86_64)( x86_64)"

 

Check: Package existence for "libaio-devel-0.3.106 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  missing                   libaio-devel-0.3.106 (x86_64)( x86_64)  failed

  oraclerac01  libaio-devel-0.3.106-3.2 (x86_64)  libaio-devel-0.3.106 (x86_64)( x86_64)  passed

Result: Package existence check failed for "libaio-devel-0.3.106 (x86_64)( x86_64)"

 

Check: Package existence for "libgcc-4.1.2 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libgcc-4.1.2-52.el5_8.1 (x86_64)  libgcc-4.1.2 (x86_64)( x86_64)  passed

  oraclerac01  libgcc-4.1.2-52.el5_8.1 (x86_64)  libgcc-4.1.2 (x86_64)( x86_64)  passed

Result: Package existence check passed for "libgcc-4.1.2 (x86_64)( x86_64)"

 

Check: Package existence for "libstdc++-4.1.2 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libstdc++-4.1.2-52.el5_8.1 (x86_64)  libstdc++-4.1.2 (x86_64)( x86_64)  passed

  oraclerac01  libstdc++-4.1.2-52.el5_8.1 (x86_64)  libstdc++-4.1.2 (x86_64)( x86_64)  passed

Result: Package existence check passed for "libstdc++-4.1.2 (x86_64)( x86_64)"

 

Check: Package existence for "libstdc++-devel-4.1.2 (x86_64)( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  libstdc++-devel-4.1.2-52.el5_8.1 (x86_64)  libstdc++-devel-4.1.2 (x86_64)( x86_64)  passed

  oraclerac01  libstdc++-devel-4.1.2-52.el5_8.1 (x86_64)  libstdc++-devel-4.1.2 (x86_64)( x86_64)  passed

Result: Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)( x86_64)"

 

Check: Package existence for "sysstat-7.0.2( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  sysstat-7.0.2-11.el5      sysstat-7.0.2( x86_64)    passed

  oraclerac01  sysstat-7.0.2-11.el5      sysstat-7.0.2( x86_64)    passed

Result: Package existence check passed for "sysstat-7.0.2( x86_64)"

 

Check: Package existence for "ksh-20060214( x86_64)"

  Node Name     Available                 Required                  Comment

  ------------  ------------------------  ------------------------  ----------

  oraclerac03  ksh-20100621-5.el5_8.1    ksh-20060214( x86_64)     passed

  oraclerac01  ksh-20100621-5.el5_8.1    ksh-20060214( x86_64)     passed

Result: Package existence check passed for "ksh-20060214( x86_64)"

 

Checking for multiple users with UID value 0

Result: Check for multiple users with UID value 0 passed

 

Check: Current group ID

Result: Current group ID check passed

 

Checking OCR integrity...

 

OCR integrity check passed

 

Checking Oracle Cluster Voting Disk configuration...

 

ERROR:

PRVF-5449 : Check of Voting Disk location "ORCL:ONV1(ORCL:ONV1)" failed on the following nodes:

 

        oraclerac03:No such file or directory

 

ERROR:

PRVF-5449 : Check of Voting Disk location "ORCL:ONV2(ORCL:ONV2)" failed on the following nodes:

 

        oraclerac03:No such file or directory

 

ERROR:

PRVF-5449 : Check of Voting Disk location "ORCL:ONV3(ORCL:ONV3)" failed on the following nodes:

 

        oraclerac03:No such file or directory

 

PRVF-5431 : Oracle Cluster Voting Disk configuration check failed

 

 

*******************************************************************

 

Ignore the above error since there is a bug

 

 

 

/etc/init.d/oracleasm status

Checking if ASM is loaded:                                  [  OK  ]

Checking if /dev/oracleasm is mounted:                [  OK  ]

 

## Both should be [OK]

 

 

*******************************************************************

 

Check: Time zone consistency

Result: Time zone consistency check passed

 

Starting Clock synchronization checks using Network Time Protocol(NTP)...

 

NTP Configuration file check started...

The NTP configuration file "/etc/ntp.conf" is available on all nodes

NTP Configuration file check passed

 

Checking daemon liveness...

 

Check: Liveness for "ntpd"

  Node Name                             Running?

  ------------------------------------  ------------------------

  oraclerac03                         yes

  oraclerac01                         yes

Result: Liveness check passed for "ntpd"

Check for NTP daemon or service alive passed on all nodes

 

Checking NTP daemon command line for slewing option "-x"

Check: NTP daemon command line

  Node Name                             Slewing Option Set?

  ------------------------------------  ------------------------

  oraclerac03                         yes

  oraclerac01                         yes

Result:

NTP daemon slewing option check passed

 

Checking NTP daemon's boot time configuration, in file "/etc/sysconfig/ntpd", for slewing option "-x"

 

Check: NTP daemon's boot time configuration

  Node Name                             Slewing Option Set?

  ------------------------------------  ------------------------

  oraclerac03                         yes

  oraclerac01                         yes

Result:

NTP daemon's boot time configuration check for slewing option passed

 

Checking whether NTP daemon or service is using UDP port 123 on all nodes

 

Check for NTP daemon or service using UDP port 123

  Node Name                             Port Open?

  ------------------------------------  ------------------------

  oraclerac03                         yes

  oraclerac01                         yes

 

NTP common Time Server Check started...

NTP Time Server ".GPS." is common to all nodes on which the NTP daemon is running

NTP Time Server ".LOCL." is common to all nodes on which the NTP daemon is running

Check of common NTP Time Server passed

 

Clock time offset check from NTP Time Server started...

Checking on nodes "[oraclerac03, oraclerac01]"...

Check: Clock time offset from NTP Time Server

 

Time Server: .GPS.

Time Offset Limit: 1000.0 msecs

  Node Name     Time Offset               Status

  ------------  ------------------------  ------------------------

  oraclerac03  0.091                     passed

  oraclerac01  -0.193                    passed

Time Server ".GPS." has time offsets that are within permissible limits for nodes "[oraclerac03, oraclerac01]".

 

Time Server: .LOCL.

Time Offset Limit: 1000.0 msecs

  Node Name     Time Offset               Status

  ------------  ------------------------  ------------------------

  oraclerac03  0.0                       passed

  oraclerac01  0.0                       passed

Time Server ".LOCL." has time offsets that are within permissible limits for nodes "[oraclerac03, oraclerac01]".

Clock time offset check passed

 

Result: Clock synchronization check using Network Time Protocol(NTP) passed

 

 

Checking to make sure user "oragrid" is not in "root" group

  Node Name     Status                    Comment

  ------------  ------------------------  ------------------------

  oraclerac03  does not exist            passed

  oraclerac01  does not exist            passed

Result: User "oragrid" is not part of "root" group. Check passed

Checking consistency of file "/etc/resolv.conf" across nodes

 

Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined

File "/etc/resolv.conf" does not have both domain and search entries defined

Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...

domain entry in file "/etc/resolv.conf" is consistent across nodes

Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...

search entry in file "/etc/resolv.conf" is consistent across nodes

Checking DNS response time for an unreachable node

  Node Name                             Status

  ------------------------------------  ------------------------

  oraclerac01                         passed

  oraclerac03                         passed

The DNS response time for an unreachable node is within acceptable limit on all nodes

 

File "/etc/resolv.conf" is consistent across nodes

 

 

Pre-check for node addition was unsuccessful on all the nodes.

 

 

Step (3) Add node to the cluster

oracleon oraclerac01 : </g01/app/oracle/12.2.0.2/grid/oui/bin>

$ ./addNode.sh -silent CLUSTER_NEW_NODES={oraclerac03}

 

CLUSTER_NEW_VIRTUAL_HOSTNAMES={oraclerac03-vip}

Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 16807 MB    Passed

Oracle Universal Installer, Version 12.2.0.2.2.0 Production

Copyright (C) 1999, 2010, Oracle. All rights reserved.

Performing tests to see whether nodes valisprd722a,oraclerac03 are available

............................................................... 100% Done.

..-----------------------------------------------------------------------------

Cluster Node Addition Summary

Global Settings

   Source: /g01/app/oracle/12.2.0.2/grid

   New Nodes

Space Requirements

   New Nodes

      oraclerac03

         /g01: Required 6.58GB : Available 130.73GB

Installed Products

   Product Names

      Oracle Grid Infrastructure 12.2.0.2.2.0

      Sun JDK 1.5.0.24.08

      Installer SDK Component 12.2.0.2.2.0

      Oracle One-Off Patch Installer 12.2.0.2.0.2

      Oracle Universal Installer 12.2.0.2.2.0

      Oracle USM Deconfiguration 12.2.0.2.2.0

      Oracle Configuration Manager Deconfiguration 10.3.1.0.0

      Enterprise Manager Common Core Files 10.2.0.4.3

      Oracle DBCA Deconfiguration 12.2.0.2.2.0

      Oracle RAC Deconfiguration 12.2.0.2.2.0

      Oracle Quality of Service Management (Server) 12.2.0.2.2.0

      Installation Plugin Files 12.2.0.2.2.0

      Universal Storage Manager Files 12.2.0.2.2.0

      Oracle Text Required Support Files 12.2.0.2.2.0

      Automatic Storage Management Assistant 12.2.0.2.2.0

      Oracle Database 11g Multimedia Files 12.2.0.2.2.0

      Oracle Multimedia Java Advanced Imaging 12.2.0.2.2.0

      Oracle Globalization Support 12.2.0.2.2.0

      Oracle Multimedia Locator RDBMS Files 12.2.0.2.2.0

      Oracle Core Required Support Files 12.2.0.2.2.0

      Bali Share 1.1.18.0.0

      Oracle Database Deconfiguration 12.2.0.2.2.0

      Oracle Quality of Service Management (Client) 12.2.0.2.2.0

      Expat libraries 2.0.1.0.1

      Oracle Containers for Java 12.2.0.2.2.0

      Perl Modules 5.10.0.0.1

      Secure Socket Layer 12.2.0.2.2.0

      Oracle JDBC/OCI Instant Client 12.2.0.2.2.0

      Oracle Multimedia Client Option 12.2.0.2.2.0

      LDAP Required Support Files 12.2.0.2.2.0

      Character Set Migration Utility 12.2.0.2.2.0

      Perl Interpreter 5.10.0.0.1

      PL/SQL Embedded Gateway 12.2.0.2.2.0

      OLAP SQL Scripts 12.2.0.2.2.0

      Database SQL Scripts 12.2.0.2.2.0

      Oracle Extended Windowing Toolkit 3.4.47.0.0

      SSL Required Support Files for InstantClient 12.2.0.2.2.0

      SQL*Plus Files for Instant Client 12.2.0.2.2.0

      Oracle Net Required Support Files 12.2.0.2.2.0

      Oracle Database User Interface 2.2.13.0.0

      RDBMS Required Support Files for Instant Client 12.2.0.2.2.0

      RDBMS Required Support Files Runtime 12.2.0.2.2.0

      XML Parser for Java 12.2.0.2.2.0

      Oracle Security Developer Tools 12.2.0.2.2.0

      Oracle Wallet Manager 12.2.0.2.2.0

      Enterprise Manager plugin Common Files 12.2.0.2.2.0

      Platform Required Support Files 12.2.0.2.2.0

      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0

      RDBMS Required Support Files 12.2.0.2.2.0

      Oracle Ice Browser 5.2.3.6.0

      Oracle Help For Java 4.2.9.0.0

      Enterprise Manager Common Files 10.2.0.4.3

      Deinstallation Tool 12.2.0.2.2.0

      Oracle Java Client 12.2.0.2.2.0

      Cluster Verification Utility Files 12.2.0.2.2.0

      Oracle Notification Service (eONS) 12.2.0.2.2.0

      Oracle LDAP administration 12.2.0.2.2.0

      Cluster Verification Utility Common Files 12.2.0.2.2.0

      Oracle Clusterware RDBMS Files 12.2.0.2.2.0

      Oracle Locale Builder 12.2.0.2.2.0

      Oracle Globalization Support 12.2.0.2.2.0

      Buildtools Common Files 12.2.0.2.2.0

      Oracle RAC Required Support Files-HAS 12.2.0.2.2.0

      SQL*Plus Required Support Files 12.2.0.2.2.0

      XDK Required Support Files 12.2.0.2.2.0

      Agent Required Support Files 10.2.0.4.3

      Parser Generator Required Support Files 12.2.0.2.2.0

      Precompiler Required Support Files 12.2.0.2.2.0

      Installation Common Files 12.2.0.2.2.0

      Required Support Files 12.2.0.2.2.0

      Oracle JDBC/THIN Interfaces 12.2.0.2.2.0

      Oracle Multimedia Locator 12.2.0.2.2.0

      Oracle Multimedia 12.2.0.2.2.0

      HAS Common Files 12.2.0.2.2.0

      Assistant Common Files 12.2.0.2.2.0

      PL/SQL 12.2.0.2.2.0

      HAS Files for DB 12.2.0.2.2.0

      Oracle Recovery Manager 12.2.0.2.2.0

      Oracle Database Utilities 12.2.0.2.2.0

      Oracle Notification Service 12.2.0.2.2.0

      SQL*Plus 12.2.0.2.2.0

      Oracle Netca Client 12.2.0.2.2.0

      Oracle Net 12.2.0.2.2.0

      Oracle JVM 12.2.0.2.2.0

      Oracle Internet Directory Client 12.2.0.2.2.0

      Oracle Net Listener 12.2.0.2.2.0

      Cluster Ready Services Files 12.2.0.2.2.0

      Oracle Database 11g 12.2.0.2.2.0

-----------------------------------------------------------------------------

Instantiating scripts for add node (Tuesday, March 29, 2011 2:25:21 PM CDT)

.                                                                 1% Done.

Instantiation of add node scripts complete

Copying to remote nodes (Tuesday, March 29, 2011 2:25:33 PM CDT)

...............................................................................................                                 96% Done.

Home copied to new nodes

Saving inventory on nodes (Tuesday, March 29, 2011 2:30:51 PM CDT)

.                                                               100% Done.

Save inventory complete

WARNING:A new inventory has been created on one or more nodes in this session. However, it has not yet been registered as the central inventory of this system.

To register the new inventory please run the script at '/g01/app/oracle/oraInventory/orainstRoot.sh' with root privileges on nodes 'oraclerac03'.

If you do not register the inventory, you may not be able to update or patch the products you installed.

The following configuration scripts need to be executed as the "root" user in each cluster node.

/g01/app/oracle/oraInventory/orainstRoot.sh #On nodes oraclerac03

/g01/app/oracle/12.2.0.2/grid/root.sh #On nodes oraclerac03

To execute the configuration scripts:

    1. Open a terminal window

    2. Log in as "root"

    3. Run the scripts in each cluster node

The Cluster Node Addition of /g01/app/oracle/12.2.0.2/grid was successful.

Please check '/tmp/silentInstall.log' for more details.

 

Step (4) Finaly run the root.sh on the new node from root user

# cd /g01/app/oracle/12*/grid

root on oraclerac03:</g01/app/oracle/12.2.0.2/grid>

# ./root.sh

Running Oracle 11g root script...

The following environment variables are set as:

    ORACLE_OWNER= oragrid

    ORACLE_HOME=  /g01/app/oracle/12.2.0.2/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

Creating /var/opt/oracle/oratab file...

Entries will be added to the /var/opt/oracle/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: /g01/app/oracle/12.2.0.2/grid/crs/install/crsconfig_params

Creating trace directory

LOCAL ADD MODE

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

OLR initialization - successful

Adding daemon to inittab

ACFS-9200: Supported

ACFS-9300: ADVM/ACFS distribution files found.

ACFS-9312: Existing ADVM/ACFS installation detected.

ACFS-9314: Removing previous ADVM/ACFS installation.

updating /platform/sun4u/boot_archive

ACFS-9315: Previous ADVM/ACFS components successfully removed.

ACFS-9307: Installing requested ADVM/ACFS software.

ACFS-9308: Loading installed ADVM/ACFS drivers.

ACFS-9327: Verifying ADVM/ACFS devices.

ACFS-9309: ADVM/ACFS installation correctness verified.

CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node valisprd722a, number 1, and is terminating

An active cluster was found during exclusive startup, restarting to join the cluster

clscfg: EXISTING configuration version 5 detected.

clscfg: version 5 is 11g Release 2.

Successfully accumulated necessary OCR keys.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

Configure Oracle Grid Infrastructure for a Cluster ... succeeded

 

=================================================================
Please check our other blogs for  Oracle RAC & Cluster.

Comments

Popular posts from this blog

Restart Innodb MySQL Cluster after Complete outage(All node Down)

Oracle Block Corruption - Detection and Resolution

Install & Configure MySQL Router - MySQL InnoDB Cluster