Build your own RAC system part V – add RDBMS home

This article concludes my short series about how to build your own RAC system-I might explore an extended distance cluster with 11.2 soon so stay tuned for more material. As you could read in my previous posts, I have installed a cluster on 2 (now 3) nodes, with a fresh 11.2 Grid Infrastructure installation. I then wanted to extend my RDBMS home to the 3 node.

As I use to say-it’s easy to extend RAC once the cluster layer is in place and working. In my case, that was a given so I continued with the extension.

I knew from extending the Grid Infrastructure that was headless and silent-you need to pass appropriate parameters and it will do it all for you. In my case I logged in as oracle to the first node and changed directory to $ORACLE_HOME/oui/bin. There I tried the following, and it worked without problems! My cluster is made up of rac11gr2node{1,2,3}, the RDBMS software was already present on nodes 1 and 2. I should actually have run a cluvfy but was too lazy (I wouldn’t do this on any non-lab environment!)

[oracle@rac11gr2node1 bin]$ ./ -silent "CLUSTER_NEW_NODES={rac11gr2node3}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 880 MB    Passed
Oracle Universal Installer, Version Production
Copyright (C) 1999, 2009, Oracle. All rights reserved.

Performing tests to see whether nodes rac11gr2node2,rac11gr2node3 are available
............................................................... 100% Done.

Cluster Node Addition Summary
Global Settings
 Source: /u01/app/oracle/product/11.2.0/dbhome_1
 New Nodes
Space Requirements
 New Nodes
 /u01: Required 3.61GB : Available 4.15GB
Installed Products
 Product Names
 Oracle Database 11g
 Sun JDK
 Installer SDK Component
 Oracle One-Off Patch Installer
 Oracle Universal Installer
 Oracle Configuration Manager Deconfiguration
 Oracle DBCA Deconfiguration
 Oracle RAC Deconfiguration
 Oracle Database Deconfiguration
 Oracle Configuration Manager
 Oracle ODBC Driverfor Instant Client
 LDAP Required Support Files
 SSL Required Support Files for InstantClient
 Bali Share
 Oracle Extended Windowing Toolkit
 Oracle JFC Extended Windowing Toolkit
 Oracle Real Application Testing
 Oracle Database Vault J2EE Application
 Oracle Label Security
 Oracle Data Mining RDBMS Files
 Oracle OLAP RDBMS Files
 Oracle OLAP API
 Platform Required Support Files
 Oracle Database Vault option
 Oracle RAC Required Support Files-HAS
 SQL*Plus Required Support Files
 Oracle Display Fonts
 Oracle Ice Browser
 Oracle JDBC Server Support Package
 Oracle SQL Developer
 Oracle Application Express
 XDK Required Support Files
 RDBMS Required Support Files for Instant Client
 SQLJ Runtime
 Database Workspace Manager
 RDBMS Required Support Files
 Oracle Globalization Support
 Exadata Storage Server
 Provisioning Advisor Framework
 Enterprise Manager Database Plugin -- Repository Support
 Enterprise Manager Repository Core Files
 Enterprise Manager Database Plugin -- Agent Support
 Enterprise Manager Grid Control Core Files
 Enterprise Manager Common Core Files
 Enterprise Manager Agent Core Files
 Agent Required Support Files
 Parser Generator Required Support Files
 Oracle 11g Warehouse Builder Required Files
 Oracle Notification Service (eONS)
 Oracle Text Required Support Files
 Precompiler Required Support Files
 Oracle Database 11g Multimedia Files
 Oracle Multimedia Java Advanced Imaging
 Oracle Multimedia Annotator
 Oracle JDBC/OCI Instant Client
 Oracle Multimedia Locator RDBMS Files
 Oracle Core Required Support Files
 Oracle Help For Java
 Sample Schema Data
 Oracle Starter Database
 Oracle Message Gateway Common Files
 Oracle XML Query
 XML Parser for Oracle JVM
 Expat libraries
 Installation Plugin Files
 Enterprise Manager Common Files
 Perl Modules
 Deinstallation Tool
 Oracle Quality of Service Management (Client)
 Perl Interpreter
 JAccelerator (COMPANION)
 Oracle Containers for Java
 Oracle Code Editor
 Oracle Net Required Support Files
 Secure Socket Layer
 Oracle Universal Connection Pool
 Oracle JDBC/THIN Interfaces
 Oracle Multimedia Client Option
 Oracle Java Client
 Character Set Migration Utility
 Oracle Locale Builder
 PL/SQL Embedded Gateway
 OLAP SQL Scripts
 Database SQL Scripts
 Oracle Globalization Support
 Required Support Files
 SQL*Plus Files for Instant Client
 Oracle ODBC Driver
 Oracle Database User Interface
 Oracle Notification Service
 Enterprise Manager Minimal Integration
 XML Parser for Java
 Oracle Security Developer Tools
 Oracle Wallet Manager
 Cluster Verification Utility Common Files
 Oracle Clusterware RDBMS Files
 Oracle UIX
 Enterprise Manager plugin Common Files
 HAS Common Files
 Precompiler Common Files
 Installation Common Files
 Oracle Help for the  Web
 Oracle LDAP administration
 Buildtools Common Files
 Assistant Common Files
 Oracle Recovery Manager
 Generic Connectivity Common Files
 Oracle Database Gateway for ODBC
 Oracle Programmer
 Oracle Database Utilities
 Enterprise Manager Agent
 Oracle Netca Client
 Oracle Call Interface (OCI)
 Oracle Multimedia Locator
 Oracle Multimedia
 Oracle Net
 Database Configuration and Upgrade Assistants
 Oracle XML Development Kit
 Oracle JVM
 Oracle Advanced Security
 Oracle Internet Directory Client
 HAS Files for DB
 Oracle Enterprise Manager Console DB
 Oracle Net Listener
 Oracle Text
 Oracle Net Services
 Oracle Database 11g
 Oracle OLAP
 Oracle Spatial
 Oracle Partitioning
 Enterprise Edition Options

Instantiating scripts for add node (Friday, February 12, 2010 12:13:02 PM GMT)
.                                                                 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Friday, February 12, 2010 12:13:14 PM GMT)
 96% Done.
Home copied to new nodes

Saving inventory on nodes (Friday, February 12, 2010 12:20:33 PM GMT)
.                                                               100% Done.
Save inventory complete
The following configuration scripts need to be executed as the "root" user in each cluster node.
/u01/app/oracle/product/11.2.0/dbhome_1/ #On nodes rac11gr2node3
To execute the configuration scripts:
 1. Open a terminal window
 2. Log in as "root"
 3. Run the scripts in each cluster node

The Cluster Node Addition of /u01/app/oracle/product/11.2.0/dbhome_1 was successful.
Please check '/tmp/silentInstall.log' for more details.
[oracle@rac11gr2node1 bin]$

Cool – it seems like it was never as easy as  this! I checked if it worked by invoking opatch on the newly added node in $ORACLE_HOME/OPatch/:

[oracle@rac11gr2node3 OPatch]$ ./opatch lsinv
Invoking OPatch

Oracle Interim Patch Installer version
Copyright (c) 2009, Oracle Corporation.  All rights reserved.

Oracle Home       : /u01/crs/oracle/product/11.2.0/grid
Central Inventory : /u01/app/oraInventory
 from           : /etc/oraInst.loc
OPatch version    :
OUI version       :
OUI location      : /u01/crs/oracle/product/11.2.0/grid/oui
Log file location : /u01/crs/oracle/product/11.2.0/grid/cfgtoollogs/opatch/opatch2010-02-12_14-37-07PM.log

Patch history file: /u01/crs/oracle/product/11.2.0/grid/cfgtoollogs/opatch/opatch_history.txt

Lsinventory Output file location : /u01/crs/oracle/product/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2010-02-12_14-37-07PM.txt

Installed Top-level Products (1):

Oracle Grid Infrastructure                                 
There are 1 products installed in this Oracle Home.

There are no Interim patches installed in this Oracle Home.

Rac system comprising of multiple nodes Local node = rac11gr2node3 Remote node = rac11gr2node1 Remote node = rac11gr2node2
OPatch succeeded.

Success! Note that it’s intentional to use opatch with 11.2 for now…

On a future post I’ll try to work out how this affects server pool and policy managed databases.