Oracle Linux 4.8安装Oracle 10g RAC环境之Cluster安装

安装环境:
操作系统:Oracle Linux 4.8 64位
集群软件:10201_clusterware_linux_x86_64.cpio.gz
数据库:10201_database_linux_x86_64.cpio.gz
cpu:1颗
内存:必须1.5G以上(一般是2G)

本地磁盘:20G(根分区17G,swap是4G,boot分区是512M)

asm下载地址:http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel4-092650.html#oracleasm_rhel4_amd64
asm软件:oracleasm-support-2.1.7-1.el4.x86_64.rpm
              oracleasmlib-2.0.4-1.el4.x86_64.rpm
              oracleasm-2.6.9-89.35.1.EL-2.0.5-1.el4.x86_64.rpm

IP地址划分:
      192.168.3.30  rac10g01          eth0

      192.168.3.40  rac10g01          eth0

      192.168.3.50  rac10g01-vip    eth0:1

      192.168.3.60  rac10g02-vip    eth0:1

      10.0.0.1          rac10g01-priv  eth1

      10.0.0.2          rac10g02-priv  eth1
IP说明: 
      每台服务器必须两块网卡, public ip和priv ip不能在同一网段.public和priv必须在网卡中写明地址,vip在地址是数据库自己添加的.

1.安装操作系统,图形化安装
    安装系统时将iptable和selinux全部禁用

2.配置虚拟机的网卡
rac10g01节点:
[root@rac10g01 ~]# vim /etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE=eth0
BOOTPROTO=static
HWADDR=00:0C:29:54:80:1D
ONBOOT=yes
TYPE=Ethernet
IPADDR=192.168.3.30
NETMASK=255.255.255.0
[root@rac10g01 ~]# vim /etc/sysconfig/network-scripts/ifcfg-eth1

DEVICE=eth1
BOOTPROTO=static
HWADDR=00:0C:29:54:80:27
ONBOOT=yes
TYPE=Ethernet
IPADDR=10.0.0.1
NETMASK=255.255.255.0
[root@rac10g01 ~]# /etc/init.d/network restart
Shutting down interface eth0:                              [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Setting network parameters:                                [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface eth0:                                [  OK  ]
Bringing up interface eth1:                                [  OK  ]
[root@rac10g01 ~]#

rac10g02节点:
[root@rac10g02 ~]# vim /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
BOOTPROTO=static
HWADDR=00:0C:29:25:63:D2
ONBOOT=yes
TYPE=Ethernet
IPADDR=192.168.3.40
NETMASK=255.255.255.0
[root@rac10g02 ~]# vim /etc/sysconfig/network-scripts/ifcfg-eth1
DEVICE=eth1
BOOTPROTO=static
HWADDR=00:0C:29:25:63:DC
ONBOOT=yes
TYPE=Ethernet
IPADDR=10.0.0.2
NETMASK=255.255.255.0
[root@rac10g02 ~]# /etc/init.d/network restart
Shutting down interface eth0:                              [  OK  ]
Shutting down loopback interface:                          [  OK  ]
Setting network parameters:                                [  OK  ]
Bringing up loopback interface:                            [  OK  ]
Bringing up interface eth0:                                [  OK  ]
Bringing up interface eth1:                                [  OK  ]
[root@rac10g01 ~]#

3.配置hosts文件,主机名与IP地址解析(两个节点都是一样的)
[root@rac10g01 ~]# vim /etc/hosts
192.168.3.30    localhost.localdomain localhost    --在两个节点分别写入这行,IP地址是本机的
192.168.3.30  rac10g01
192.168.3.40  rac10g02
192.168.3.50  rac10g01-vip
192.168.3.60  rac10g02-vip
10.0.0.1      rac10g01-priv
10.0.0.2      rac10g02-priv
[root@rac10g01 ~]# ping rac10g01    --所有的地址都ping一下,检查是否有问题

4.光盘镜像挂载,安装软件依赖包(两个节点是一样的)

[root@rac10g01 ~]# mount /dev/hdc /mnt/cdrom/
mount: block device /dev/hdc is write-protected, mounting read-only
[root@rac10g01 ~]# vim /etc/yum.repos.d/tong.repo
[tong]
name=tong
baseurl=file:///mnt
gpgkey=file:///mnt/cdrom/RPM-GPG-KEY-oracle
gpgcheck=1
enabled=1
[root@rac10g01 ~]# yum list

[root@rac10g01 ~]# yum install binutils compat-db compat-libstdc++-296 control-center gcc gcc-c++ glibc glibc-common libstdc++ libstdc++-devel make sysstat setarch glibc-devel libaio ksh glibc-headers libgnome libgcc libgnomeui libgomp openmotif libXp -y
[root@rac10g01 ~]#

5.修改内核参数(两个节点必须一至)
[root@rac10g01 ~]# vim /etc/sysctl.conf
kernel.shmall = 2097152
kernel.shmmax = 2147483648
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
fs.file-max = 65536
net.ipv4.ip_local_port_range = 1024 65000
net.core.rmem_default = 262144
net.core.rmem_max = 262144
net.core.wmem_default = 262144
net.core.wmem_max = 262144
[root@rac10g01 ~]# sysctl -p

6.创建用户，用户组,用户设置密码(两个节点必须一至)

[root@rac10g01 ~]# groupadd -g 500 oinstall
[root@rac10g01 ~]# groupadd -g 501 dba
[root@rac10g01 ~]# groupadd -g 502 oper
[root@rac10g01 ~]# groupadd -g 503 asmadmin
[root@rac10g01 ~]# groupadd -g 504 asmdba
[root@rac10g01 ~]# groupadd -g 505 asmoper
[root@rac10g01 ~]# useradd -u 1000 -g oinstall -G dba,oper,asmdba -d /home/oracle oracle
[root@rac10g01 ~]# passwd oracle
Changing password for user oracle.
New UNIX password:
BAD PASSWORD: it is based on a dictionary word
Retype new UNIX password:
passwd: all authentication tokens updated successfully.
[root@rac10g01 ~]#

7.创建oracle与grid存放的目录(两个节点必须一至)
[root@rac10g01 ~]# mkdir -p /u01/oracle/product/10.2.0.1/db_1
[root@rac10g01 ~]# mkdir -p /u01/oracle/product/10.2.0.1/crs_1
[root@rac10g01 ~]# chown  -R oracle:oinstall /u01/

8.修改用户对文件打开的限制(两个节点一至)

[root@rac10g01 ~]# vim /etc/security/limits.conf
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
oracle soft memlock 5242880
oracle hard memlock 524280
[root@rac10g01 ~]#

9.添加oracle用户的环境变量(两个节点一至)
[root@rac10g01 ~]# vim /home/oracle/.bash_profile
export ORACLE_BASE=/u01/oracle
export ORACLE_HOME=$ORACLE_BASE/product/10.2.0.1/db_1
export CRS_HOME=$ORACLE_BASE/product/10.2.0.1/crs_1
export ORA_CRS_HOME=$CRS_HOME
export ORACLE_SID=rac10g1
export PATH=$PATH:$ORA_CRS_HOME/bin:$ORACLE_HOME/bin
[root@rac10g01 ~]# . /home/oracle/.bash_profile

10.oracle用户的ssh互相信任(两个节点一至)
rac10g01节点:

[root@rac10g01 ~]# su - oracle
[oracle@rac10g01 ~]$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
Created directory '/home/oracle/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_rsa.
Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.
The key fingerprint is:
cb:63:66:59:9d:7a:68:8f:4c:de:83:c4:f3:f4:19:97 oracle@rac10g01

[oracle@rac10g01 ~]$ cd .ssh/
[oracle@rac10g01 .ssh]$ scp id_rsa.pub oracle@rac10g02:/home/oracle/
The authenticity of host 'rac10g02 (192.168.3.40)' can't be established.
RSA key fingerprint is 43:20:d8:f6:01:f1:e0:c0:9a:5f:6c:e2:f8:76:3e:3a.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'rac10g02,192.168.3.40' (RSA) to the list of known hosts.
oracle@rac10g02's password:
id_rsa.pub                      100%  225    0.2KB/s  00:00
[oracle@rac10g01 .ssh]$

rac10g02节点:
[oracle@rac10g02 ~]$ ssh-keygen -t rsa
Generating public/private rsa key pair.
Enter file in which to save the key (/home/oracle/.ssh/id_rsa):
Created directory '/home/oracle/.ssh'.
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /home/oracle/.ssh/id_rsa.
Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.2
The key fingerprint is:
cb:63:66:59:9d:7a:68:8f:4c:de:83:c4:f3:f4:19:97 oracle@rac10g02
[oracle@rac10g02 ~]$  cat  id_rsa.pub >> ./ssh/id_rsa.pub

[oracle@rac10g02 ~]$  mv ./ssh/id_rsa.pub  ./ssh/authorized_keys
[oracle@rac10g02 ~]$ scp ./ssh/authorized_keys oracle@rac10g01:/home/oracle/.ssh/

[oracle@rac10g01 .ssh]$ ssh rac10g01 date      --两边节点都要测试,必须通过
Sat Nov 12 22:39:54 CST 2016
[oracle@rac10g01 .ssh]$ ssh rac10g02 date
Sat Nov 12 22:40:03 CST 2016
[oracle@rac10g01 .ssh]$ ssh rac10g02-priv date
Sat Nov 12 22:40:07 CST 2016
[oracle@rac10g01 .ssh]$ ssh rac10g01-priv date
Sat Nov 12 22:40:04 CST 2016
[oracle@rac10g01 .ssh]$

11.添加本地磁盘,安装oracleasm软件,设置asm自动存储管理

[root@rac10g01 Desktop]# rpm -ivh oracleasm-support-2.1.7-1.el4.x86_64.rpm
Preparing...                ########################################### [100%]
  1:oracleasm-support      ########################################### [100%]
[root@rac10g01 Desktop]# rpm -ivh oracleasm-2.6.9-89.35.1.EL-2.0.5-1.el4.x86_64.rpm
Preparing...                ########################################### [100%]
  1:oracleasm-2.6.9-89.35.1########################################### [100%]
[root@rac10g01 Desktop]# rpm -ivh oracleasmlib-2.0.4-1.el4.x86_64.rpm
Preparing...                ########################################### [100%]
  1:oracleasmlib          ########################################### [100%]
[root@rac10g01 Desktop]# /etc/init.d/oracleasm configure
Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library
driver.  The following questions will determine whether the driver is
loaded on boot and what permissions it will have.  The current values
will be shown in brackets ('[]').  Hitting <ENTER> without typing an
answer will keep that current value.  Ctrl-C will abort.

Default user to own the driver interface [oracle]: oracle
Default group to own the driver interface [dba]: dba
Start Oracle ASM library driver on boot (y/n) [y]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
Initializing the Oracle ASMLib driver:                    [  OK  ]
Scanning the system for Oracle ASMLib disks:              [  OK  ]
[root@rac10g01 Desktop]# fdisk  /dev/sdb    --磁盘分区
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel. Changes will remain in memory only,
until you decide to write them. After that, of course, the previous
content won't be recoverable.
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
Command (m for help): n
Command action
  e  extended
  p  primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-130, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-130, default 130):
Using default value 130

Command (m for help): p

Disk /dev/sdb: 1073 MB, 1073741824 bytes
255 heads, 63 sectors/track, 130 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes

  Device Boot      Start        End      Blocks  Id  System
/dev/sdb1              1        130    1044193+  83  Linux

Command (m for help): w
The partition table has been altered!

Calling ioctl() to re-read partition table.
Syncing disks.
[root@rac10g01 ~]# raw /dev/raw/raw1 /dev/sdb1    --vote disk和crs磁盘使用的
/dev/raw/raw1:  bound to major 8, minor 17
[root@rac10g01 ~]# raw /dev/raw/raw2 /dev/sdc1
/dev/raw/raw2:  bound to major 8, minor 33
[root@rac10g01 ~]# raw /dev/raw/raw3 /dev/sdd1
/dev/raw/raw3:  bound to major 8, minor 49
[root@rac10g01 ~]# raw /dev/raw/raw4 /dev/sde1
/dev/raw/raw4:  bound to major 8, minor 65
[root@rac10g01 ~]# vim /etc/sysconfig/rawdevices
/dev/raw/raw1  /dev/sdb1
/dev/raw/raw2  /dev/sdc1
/dev/raw/raw3  /dev/sdd1
/dev/raw/raw4  /dev/sde1
[root@rac10g01 ~]# chown -R oracle:oinstall /dev/raw
[root@rac10g01 ~]# ll /dev/raw/raw*
crw-rw----  1 oracle oinstall 162, 1 Nov 13 00:49 /dev/raw/raw1
crw-rw----  1 oracle oinstall 162, 2 Nov 13 00:50 /dev/raw/raw2
crw-rw----  1 oracle oinstall 162, 3 Nov 13 00:50 /dev/raw/raw3
crw-rw----  1 oracle oinstall 162, 4 Nov 13 00:50 /dev/raw/raw4
[root@rac10g01 ~]# udevstart
[root@rac10g01 Desktop]# /etc/init.d/oracleasm  createdisk VOL05 /dev/sdf1      --其它盘都是一样的
Marking disk "VOL05" as an ASM disk:                      [  OK  ]
[root@rac10g01 Desktop]# /etc/init.d/oracleasm  createdisk VOL06 /dev/sdg1
Marking disk "VOL06" as an ASM disk:                      [  OK  ]
[root@rac10g01 Desktop]# /etc/init.d/oracleasm  listdisks
VOL05
VOL06
[root@rac10g01 Desktop]#

rac10g02节点:

[root@rac10g02 Desktop]# /etc/init.d/oracleasm  scandisks
Scanning the system for Oracle ASMLib disks:

[root@rac10g02 Desktop]# /etc/init.d/oracleasm  listdisks
VOL05
VOL06
[root@rac10g02 Desktop]#