开启辅助访问

Bo's Oracle Station

Bo's Oracle Station › 博客首页 ›Oracle技术› RAC真实应用集群 › 查看内容

【博客文章2024】教会新手：使用Dell Storage在Oracle Enterprise Linux 8.3中安装Oracle 19c RAC真实应用集群

2024-1-13 11:12| 发布者: admin| 查看: 113| 评论: 0

摘要: 通过本项目使新手掌握在Oracle Enterprise Linux 8.3环境下的Oracle 19c RAC安装配置；让新的Oracle数据库管理员为执行RAC/Grid Infrastructure管理任务打下坚实的基础；并提供所需的技术和技巧来设置Dell厂商的Disk Group并映射到ASM的Fail Group。

【博客文章2024】教会新手DBA：使用Dell Storage在Oracle Enterprise Linux 8.3中安装Oracle 19c RAC真实应用集群


Author： Bo Tang


 1.测试环境安装概览：


    通过这个项目，新手DBA将学习到如何安装和管理Oracle 19c集群套件（RAC软件和数据库的软件）、并且学会ASM在RAC中的部署：映射Dell厂商的存储设备的Disk Group概念到Oracle ASM的Fail Group。
    * 描述Oracle RAC 19c的安装过程
    * 执行RAC预安装任务
    * 执行集群件安装任务
    * 安装和配置Automatic Storage Management (ASM)
    * 安装Oracle数据库软件
    * 创建集群数据库
1.1真机测试环境概览：




1.2真机测试环境IP规划：

主机

操作系统

外网IP

内网IP

主机名

DNS/chronyd

RedHat Enterprise Linux 8.3 x86_64

172.25.250.254

无

classroom.lab.example.com

Oracle 19c RAC环境节点主机（第一台）

Oracle Enterprise Linux 8.3 x86_64

IP：172.25.250.x

VIP：172.25.250.x+200

 

SCAN-VIP1/2/3可能会存在于RAC的任意节点上：

SCAN-VIP1：172.25.250.x+100

SCAN-VIP2： 172.25.250.x+150

（x取值范围1到39)

第一张内网网卡（用于心跳和Flex ASM）172.31.118.x

（x取值范围1到39)

第二张内网网卡（用于心跳和Flex ASM）172.31.118.x+200
（x取值范围1到39)

stationx.lab.example.com

（x取值范围1到39)

Oracle 19c RAC环境节点主机（第二台）

同上

IP：172.25.250.x+1

VIP：172.25.250.x+201

 

SCAN-VIP1/2/3可能会存在于RAC的任意节点上：

SCAN-VIP3：172.25.250.x+101

（x取值范围1到39)

第一张内网网卡（用于心跳和Flex ASM）172.31.118.x

（x取值范围1到39)

第二张内网网卡（用于心跳和Flex ASM）172.31.118.200+x
（x取值范围1到39)

stationx+1.lab.example.com

（x取值范围1到39)



 2.测试环境周边支持系统的安装：


2.1真机测试环境DNS/chronyd服务器的安装：
1）可以使用RedHat/CentOS/Oracle Linux的7或8的任何版本进行安装。配置方法完全一样。
2）只需要1个网卡，该网卡连接外网switcher，IP地址为RAC的外网网段的某个地址。
3）所有超融合系统中的客户端都要以它作为DNS。所有RAC节点都要以它作为DNS和时间服务器。
4）它的硬件配置要求不需要很高。
下面使用一台2G内存/20G硬盘的虚拟机进行演示：






 


 


重启后接受licence。

 

 

2.1.1DNS软件包的安装：


[root@classroom ~]# mount /dev/cdromm /mnt
[root@classroom ~]# vim /etc/yum.repos.d/base.repo
[root@classroom ~]# cat /etc/yum.repos.d/base.repo
[BaseOS]
name=BaseOS
baseurl=file:///mnt/BaseOS
gpgcheck=0
[AppStream]
name=AppStream
baseurl=file:///mnt/AppStream
gpgcheck=0
[root@classroom ~]# yum -y install bind*
Failed to set locale, defaulting to C.UTF-8
Updating Subscription Management repositories.
Unable to read consumer identity
This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register.
Last metadata expiration check: 0:00:29 ago on Sun Jan  7 02:56:59 2024.
Package bind-export-libs-32:9.11.20-5.el8.x86_64 is already installed.
Package bind-libs-32:9.11.20-5.el8.x86_64 is already installed.
Package bind-libs-lite-32:9.11.20-5.el8.x86_64 is already installed.
Package bind-license-32:9.11.20-5.el8.noarch is already installed.
Package bind-utils-32:9.11.20-5.el8.x86_64 is already installed.
Dependencies resolved.
================================================================================
 Package                       Arch      Version             Repository    Size
================================================================================
Installing:
 bind                          x86_64    32:9.11.20-5.el8    AppStream    2.1 M
 bind-chroot                   x86_64    32:9.11.20-5.el8    AppStream    103 k
 bind-devel                    x86_64    32:9.11.20-5.el8    AppStream    176 k
 bind-export-devel             x86_64    32:9.11.20-5.el8    BaseOS       405 k
 bind-lite-devel               x86_64    32:9.11.20-5.el8    AppStream    398 k
 bind-pkcs11                   x86_64    32:9.11.20-5.el8    AppStream    390 k
 bind-pkcs11-devel             x86_64    32:9.11.20-5.el8    AppStream    114 k
 bind-pkcs11-libs              x86_64    32:9.11.20-5.el8    AppStream    1.1 M
 bind-pkcs11-utils             x86_64    32:9.11.20-5.el8    AppStream    259 k
 bind-sdb                      x86_64    32:9.11.20-5.el8    AppStream    450 k
 bind-sdb-chroot               x86_64    32:9.11.20-5.el8    AppStream    103 k
Installing dependencies:
 cmake-filesystem              x86_64    3.11.4-7.el8        AppStream     40 k
 keyutils-libs-devel           x86_64    1.5.10-6.el8        BaseOS        48 k
 krb5-devel                    x86_64    1.18.2-5.el8        BaseOS       558 k
 libcap-devel                  x86_64    2.26-4.el8          BaseOS        34 k
 libcom_err-devel              x86_64    1.45.6-1.el8        BaseOS        38 k
 libkadm5                      x86_64    1.18.2-5.el8        BaseOS       185 k
 libpq                         x86_64    12.4-1.el8_2        AppStream    195 k
 libselinux-devel              x86_64    2.9-3.el8           BaseOS       199 k
 libsepol-devel                x86_64    2.9-1.el8           BaseOS        86 k
 libverto-devel                x86_64    0.3.0-5.el8         BaseOS        18 k
 libxml2-devel                 x86_64    2.9.7-8.el8         AppStream    1.0 M
 mariadb-connector-c           x86_64    3.0.7-1.el8         AppStream    148 k
 mariadb-connector-c-config    noarch    3.0.7-1.el8         AppStream     13 k
 openssl-devel                 x86_64    1:1.1.1g-11.el8     BaseOS       2.3 M
 pcre2-devel                   x86_64    10.32-2.el8         BaseOS       605 k
 pcre2-utf16                   x86_64    10.32-2.el8         BaseOS       229 k
 pcre2-utf32                   x86_64    10.32-2.el8         BaseOS       220 k
 xz-devel                      x86_64    5.2.4-3.el8         BaseOS        62 k
 zlib-devel                    x86_64    1.2.11-16.el8_2     BaseOS        57 k
Transaction Summary
================================================================================
Install  30 Packages
Total size: 12 M
Installed size: 31 M
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Running scriptlet: mariadb-connector-c-3.0.7-1.el8.x86_64                 1/1
  Preparing        :                                                        1/1
  Installing       : bind-pkcs11-libs-32:9.11.20-5.el8.x86_64              1/30
  Running scriptlet: bind-32:9.11.20-5.el8.x86_64                          2/30
  Installing       : bind-32:9.11.20-5.el8.x86_64                          2/30
  Running scriptlet: bind-32:9.11.20-5.el8.x86_64                          2/30
  Installing       : zlib-devel-1.2.11-16.el8_2.x86_64                     3/30
  Installing       : mariadb-connector-c-config-3.0.7-1.el8.noarch         4/30
  Installing       : mariadb-connector-c-3.0.7-1.el8.x86_64                5/30
  Installing       : libpq-12.4-1.el8_2.x86_64                             6/30
  Installing       : bind-sdb-32:9.11.20-5.el8.x86_64                      7/30
  Running scriptlet: bind-sdb-32:9.11.20-5.el8.x86_64                      7/30
  Installing       : cmake-filesystem-3.11.4-7.el8.x86_64                  8/30
  Installing       : xz-devel-5.2.4-3.el8.x86_64                           9/30
  Installing       : libxml2-devel-2.9.7-8.el8.x86_64                     10/30
  Installing       : pcre2-utf32-10.32-2.el8.x86_64                       11/30
  Installing       : pcre2-utf16-10.32-2.el8.x86_64                       12/30
  Installing       : pcre2-devel-10.32-2.el8.x86_64                       13/30
  Installing       : libverto-devel-0.3.0-5.el8.x86_64                    14/30
  Installing       : libsepol-devel-2.9-1.el8.x86_64                      15/30
  Installing       : libselinux-devel-2.9-3.el8.x86_64                    16/30
  Installing       : libkadm5-1.18.2-5.el8.x86_64                         17/30
  Installing       : libcom_err-devel-1.45.6-1.el8.x86_64                 18/30
  Installing       : libcap-devel-2.26-4.el8.x86_64                       19/30
  Installing       : keyutils-libs-devel-1.5.10-6.el8.x86_64              20/30
  Installing       : krb5-devel-1.18.2-5.el8.x86_64                       21/30
  Installing       : openssl-devel-1:1.1.1g-11.el8.x86_64                 22/30
  Installing       : bind-lite-devel-32:9.11.20-5.el8.x86_64              23/30
  Installing       : bind-devel-32:9.11.20-5.el8.x86_64                   24/30
  Installing       : bind-pkcs11-devel-32:9.11.20-5.el8.x86_64            25/30
  Installing       : bind-export-devel-32:9.11.20-5.el8.x86_64            26/30
  Installing       : bind-sdb-chroot-32:9.11.20-5.el8.x86_64              27/30
  Running scriptlet: bind-sdb-chroot-32:9.11.20-5.el8.x86_64              27/30
  Installing       : bind-chroot-32:9.11.20-5.el8.x86_64                  28/30
  Running scriptlet: bind-chroot-32:9.11.20-5.el8.x86_64                  28/30
  Installing       : bind-pkcs11-32:9.11.20-5.el8.x86_64                  29/30
  Running scriptlet: bind-pkcs11-32:9.11.20-5.el8.x86_64                  29/30
  Installing       : bind-pkcs11-utils-32:9.11.20-5.el8.x86_64            30/30
  Running scriptlet: bind-sdb-chroot-32:9.11.20-5.el8.x86_64              30/30
  Running scriptlet: bind-chroot-32:9.11.20-5.el8.x86_64                  30/30
  Running scriptlet: bind-pkcs11-utils-32:9.11.20-5.el8.x86_64            30/30
  Verifying        : bind-export-devel-32:9.11.20-5.el8.x86_64             1/30
  Verifying        : keyutils-libs-devel-1.5.10-6.el8.x86_64               2/30
  Verifying        : krb5-devel-1.18.2-5.el8.x86_64                        3/30
  Verifying        : libcap-devel-2.26-4.el8.x86_64                        4/30
  Verifying        : libcom_err-devel-1.45.6-1.el8.x86_64                  5/30
  Verifying        : libkadm5-1.18.2-5.el8.x86_64                          6/30
  Verifying        : libselinux-devel-2.9-3.el8.x86_64                     7/30
  Verifying        : libsepol-devel-2.9-1.el8.x86_64                       8/30
  Verifying        : libverto-devel-0.3.0-5.el8.x86_64                     9/30
  Verifying        : openssl-devel-1:1.1.1g-11.el8.x86_64                 10/30
  Verifying        : pcre2-devel-10.32-2.el8.x86_64                       11/30
  Verifying        : pcre2-utf16-10.32-2.el8.x86_64                       12/30
  Verifying        : pcre2-utf32-10.32-2.el8.x86_64                       13/30
  Verifying        : xz-devel-5.2.4-3.el8.x86_64                          14/30
  Verifying        : zlib-devel-1.2.11-16.el8_2.x86_64                    15/30
  Verifying        : bind-32:9.11.20-5.el8.x86_64                         16/30
  Verifying        : bind-chroot-32:9.11.20-5.el8.x86_64                  17/30
  Verifying        : bind-devel-32:9.11.20-5.el8.x86_64                   18/30
  Verifying        : bind-lite-devel-32:9.11.20-5.el8.x86_64              19/30
  Verifying        : bind-pkcs11-32:9.11.20-5.el8.x86_64                  20/30
  Verifying        : bind-pkcs11-devel-32:9.11.20-5.el8.x86_64            21/30
  Verifying        : bind-pkcs11-libs-32:9.11.20-5.el8.x86_64             22/30
  Verifying        : bind-pkcs11-utils-32:9.11.20-5.el8.x86_64            23/30
  Verifying        : bind-sdb-32:9.11.20-5.el8.x86_64                     24/30
  Verifying        : bind-sdb-chroot-32:9.11.20-5.el8.x86_64              25/30
  Verifying        : cmake-filesystem-3.11.4-7.el8.x86_64                 26/30
  Verifying        : libpq-12.4-1.el8_2.x86_64                            27/30
  Verifying        : libxml2-devel-2.9.7-8.el8.x86_64                     28/30
  Verifying        : mariadb-connector-c-3.0.7-1.el8.x86_64               29/30
  Verifying        : mariadb-connector-c-config-3.0.7-1.el8.noarch        30/30
Installed products updated.
Installed:
  bind-32:9.11.20-5.el8.x86_64                                                 
  bind-chroot-32:9.11.20-5.el8.x86_64                                          
  bind-devel-32:9.11.20-5.el8.x86_64                                           
  bind-export-devel-32:9.11.20-5.el8.x86_64                                    
  bind-lite-devel-32:9.11.20-5.el8.x86_64                                      
  bind-pkcs11-32:9.11.20-5.el8.x86_64                                          
  bind-pkcs11-devel-32:9.11.20-5.el8.x86_64                                    
  bind-pkcs11-libs-32:9.11.20-5.el8.x86_64                                     
  bind-pkcs11-utils-32:9.11.20-5.el8.x86_64                                    
  bind-sdb-32:9.11.20-5.el8.x86_64                                             
  bind-sdb-chroot-32:9.11.20-5.el8.x86_64                                      
  cmake-filesystem-3.11.4-7.el8.x86_64                                         
  keyutils-libs-devel-1.5.10-6.el8.x86_64                                      
  krb5-devel-1.18.2-5.el8.x86_64                                               
  libcap-devel-2.26-4.el8.x86_64                                               
  libcom_err-devel-1.45.6-1.el8.x86_64                                         
  libkadm5-1.18.2-5.el8.x86_64                                                 
  libpq-12.4-1.el8_2.x86_64                                                    
  libselinux-devel-2.9-3.el8.x86_64                                            
  libsepol-devel-2.9-1.el8.x86_64                                              
  libverto-devel-0.3.0-5.el8.x86_64                                            
  libxml2-devel-2.9.7-8.el8.x86_64                                             
  mariadb-connector-c-3.0.7-1.el8.x86_64                                       
  mariadb-connector-c-config-3.0.7-1.el8.noarch                                
  openssl-devel-1:1.1.1g-11.el8.x86_64                                         
  pcre2-devel-10.32-2.el8.x86_64                                               
  pcre2-utf16-10.32-2.el8.x86_64                                               
  pcre2-utf32-10.32-2.el8.x86_64                                               
  xz-devel-5.2.4-3.el8.x86_64                                                  
  zlib-devel-1.2.11-16.el8_2.x86_64                                            
 
Complete!

 

2.1.2/etc/named.conf的配置：


# /etc/named.conf
#
# This file should be used for all classes except RH320.
# Replaces: named.conf-isolated, named.conf-internet
 
########################################################################
#
#   Define the location of the zone files, clean daily,
#   and possibly specify forwarders.
#
########################################################################
// Define ACL(s) here
acl exampleNetwork { 172.25.250.0/24; };
options {
// Where do our zone files live?
directory "/var/named";
 
cleaning-interval 1440;
// Use the ACL to say who can query us
allow-query { exampleNetwork; };
 
// Allow recursion for localnets( not really needed becauses of above )
allow-recursion { exampleNetwork; };
 
// Allow zone transfers only to exampleNetwork ACL
allow-transfer { exampleNetwork; };
 
// Blackhole illegal addresses commonly used for spoofing
// This is also redundant but we are showing off
 
// If you're behind a firewall but have Internet access, you
// might need to run DNS lookups through another name server
// that can see through it, to resolve outside hosts.
// The commented-out line below works for Meridian.
# forwarders { 192.168.22.250; };
 
// Get rid of annoying reminder of default that is, in fact, the
// opposite of what man named.conf would have you believe.
auth-nxdomain no;
};
// Magic to make rndc work
//include "/etc/rndc.key";
//controls {
// inet 127.0.0.1 allow { localhost; } keys { rndckey; };
//};
 
#########################################################################
#
#   Help out root nameservers; take responsibility for localhost.
#
#########################################################################
// file names are arbitrary and can be anything
// RFC 1033 uses .zone in their examples and so shall we
zone "localhost" {
type master;
file "named.localhost";
};
 
zone "0.0.127.in-addr.arpa" {
type master;
file "named.loopback";
};
 
########################################################################
#
#   Provide a hint to the root nameservers
#
########################################################################
 
zone "." {
type hint;
file "named.ca";
};
 
 
#########################################################################
#
#   Master nameserver for example.com and 192.168.0/24
#
#########################################################################
 
zone "lab.example.com" {
type master;
file "lab.example.com.zone";
// The forwarders line below turns off forwarding, if specified
// above, for delegated subdomains (domainXX.example.com, etc).
// (So we talk directly to the server for the zone we delegated,
// rather than asking the forwarder to do it for us.)
forwarders {};
};
 
zone "25.172.in-addr.arpa" {
type master;
file "172.25.zone";
forwarders {};
};
 
#########################################################################
#
#    Master nameserver for cracker.org and 192.168.1/24
#
#########################################################################


2.1.3/var/named/lab.example.com.zone的配置：


$TTL 86400  ; 1 Day ( we could have used 1D )
lab.example.com. IN  SOA classroom.lab.example.com. root.classroom.lab.example.com. (
2003040100 ; serial number
1H ; refresh slave
5M ; retry query
1W ; expire
1M ; negative TTL
)
 
@         IN  NS classroom.lab.example.com.
@         IN  MX   10  classroom.lab.example.com.
lab.example.com.                 IN  A 172.25.250.254
 
classroom.lab.example.com.              IN  A           172.25.250.254
station1 IN  A 172.25.250.1
station2         IN  A 172.25.250.2
scan1              IN  A 172.25.250.101
scan1         IN  A 172.25.250.102
scan1         IN  A 172.25.250.151
station3 IN  A 172.25.250.3
station4         IN  A 172.25.250.4
scan3              IN  A 172.25.250.103
scan3         IN  A 172.25.250.104
scan3         IN  A 172.25.250.153
station5 IN  A 172.25.250.5
station6         IN  A 172.25.250.6
scan5              IN  A 172.25.250.105
scan5         IN  A 172.25.250.106
scan5         IN  A 172.25.250.155
station7 IN  A 172.25.250.7
station8         IN  A 172.25.250.8
scan7              IN  A 172.25.250.107
scan7         IN  A 172.25.250.108
scan7         IN  A 172.25.250.157
station11 IN  A 172.25.250.11
station12         IN  A 172.25.250.12
scan11              IN  A 172.25.250.111
scan11         IN  A 172.25.250.112
scan11         IN  A 172.25.250.161
station13 IN  A 172.25.250.13
station14         IN  A 172.25.250.14
scan13              IN  A 172.25.250.113
scan13         IN  A 172.25.250.114
scan13         IN  A 172.25.250.163
station15 IN  A 172.25.250.15
station16         IN  A 172.25.250.16
scan15              IN  A 172.25.250.115
scan15                      IN  A 172.25.250.116
scan15         IN  A 172.25.250.165
station17 IN  A 172.25.250.17
station18         IN  A 172.25.250.18
scan17              IN  A 172.25.250.117
scan17                      IN  A 172.25.250.118
scan17         IN  A 172.25.250.167
station19 IN  A 172.25.250.19
station20         IN  A 172.25.250.20
scan19              IN  A 172.25.250.119
scan19                      IN  A 172.25.250.120
scan19         IN  A 172.25.250.169
station21 IN  A 172.25.250.21
station22         IN  A 172.25.250.22
scan21              IN  A 172.25.250.121
scan21                      IN  A 172.25.250.122
scan21         IN  A 172.25.250.171
 
 
gns.cluster1.lab.example.com.                    IN  A           172.25.250.152
cluster1.lab.example.com.                        IN  NS          gns.cluster1.lab.example.com.
gns.cluster3.lab.example.com.                    IN  A           172.25.250.154
cluster3.lab.example.com.                        IN  NS          gns.cluster3.lab.example.com.
gns.cluster5.lab.example.com.                    IN  A           172.25.250.156
cluster5.lab.example.com.                        IN  NS          gns.cluster5.lab.example.com.
gns.cluster7.lab.example.com.                    IN  A           172.25.250.158
cluster7.lab.example.com.                        IN  NS          gns.cluster7.lab.example.com.
gns.cluster9.lab.example.com.                    IN  A           172.25.250.160
cluster9.lab.example.com.                        IN  NS          gns.cluster9.lab.example.com.
gns.cluster11.lab.example.com.                    IN  A           172.25.250.162
cluster11.lab.example.com.                        IN  NS          gns.cluster11.lab.example.com.
gns.cluster13.lab.example.com.                    IN  A           172.25.250.164
cluster13.lab.example.com.                        IN  NS          gns.cluster13.lab.example.com.
gns.cluster15.lab.example.com.                    IN  A           172.25.250.166
cluster15.lab.example.com.                        IN  NS          gns.cluster15.lab.example.com.
gns.cluster17.lab.example.com.                    IN  A           172.25.250.168
cluster17.lab.example.com.                        IN  NS          gns.cluster17.lab.example.com.
gns.cluster19.lab.example.com.                    IN  A           172.25.250.170
cluster19.lab.example.com.                        IN  NS          gns.cluster19.lab.example.com.
gns.cluster21.lab.example.com.                    IN  A           172.25.250.172
cluster21.lab.example.com.                        IN  NS          gns.cluster21.lab.example.com.

 

2.1.4/var/named/172.25.zone的配置：


$TTL 86400
@ IN  SOA classroom.lab.example.com. root.classroom.lab.example.com. ( 4 10800 3600 604800 0 )
 
  IN  NS  classroom.lab.example.com.
 
254.250.25.172.IN-ADDR.ARPA.    IN  PTR   classroom.lab.example.com.
1.250.25.172.IN-ADDR.ARPA.               IN  PTR   station1.lab.example.com.
2.250.25.172.IN-ADDR.ARPA.                IN  PTR   station2.lab.example.com.
101.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan1.lab.example.com.
102.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan1.lab.example.com.
151.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan1.lab.example.com.
3.250.25.172.IN-ADDR.ARPA.                IN  PTR   station3.lab.example.com.
4.250.25.172.IN-ADDR.ARPA.                IN  PTR   station4.lab.example.com.
103.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan3.lab.example.com.
104.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan3.lab.example.com.
153.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan3.lab.example.com.
5.250.25.172.IN-ADDR.ARPA.                IN  PTR   station5.lab.example.com.
6.250.25.172.IN-ADDR.ARPA.                IN  PTR   station6.lab.example.com.
105.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan5.lab.example.com.
106.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan5.lab.example.com.
155.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan5.lab.example.com.
7.250.25.172.IN-ADDR.ARPA.                IN  PTR   station7.lab.example.com.
8.250.25.172.IN-ADDR.ARPA.                IN  PTR   station8.lab.example.com.
107.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan7.lab.example.com.
108.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan7.lab.example.com.
157.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan7.lab.example.com.
11.250.25.172.IN-ADDR.ARPA.                IN  PTR   station11.lab.example.com.
12.250.25.172.IN-ADDR.ARPA.                IN  PTR   station12.lab.example.com.
111.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan11.lab.example.com.
112.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan11.lab.example.com.
161.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan11.lab.example.com.
13.250.25.172.IN-ADDR.ARPA.                IN  PTR   station13.lab.example.com.
14.250.25.172.IN-ADDR.ARPA.                IN  PTR   station14.lab.example.com.
113.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan13.lab.example.com.
114.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan13.lab.example.com.
163.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan13.lab.example.com.
15.250.25.172.IN-ADDR.ARPA.                IN  PTR   station15.lab.example.com.
16.250.25.172.IN-ADDR.ARPA.                IN  PTR   station16.lab.example.com.
115.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan15.lab.example.com.
116.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan15.lab.example.com.
165.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan15.lab.example.com.
17.250.25.172.IN-ADDR.ARPA.                IN  PTR   station17.lab.example.com.
18.250.25.172.IN-ADDR.ARPA.                IN  PTR   station18.lab.example.com.
117.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan17.lab.example.com.
118.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan17.lab.example.com.
167.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan17.lab.example.com.
19.250.25.172.IN-ADDR.ARPA.                IN  PTR   station19.lab.example.com.
20.250.25.172.IN-ADDR.ARPA.                IN  PTR   station20.lab.example.com.
119.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan19.lab.example.com.
120.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan19.lab.example.com.
169.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan19.lab.example.com.
21.250.25.172.IN-ADDR.ARPA.                IN  PTR   station21.lab.example.com.
22.250.25.172.IN-ADDR.ARPA.                IN  PTR   station22.lab.example.com.
121.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan21.lab.example.com.
122.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan21.lab.example.com.
171.250.25.172.IN-ADDR.ARPA.              IN  PTR   scan21.lab.example.com.
 
cluster1.lab.example.com.        IN  NS    gns.cluster1.lab.example.com.
152.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster1.lab.example.com.
 
cluster3.lab.example.com.        IN  NS    gns.cluster3.lab.example.com.
154.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster3.lab.example.com.
 
cluster5.lab.example.com.        IN  NS    gns.cluster5.lab.example.com.
156.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster5.lab.example.com.
 
cluster7.lab.example.com.        IN  NS    gns.cluster7.lab.example.com.
158.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster7.lab.example.com.
 
cluster11.lab.example.com.        IN  NS    gns.cluster11.lab.example.com.
162.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster11.lab.example.com.
 
cluster13.lab.example.com.        IN  NS    gns.cluster13.lab.example.com.
164.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster13.lab.example.com.
 
cluster15.lab.example.com.        IN  NS    gns.cluster15.lab.example.com.
166.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster15.lab.example.com.
 
cluster17.lab.example.com.        IN  NS    gns.cluster17.lab.example.com.
168.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster17.lab.example.com.
 
cluster19.lab.example.com.        IN  NS    gns.cluster19.lab.example.com.
170.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster19.lab.example.com.
 
cluster21.lab.example.com.        IN  NS    gns.cluster21.lab.example.com.
172.250.25.172.IN-ADDR.ARPA.              IN  PTR   gns.cluster21.lab.example.com.


最后要启动named服务，配置firewall（或者关闭firewall）。

 2.2 时间服务器/etc/chrony.conf的配置：


# Use public servers from the pool.ntp.org project.
# Please consider joining the pool (http://www.pool.ntp.org/join.html).
#pool 2.rhel.pool.ntp.org iburst
 
# Record the rate at which the system clock gains/losses time.
driftfile /var/lib/chrony/drift
 
# Allow the system clock to be stepped in the first three updates
# if its offset is larger than 1 second.
makestep 1.0 3
 
# Enable kernel synchronization of the real-time clock (RTC).
rtcsync
 
# Enable hardware timestamping on all interfaces that support it.
#hwtimestamp *
 
# Increase the minimum number of selectable sources required to adjust
# the system clock.
#minsources 2
 
# Allow NTP client access from local network.
allow 172.25.0.0/16
 
# Serve time even if not synchronized to a time source.
local stratum 10
 
# Specify file containing keys for NTP authentication.
keyfile /etc/chrony.keys
 
# Get TAI-UTC offset and leap seconds from the system tz database.
leapsectz right/UTC
 
# Specify directory for log files.
logdir /var/log/chrony
 
# Select which information is logged.
#log measurements statistics tracking


最后要启动chrony服务，配置firewall（或者关闭firewall）。 

3. RAC节点：

3.1 RAC节点操作系统（Oracle Enterprise Linux8.3）：

下载链接:https://caiyun.139.com/m/i?135ClLu8DwM6g

提取码:L573 

使用VMware Workstation 17或以上版本打开（虚拟机来源问题选择“移动”，而不是“复制”），这台机器的IP为172.25.250.254（可能要在推送完成过程中，短暂关闭《1.3-1.4》中我们自己安装的172.25.250.254）。

所有RAC节点的外网网卡（第一张网卡的mac地址收集好，根据《1.2真机测试环境IP规划》，填写这台VMware机器的/etc/dhcp/dhcpd.conf，并systemctl restart dhcpd）。


option space PXE;
option PXE.mtftp-ip  code 1 = ip-address;
option PXE.mtftp-cport code 2 = unsigned integer 16;
option PXE.mtftp-sport code 3 = unsigned integer 16;
option PXE.mtftp-tmout code 4 = unsigned integer 8;
option PXE.mtftp-delay code 5 = unsigned integer 8;
option arch code 93 = unsigned integer 16; # RFC4578
allow booting;
allow bootp;
authoritative;
ddns-update-style none;
ignore client-updates;
one-lease-per-client true;
ddns-update-style none;
subnet 172.25.0.0 netmask 255.255.0.0 {
 
        option routers 172.25.250.254;
        option subnet-mask 255.255.0.0;
        option domain-name "lab.example.com";
        option domain-name-servers 172.25.250.254;
        default-lease-time 21600;
        max-lease-time 43200;
 
        pool {
                allow unknown-clients;
                range 172.25.250.101 172.25.250.252;
        }
        # static IPs are assigned below
        pool {
                deny  unknown-clients;
                range  172.25.250.1 172.25.250.99;
        }
 
        class "PXE" {
        match if substring(option vendor-class-identifier, 0, 9) = "PXEClient";
        next-server 172.25.250.254;
        if option arch = 00:07 {
           filename "/BOOTX64.EFI";
           } else {
           filename "/pxelinux.0";
           }
        } 
 
 
 host station11 {
                 hardware ethernet 52:54:00:a3:7e:94 ;
                 fixed-address  172.25.250.11;
 }
 host station12 {
                 hardware ethernet 52:54:00:73:ce:14 ;
                 fixed-address  172.25.250.12;
 }
 host station61 {
                 hardware ethernet 52:54:00:fc:5a:de ;
                 fixed-address  172.25.250.61;
 }
}


3.1.1BIOS型的RAC节点推送安装基本操作系统：


 


 

3.1.2UEFI型的RAC节点推送安装基本操作系统：





3.1.3BIOS型的RAC节点手动安装基本操作系统参考配置：

 

http://172.25.250.254/pub/RAC19clab-oel8.cfg

 

3.1.4UEFI型的RAC节点手动安装基本操作系统参考配置：

 

http://172.25.250.254/pub/RAC19clab-oel8-efi.cfg


3.2RAC节点时间客户端/etc/chrony.conf的配置： 


server 172.25.250.254 iburst driftfile /var/lib/chrony/drift makestep 1.0 3 rtcsync logdir /var/log/chrony


 4.真机测试环境最重要的硬件---磁盘阵列配置：


1）在RAC的第一个节点上，连接好通向磁盘阵列的HBA线（两根）。安装好厂商的软件。运行：

 

[root@station1 ~]#/opt/dell/mdstoragesoftware/mdstoragemanager/client/SMclient


会发现设备，即图中的“Discovered Storage Array(1)-Storage Array MD3200”,双击它。

2）弹出“MD3200-PowerVault MD Storage Manager （Array Management)”窗口。点击“Hardware”选项卡。观察一下硬件概况。



3)点击“Host Mappings”选项卡。在“Default Group”处右击。定义Host:



4）输入Host name，比如“RAC”，点击“Next”：



5）依次添加所有的“known unassociated host port identifier”，分别给这些port命名为PORT1/PORT2/PORT3和PORT4，之后点击“Next”：





6）在“Host type(operating system)”处选择“Linux(DM-MP)”，点击“Next”：




7）务必要选中“Yes-this host will share access to the same virtual disks with other hosts.”，点击“Next”:

 


8）填写Host group的名字，并通过点击”Finish”确认并完成Host mapping的配置：



 


9)点击“Storage & Copy Services”选项卡。在“Create Disk Group”处右击。定义厂商的Disk group:



10)选择“Manual(Advanced):Choose specific”：

 


11)创建3个厂商的Disk group，都是RAID0。分别叫做“DISKGROUP1”、“DISKGROUP2”和“DISKGROUP3”，他们中的“Virtual Disk”分别可以对应ASM中的FAILGROUP1，FAILGROUP2和FAILGROUP3。ASM Normal和Flex冗余度的磁盘组需要最少3个FAILGROUP：



点击“Calculate Capacity”才能继续：



接着创建其中的“Virtual Disk”：


 

 

 


 


5.RAC节点Multipath的配置：



[root@station1 ~]# cat /proc/partitions

major minor  #blocks  name

 

   8        0  292421632 sda

   8        1     307200 sda1

   8        2   96361472 sda2

   8        3    4194304 sda3

   8        4  191557632 sda4

   8       16  145752064 sdb

   8       32  145752064 sdc

   8       48  145752064 sdd

   8      128  145752064 sdi

   8       96  145752064 sdg

   8       64  145752064 sde

   8       80  145752064 sdf

   8      144  145752064 sdj

   8      112  145752064 sdh

   8      160  145752064 sdk

   8      176  145752064 sdl

   8      208  145752064 sdn

   8      192  145752064 sdm

   8      224  145752064 sdo

   8      240  145752064 sdp

  65        0  145752064 sdq

  65       16  145752064 sdr

  65       32  145752064 sds

  65       48  145752064 sdt

  65       64  145752064 sdu

  65       80  145752064 sdv

  65       96  145752064 sdw

  65      112  145752064 sdx

  65      128  145752064 sdy

  11        0    1048575 sr0

 252        0  145752064 dm-0

 252        1  145752064 dm-1

 252        2  145752064 dm-2

 252        3  145752064 dm-3

 252        4  145752064 dm-4

 252        5  145752064 dm-5

 252        6  145752064 dm-6

 252        7  145752064 dm-7

 252        8  145752064 dm-8

 252        9  145752064 dm-9

 252       10  145752064 dm-10

 252       11  145752064 dm-11

 

[root@station1 ~]# cd /dev/mapper/

[root@station1 mapper]# ls

control

[root@station1 mapper]# multipath

Jan 10 03:56:48 | /etc/multipath.conf does not exist, blacklisting all devices.

Jan 10 03:56:48 | You can run "/sbin/mpathconf --enable" to create

Jan 10 03:56:48 | /etc/multipath.conf. See man mpathconf(8) for more details

Jan 10 03:56:48 | DM multipath kernel driver not loaded

 

[root@station1 mapper]# /sbin/mpathconf --enable

[root@station1 mapper]# multipath -ll

[root@station1 mapper]# systemctl start multipathd

[root@station1 mapper]# systemctl enable multipathd

 

[root@station1 mapper]# multipath -ll

mpathe (36c81f66000c8c49f00000bce65a0f35a) dm-4 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:2  sdp 8:240  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:2  sdd 8:48   active ready running

mpathd (36c81f66000c8c496000008d365a0fe6f) dm-3 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:11 sdm 8:192  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:11 sdy 65:128 active ready running

mpathc (36c81f66000c8c49f00000bd665a0f471) dm-2 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:10 sdx 65:112 active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:10 sdl 8:176  active ready running

mpathb (36c81f66000c8c496000008ce65a0fd23) dm-1 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:1  sdc 8:32   active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:1  sdo 8:224  active ready running

mpatha (36c81f66000c8c49f00000bcc65a0f323) dm-0 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:0  sdn 8:208  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:0  sdb 8:16   active ready running

mpathl (36c81f66000c8c496000008d265a0fe3b) dm-11 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:9  sdk 8:160  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:9  sdw 65:96  active ready running

mpathk (36c81f66000c8c49f00000bd465a0f44a) dm-10 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:8  sdv 65:80  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:8  sdj 8:144  active ready running

mpathj (36c81f66000c8c496000008d165a0fdd9) dm-9 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:7  sdi 8:128  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:7  sdu 65:64  active ready running

mpathi (36c81f66000c8c49f00000bd265a0f3e1) dm-8 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:6  sdt 65:48  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:6  sdh 8:112  active ready running

mpathh (36c81f66000c8c496000008d065a0fdae) dm-7 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:5  sdg 8:96   active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:5  sds 65:32  active ready running

mpathg (36c81f66000c8c49f00000bd065a0f3b9) dm-6 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:1:4  sdr 65:16  active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:0:4  sdf 8:80   active ready running

mpathf (36c81f66000c8c496000008cf65a0fd54) dm-5 DELL,MD32xx

size=139G features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw

|-+- policy='service-time 0' prio=14 status=active

| `- 1:0:0:3  sde 8:64   active ready running

`-+- policy='service-time 0' prio=9 status=enabled

  `- 1:0:1:3  sdq 65:0   active ready running

 

 

[root@station1 mapper]# systemctl enable multipathd

[root@station1 mapper]# ls

control  mpatha  mpathb  mpathc  mpathd  mpathe  mpathf  mpathg  mpathh  mpathi  mpathj  mpathk  mpathl

 

[root@station1 mapper]# lsscsi -g

[0:2:0:0]    disk    DELL     PERC H710        3.13  /dev/sda   /dev/sg0

[1:0:0:0]    disk    DELL     MD32xx           0784  /dev/sdb   /dev/sg1

[1:0:0:1]    disk    DELL     MD32xx           0784  /dev/sdc   /dev/sg2

[1:0:0:2]    disk    DELL     MD32xx           0784  /dev/sdd   /dev/sg3

[1:0:0:3]    disk    DELL     MD32xx           0784  /dev/sde   /dev/sg4

[1:0:0:4]    disk    DELL     MD32xx           0784  /dev/sdf   /dev/sg5

[1:0:0:5]    disk    DELL     MD32xx           0784  /dev/sdg   /dev/sg6

[1:0:0:6]    disk    DELL     MD32xx           0784  /dev/sdh   /dev/sg7

[1:0:0:7]    disk    DELL     MD32xx           0784  /dev/sdi   /dev/sg8

[1:0:0:8]    disk    DELL     MD32xx           0784  /dev/sdj   /dev/sg9

[1:0:0:9]    disk    DELL     MD32xx           0784  /dev/sdk   /dev/sg10

[1:0:0:10]   disk    DELL     MD32xx           0784  /dev/sdl   /dev/sg11

[1:0:0:11]   disk    DELL     MD32xx           0784  /dev/sdm   /dev/sg12

[1:0:0:31]   disk    DELL     Universal Xport  0784  -          /dev/sg13

[1:0:1:0]    disk    DELL     MD32xx           0784  /dev/sdn   /dev/sg14

[1:0:1:1]    disk    DELL     MD32xx           0784  /dev/sdo   /dev/sg15

[1:0:1:2]    disk    DELL     MD32xx           0784  /dev/sdp   /dev/sg16

[1:0:1:3]    disk    DELL     MD32xx           0784  /dev/sdq   /dev/sg17

[1:0:1:4]    disk    DELL     MD32xx           0784  /dev/sdr   /dev/sg18

[1:0:1:5]    disk    DELL     MD32xx           0784  /dev/sds   /dev/sg19

[1:0:1:6]    disk    DELL     MD32xx           0784  /dev/sdt   /dev/sg20

[1:0:1:7]    disk    DELL     MD32xx           0784  /dev/sdu   /dev/sg21

[1:0:1:8]    disk    DELL     MD32xx           0784  /dev/sdv   /dev/sg22

[1:0:1:9]    disk    DELL     MD32xx           0784  /dev/sdw   /dev/sg23

[1:0:1:10]   disk    DELL     MD32xx           0784  /dev/sdx   /dev/sg24

[1:0:1:11]   disk    DELL     MD32xx           0784  /dev/sdy   /dev/sg25

[1:0:1:31]   disk    DELL     Universal Xport  0784  -          /dev/sg26

[6:0:0:0]    cd/dvd  HL-DT-ST DVD-ROM DU90N    D300  /dev/sr0   /dev/sg27


根据“mutlipath -ll”的输出和“lsscsi -g”的输出，确认mpath*对应的厂商的DISKGROUP，进而确认ASM的FAILGROUP：


 

mpatha/mpathb/mpathe/mpathf为一个FAILGROUP

mpathc/mpathd/mpathk/mpathl为一个FAILGROUP

mpathg/mpathh/mpathi/mpathj为一个FAILGROUP


6.RAC节点操作系统（Oracle Enterprise Linux 8.3）上安装Oracle Database 19c的注意事项：


6.1oracleasm的配置：

在第一个节点上：

 

[root@station1 ~]# oracleasm configure -i

Configuring the Oracle ASM library driver.

 

This will configure the on-boot properties of the Oracle ASM library

driver.  The following questions will determine whether the driver is

loaded on boot and what permissions it will have.  The current values

will be shown in brackets ('[]').  Hitting without typing an

answer will keep that current value.  Ctrl-C will abort.

 

Default user to own the driver interface [grid]:

Default group to own the driver interface [asmadmin]:

Start Oracle ASM library driver on boot (y/n) [y]:

Scan for Oracle ASM disks on boot (y/n) [y]:

Writing Oracle ASM library driver configuration: done

[root@station1 ~]# oracleasm init

[root@station1 ~]# systemctl enable oracleasm

Synchronizing state of oracleasm.service with SysV service script with /usr/lib/systemd/systemd-sysv-install.

Executing: /usr/lib/systemd/systemd-sysv-install enable oracleasm

[root@station1 ~]# systemctl  start  oracleasm

root@station1 mapper]# oracleasm createdisk RACDISK01 /dev/mapper/mpatha

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK02 /dev/mapper/mpathb

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK03 /dev/mapper/mpathe

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK04 /dev/mapper/mpathf

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK05 /dev/mapper/mpathc

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK06 /dev/mapper/mpathd

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK07 /dev/mapper/mpathk

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK08 /dev/mapper/mpathl

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK09 /dev/mapper/mpathg

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK10 /dev/mapper/mpathh

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK11 /dev/mapper/mpathi

Writing disk header: done

Instantiating disk: done

[root@station1 mapper]# oracleasm createdisk RACDISK12 /dev/mapper/mpathj

Writing disk header: done

Instantiating disk: done


在第二个节点上：

 

[root@station2 ~]# oracleasm configure -i

Configuring the Oracle ASM library driver.

 

This will configure the on-boot properties of the Oracle ASM library

driver.  The following questions will determine whether the driver is

loaded on boot and what permissions it will have.  The current values

will be shown in brackets ('[]').  Hitting without typing an

answer will keep that current value.  Ctrl-C will abort.

 

Default user to own the driver interface [grid]:

Default group to own the driver interface [asmadmin]:

Start Oracle ASM library driver on boot (y/n) [y]:

Scan for Oracle ASM disks on boot (y/n) [y]:

Writing Oracle ASM library driver configuration: done

[root@station2 ~]# oracleasm init

[root@station2 ~]# systemctl enable oracleasm

Synchronizing state of oracleasm.service with SysV service script with /usr/lib/systemd/systemd-sysv-install.

Executing: /usr/lib/systemd/systemd-sysv-install enable oracleasm

[root@station2 ~]# systemctl  start  oracleasm

[root@station2 ~]# oracleasm scandisks

Reloading disk partitions: done

Cleaning any stale ASM disks...

Scanning system for ASM disks...

Instantiating disk "RACDISK01"

Instantiating disk "RACDISK02"

Instantiating disk "RACDISK05"

Instantiating disk "RACDISK07"

Instantiating disk "RACDISK06"

Instantiating disk "RACDISK08"

Instantiating disk "RACDISK09"

Instantiating disk "RACDISK11"

Instantiating disk "RACDISK10"

Instantiating disk "RACDISK12"

Instantiating disk "RACDISK04"

Instantiating disk "RACDISK03"

[root@station2 ~]# oracleasm-discover

Using ASMLib from /opt/oracle/extapi/64/asm/orcl/1/libasm.so

[ASM Library - Generic Linux, version 2.0.17 (KABI_V2)]

Discovered disk: ORCL:RACDISK01 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK02 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK03 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK04 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK05 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK06 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK07 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK08 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK09 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK10 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK11 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]

Discovered disk: ORCL:RACDISK12 [291504128 blocks (149250113536 bytes), maxio 512, integrity none]


6.2所有节点上/usr/bin/scp的配置：

 

[root@station1 ~]# mv /usr/bin/scp /usr/bin/scp.ori

[root@station1 ~]# vim /usr/bin/scp

[root@station1 ~]# cat /usr/bin/scp

/usr/bin/scp.ori -T $*

[root@station2 ~]# mv /usr/bin/scp /usr/bin/scp.ori

[root@station1 ~]# vim /usr/bin/scp

[root@station1 ~]# cat /usr/bin/scp

/usr/bin/scp.ori -T $*

 

6.3 cvu的配置：

必须去掉/u01/app/19.3.0/grid/cv/admin/cvu_config和/u01/app/oracle/product/19.3.0/dbhome_1/cv/admin/cvu_config第20行的注释。

 

 Fallback to this distribution id

CV_ASSUME_DISTID=OEL5

 

6.4 多内网网卡配置：

必须根据内网网卡的接口名称，配置/etc/sysctl.conf：

 

 [root@station1 ~]# nmcli dev status
DEVICE      TYPE      STATE                   CONNECTION

eno1        ethernet  connected               eno1       

eno2        ethernet  connected               eno2       

eno3        ethernet  connected               eno3       

eno4        ethernet  connected               eno4       

virbr0      bridge    connected (externally)  virbr0     

lo          loopback  unmanaged               --         

virbr0-nic  tun       unmanaged               --  

[root@station1 ~]# cat /etc/sysctl.conf

# sysctl settings are defined through files in

# /usr/lib/sysctl.d/, /run/sysctl.d/, and /etc/sysctl.d/.

#

# Vendors settings live in /usr/lib/sysctl.d/.

# To override a whole file, create a new file with the same in

# /etc/sysctl.d/ and put new settings there. To override

# only specific settings, add a file with a lexically later

# name in /etc/sysctl.d/ and put new settings there.

#

# For more information, see sysctl.conf(5) and sysctl.d(5).

fs.file-max = 6815744

kernel.sem = 250 32000 100 128

kernel.shmall = 89335319756

kernel.shmmni = 4096

net.core.rmem_default=4194304

net.core.rmem_max=4194304

net.core.wmem_default=1048576

net.core.wmem_max=1048576

net.ipv4.ip_local_port_range = 11000 65000

fs.aio-max-nr = 1048576

kernel.shmmax = 89335319756

net.ipv4.conf.eno2.rp_filter= 2

net.ipv4.conf.eno3.rp_filter= 2


6.5 ntp的报错忽略：

不管在grid还是在oracle安装过程中，在Enterprise Linux 8中都会报告ntp错误。

6.6 解压缩在安装位置：

 

[grid@station1 grid]$ pwd
/u01/app/19.3.0/grid
[grid@station1 grid]$ unzip  /stage/19c/GRID/V982068-01.zip
[oracle@station1 dbhome_1]$ pwd
/u01/app/oracle/product/19.3.0/dbhome_1

[oracle@station1 dbhome_1]$ unzip /stage/19c/DATABASE/V982063-01.zip

 

6.7 /etc/hosts描述vip： 


127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
172.25.250.1   station1.lab.example.com  station1
172.25.250.2   station2.lab.example.com  station2
172.25.250.201   station1-vip.lab.example.com  station1-vip
172.25.250.202   station2-vip.lab.example.com  station2-vip
172.31.118.1   station1-priv.lab.example.com  station1-priv
172.31.118.2   station2-priv.lab.example.com  station2-priv
172.25.250.3   station3.lab.example.com  station3
172.25.250.4   station4.lab.example.com  station4
172.25.250.203   station3-vip.lab.example.com  station3-vip
172.25.250.204   station4-vip.lab.example.com  station4-vip
172.31.118.3   station3-priv.lab.example.com  station3-priv
172.31.118.4   station4-priv.lab.example.com  station4-priv
172.25.250.5   station5.lab.example.com  station5
172.25.250.6   station6.lab.example.com  station6
172.25.250.205   station5-vip.lab.example.com  station5-vip
172.25.250.206   station6-vip.lab.example.com  station6-vip
172.31.118.5   station5-priv.lab.example.com  station5-priv
172.31.118.6   station6-priv.lab.example.com  station6-priv
172.25.250.7   station7.lab.example.com  station7
172.25.250.8   station8.lab.example.com  station8
172.25.250.207   station7-vip.lab.example.com  station7-vip
172.25.250.208   station8-vip.lab.example.com  station8-vip
172.31.118.7   station7-priv.lab.example.com  station7-priv
172.31.118.8   station8-priv.lab.example.com  station8-priv
172.25.250.9   station9.lab.example.com  station9
172.25.250.10   station10.lab.example.com  station10
172.25.250.209   station9-vip.lab.example.com  station9-vip
172.25.250.210   station10-vip.lab.example.com  station10-vip
172.31.118.9   station9-priv.lab.example.com  station9-priv
172.31.118.10   station10-priv.lab.example.com  station10-priv
172.25.250.11   station11.lab.example.com  station11
172.25.250.12   station12.lab.example.com  station12
172.25.250.211   station11-vip.lab.example.com  station11-vip
172.25.250.212   station12-vip.lab.example.com  station12-vip
172.31.118.11   station11-priv.lab.example.com  station11-priv
172.31.118.12   station12-priv.lab.example.com  station12-priv

  

7.RAC节点（Oracle Enterprise Linux 8.3）上安装Oracle Database 19c的过程：

 






















 之后的截图以及以oracle用户安装数据库软件、建库的截图略。

 


 


路过
雷人
握手
鲜花
鸡蛋
收藏 邀请
上一篇：【博客文章2023】Oracle MAA架构不停机滚动升级：physru.sh方式 v.s. dbms_rolling方式（以18c升级19c为例）

QQ|手机版|Bo's Oracle Station   

GMT+8, 2024-2-23 09:06 , Processed in 0.041104 second(s), 21 queries .

返回顶部