设为首页收藏本站

Botang唐波's Oracle Station

查看: 942|回复: 2

求助_oracle11.2.0.4 rac asm双存储镜像故障

[复制链接]

1

主题

2

帖子

833

积分

高级会员

Rank: 4

积分
833
发表于 2016-9-1 21:14:16 | 显示全部楼层 |阅读模式
本帖最后由 slz 于 2016-9-1 21:15 编辑

生产环境:
两台hp580 G9和两台vnx5600存储分别部署在园区两个机房。每个机房部署两台博科300B光纤交换,机房之间通过单模光纤级联。
系统安装oracle Linux6.5 x64 数据库版本11.2.0.4
现在出现的问题是随便一个机房存储断电,群集过会就会宕机,业务无法访问。查看日志是votedisk出现问题(每台存储分别划出3个lun通过normal模式镜像)。
请问大神仲裁要如何设置才正确,要怎么划分FAILGROUP,或者是什么参数要设?

MWIJFTL39]TZ$_9]~NI8.png
回复

使用道具 举报

1

主题

2

帖子

833

积分

高级会员

Rank: 4

积分
833
 楼主| 发表于 2016-9-1 22:29:48 | 显示全部楼层
日志信息
2016-09-01 18:28:56.746:
[client(32279)]CRS-4743:File /home/app/grid/product/11.2.0/grid/oc4j/j2ee/home/OC4J_DBWLM_config/system-jazn-data.xml was updated from OCR(Size: 13365(New), 13378(Old) bytes)
2016-09-01 18:32:11.052:
[cssd(25117)]CRS-1612:Network communication with node his2 (2) missing for 50% of timeout interval.  Removal of this node from cluster in 14.810 seconds
2016-09-01 18:32:19.054:
[cssd(25117)]CRS-1611:Network communication with node his2 (2) missing for 75% of timeout interval.  Removal of this node from cluster in 6.810 seconds
2016-09-01 18:32:23.054:
[cssd(25117)]CRS-1610:Network communication with node his2 (2) missing for 90% of timeout interval.  Removal of this node from cluster in 2.810 seconds
2016-09-01 18:32:25.867:
[cssd(25117)]CRS-1632:Node his2 is being removed from the cluster in cluster incarnation 368159303
2016-09-01 18:32:25.877:
[cssd(25117)]CRS-1601:CSSD Reconfiguration complete. Active nodes are his1 .
2016-09-01 18:32:25.879:
[crsd(27039)]CRS-5504:Node down event reported for node 'his2'.
2016-09-01 18:32:25.892:
[crsd(27039)]CRS-2773:Server 'his2' has been removed from pool 'Generic'.
2016-09-01 18:32:25.892:
[crsd(27039)]CRS-2773:Server 'his2' has been removed from pool 'ora.crds3db'.
2016-09-01 18:32:25.893:
[crsd(27039)]CRS-2773:Server 'his2' has been removed from pool 'ora.crds3db_crds3db_taf'.
2016-09-01 18:32:26.190:
[ctssd(26846)]CRS-2407:The new Cluster Time Synchronization Service reference node is host his1.
2016-09-01 18:39:05.461:
[cssd(25117)]CRS-1601:CSSD Reconfiguration complete. Active nodes are his1 his2 .
2016-09-01 18:39:53.317:
[crsd(27039)]CRS-2772:Server 'his2' has been assigned to pool 'Generic'.
2016-09-01 18:39:53.317:
[crsd(27039)]CRS-2772:Server 'his2' has been assigned to pool 'ora.crds3db'.
2016-09-01 18:39:53.318:
[crsd(27039)]CRS-2772:Server 'his2' has been assigned to pool 'ora.crds3db_crds3db_taf'.
2016-09-01 18:42:39.659:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A1; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:39.659:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A1; details at (:CSSNM00059 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:39.659:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:39.659:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00059 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:40.660:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:40.660:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A1; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:44.661:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:49.662:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:54.663:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:42:59.664:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060 in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:04.665:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:09.666:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:14.667:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:19.668:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:24.669:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:29.670:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:33.671:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:38.672:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:43.674:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:48.675:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:53.676:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:43:57.674:
[cssd(25117)]CRS-1615:No I/O has completed after 50% of the maximum interval. Voting file ORCL:ORACRS01A1 will be considered not functional in 99630 milliseconds
2016-09-01 18:43:58.677:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:02.675:
[cssd(25117)]CRS-1615:No I/O has completed after 50% of the maximum interval. Voting file ORCL:ORACRS01A2 will be considered not functional in 99430 milliseconds
2016-09-01 18:44:03.678:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:08.679:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:13.680:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:18.681:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:22.681:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:27.682:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:32.683:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:37.685:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:42.686:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:47.682:
[cssd(25117)]CRS-1614:No I/O has completed after 75% of the maximum interval. Voting file ORCL:ORACRS01A1 will be considered not functional in 49620 milliseconds
2016-09-01 18:44:47.687:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:52.683:
[cssd(25117)]CRS-1614:No I/O has completed after 75% of the maximum interval. Voting file ORCL:ORACRS01A2 will be considered not functional in 49420 milliseconds
2016-09-01 18:44:52.688:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:44:57.688:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:02.689:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:07.690:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:11.691:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:16.692:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:17.687:
[cssd(25117)]CRS-1613:No I/O has completed after 90% of the maximum interval. Voting file ORCL:ORACRS01A1 will be considered not functional in 19620 milliseconds
2016-09-01 18:45:21.693:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:22.688:
[cssd(25117)]CRS-1613:No I/O has completed after 90% of the maximum interval. Voting file ORCL:ORACRS01A2 will be considered not functional in 19420 milliseconds
2016-09-01 18:45:26.694:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:31.695:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:36.696:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:37.691:
[cssd(25117)]CRS-1604:CSSD voting file is offline: ORCL:ORACRS01A1; details at (:CSSNM00058:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:41.697:
[cssd(25117)]CRS-1649:An I/O error occured for voting file: ORCL:ORACRS01A2; details at (:CSSNM00060:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:42.692:
[cssd(25117)]CRS-1604:CSSD voting file is offline: ORCL:ORACRS01A2; details at (:CSSNM00058:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log.
2016-09-01 18:45:42.692:
[cssd(25117)]CRS-1606:The number of voting files available, 1, is less than the minimum number of voting files required, 2, resulting in CSSD termination to ensure data integrity; details at (:CSSNM00018:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log
2016-09-01 18:45:42.692:
[cssd(25117)]CRS-1656:The CSS daemon is terminating due to a fatal error; Details at (:CSSSC00012:) in /home/app/grid/product/11.2.0/grid/log/his1/cssd/ocssd.log
2016-09-01 18:45:42.740:
[cssd(25117)]CRS-1652:Starting clean up of CRSD resources.
2016-09-01 18:45:43.980:
[/home/app/grid/product/11.2.0/grid/bin/oraagent.bin(27148)]CRS-5016rocess "/home/app/grid/product/11.2.0/grid/opmn/bin/onsctli" spawned by agent "/home/app/grid/product/11.2.0/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/home/app/grid/product/11.2.0/grid/log/his1/agent/crsd/oraagent_grid/oraagent_grid.log"
2016-09-01 18:45:44.183:
[cssd(25117)]CRS-1625:Node his2, number 2, was manually shut down
回复 支持 反对

使用道具 举报

719

主题

1081

帖子

7844

积分

管理员

Rank: 9Rank: 9Rank: 9

积分
7844
发表于 2016-9-3 09:51:40 | 显示全部楼层
slz 发表于 2016-9-1 22:29
日志信息
2016-09-01 18:28:56.746:
[client(32279)]CRS-4743:File /home/app/grid/product/11.2.0/grid ...

机房和拓扑都是正常配置。
像这样远程双存储,Oracle的解决办法就是:设置ASM中设置quotum,以避免voting disk脑裂。
回复 支持 反对

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

QQ|手机版|Botang唐波's Oracle Station   

GMT+8, 2018-9-18 21:54 , Processed in 0.151127 second(s), 26 queries .

快速回复 返回顶部 返回列表