<rt id="bn8ez"></rt>
<label id="bn8ez"></label>

  • <span id="bn8ez"></span>

    <label id="bn8ez"><meter id="bn8ez"></meter></label>

    qileilove

    blog已經(jīng)轉(zhuǎn)移至github,大家請(qǐng)?jiān)L問(wèn) http://qaseven.github.io/

    Oracle RAC Database 11.1.0.6監(jiān)聽(tīng)故障案例

     晚上接到電話,客戶(hù)的一套核心Oracle RAC數(shù)據(jù)庫(kù)連接不上,連接時(shí)報(bào)無(wú)監(jiān)聽(tīng)程序,客戶(hù)的Oracle RAC版本為11.1.0.6,平臺(tái)為AIX 6.1.05,使用了IBM HACMP 5.5.0.8。
      當(dāng)我遠(yuǎn)程過(guò)去的時(shí)候,發(fā)現(xiàn)節(jié)點(diǎn)2已經(jīng)沒(méi)有任何oracle用戶(hù)的進(jìn)程,且concurrent的vg沒(méi)有激活,HACMP的服務(wù)也offline。
      另一個(gè)節(jié)點(diǎn)Oracle的實(shí)例是正常的,且有部分服務(wù)器進(jìn)程依然在工作,但是本地監(jiān)聽(tīng)器出現(xiàn)了故障,導(dǎo)致新的連接無(wú)法連接到實(shí)例,通過(guò)crs_stat -t看到兩個(gè)實(shí)例的監(jiān)聽(tīng)也都是OFFLINE狀態(tài)。
      在節(jié)點(diǎn)上并沒(méi)有發(fā)現(xiàn)有LISTENER進(jìn)程,且手動(dòng)殺掉了所有的服務(wù)器進(jìn)程,在oracle用戶(hù)下啟動(dòng)監(jiān)聽(tīng)時(shí)收到以下的報(bào)錯(cuò):
    $ lsnrctl start listener_cdfy740a
    LSNRCTL for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production on 20-NOV-2014 20:09:09
    Copyright (c) 1991, 2007, Oracle.  All rights reserved.
    Starting /oracle/app/oracle/product/11.1.0/db_1/bin/tnslsnr: please wait...
    TNSLSNR for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production
    System parameter file is /oracle/app/oracle/product/11.1.0/db_1/network/admin/listener.ora
    Log messages written to /oracle/app/oracle/diag/tnslsnr/cdfy740a/listener_cdfy740a/alert/log.xml
    Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.107.64.1)(PORT=1521)))
    Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.107.64.1)(PORT=1521)(IP=FIRST)))
    TNS-12542: TNS:address already in use
    TNS-12560: TNS:protocol adapter error
    TNS-00512: Address already in use
    IBM/AIX RISC System/6000 Error: 67: Address already in use
    Listener failed to start. See the error message(s) above...
      10.107.64.1是該節(jié)點(diǎn)的vip地址,下面是RAC環(huán)境的hosts配置:
    10.107.64.1     vip1
    10.107.64.2     vip2
    10.107.64.3     cdfy740a
    10.107.64.4     cdfy740b
    172.201.201.1   prv1
    172.201.201.2   prv2
      手動(dòng)停掉該節(jié)點(diǎn)的nodeapps服務(wù):
      cdfy740a@root[/oracle/app/11.1.0/crs/bin]./srvctl stop nodeapps -n cdfy740a
      成功停止后,VIP在主機(jī)層面已經(jīng)消失:
    cdfy740a@root[/oracle/app/11.1.0/crs/bin]ifconfig -a | more
    en0: flags=1e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),LARGESEND,CHAIN>
    inet 172.200.200.1 netmask 0xffffff00 broadcast 172.200.200.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    en1: flags=1e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),LARGESEND,CHAIN>
    inet 172.201.201.1 netmask 0xffffff00 broadcast 172.201.201.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    en4: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
    inet 10.107.64.3 netmask 0xffffff00 broadcast 10.107.64.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    lo0: flags=e08084b,c0<UP,BROADCAST,LOOPBACK,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,LARGESEND,CHAIN>
    inet 127.0.0.1 netmask 0xff000000 broadcast 127.255.255.255
    inet6 ::1%1/0
    tcp_sendspace 131072 tcp_recvspace 131072 rfc1323 1
     再次啟動(dòng)節(jié)點(diǎn)nodeapps服務(wù):
    cdfy740a@root[/oracle/app/11.1.0/crs/bin]./srvctl start nodeapps -n cdfy740a
    CRS-1006: No more members to consider
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:LSNRCTL for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production on 20-NOV-2014 20:13:07
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Copyright (c) 1991, 2007, Oracle.  All rights reserved.
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Starting /oracle/app/oracle/product/11.1.0/db_1/bin/tnslsnr: please wait...
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:TNSLSNR for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:System parameter file is /oracle/app/oracle/product/11.1.0/db_1/network/admin/listener.ora
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Log messages written to /oracle/app/oracle/diag/tnslsnr/cdfy740a/listener_cdfy740a/alert/log.xml
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.107.64.1)(PORT=1521)))
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.107.64.1)(PORT=1521)(IP=FIRST)))
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:TNS-12542: TNS:address already in use
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr: TNS-12560: TNS:protocol adapter error
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:  TNS-00512: Address already in use
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:   IBM/AIX RISC System/6000 Error: 67: Address already in use
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Listener failed to start. See the error message(s) above...
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:LSNRCTL for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production on 20-NOV-2014 20:13:08
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Copyright (c) 1991, 2007, Oracle.  All rights reserved.
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=vip1)(PORT=1521)))
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:TNS-12541: TNS:no listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr: TNS-12560: TNS:protocol adapter error
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:  TNS-00511: No listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:   IBM/AIX RISC System/6000 Error: 79: Connection refused
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.107.64.1)(PORT=1521)(IP=FIRST)))
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:TNS-12541: TNS:no listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr: TNS-12560: TNS:protocol adapter error
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:  TNS-00511: No listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:   IBM/AIX RISC System/6000 Error: 79: Connection refused
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.107.64.3)(PORT=1521)(IP=FIRST)))
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:TNS-12541: TNS:no listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr: TNS-12560: TNS:protocol adapter error
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:  TNS-00511: No listener
    cdfy740a:ora.cdfy740a.LISTENER_CDFY740A.lsnr:   IBM/AIX RISC System/6000 Error: 79: Connection refused
    CRS-0215: Could not start resource 'ora.cdfy740a.LISTENER_CDFY740A.lsnr'.
      之前使用lsnrctl status listener_cdfy740a查看監(jiān)聽(tīng)器狀態(tài)時(shí)也收到Connection refused的錯(cuò)誤。
      查看主機(jī)層面已經(jīng)成功綁定了VIP地址:
    cdfy740a@root[/oracle/app/11.1.0/crs/bin]ifconfig -a | more
    en0: flags=1e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),LARGESEND,CHAIN>
    inet 172.200.200.1 netmask 0xffffff00 broadcast 172.200.200.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    en1: flags=1e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),LARGESEND,CHAIN>
    inet 172.201.201.1 netmask 0xffffff00 broadcast 172.201.201.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    en4: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
    inet 10.107.64.3 netmask 0xffffff00 broadcast 10.107.64.255
    inet 10.107.64.1 netmask 0xffffff00 broadcast 10.107.64.255
    tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
    lo0: flags=e08084b,c0<UP,BROADCAST,LOOPBACK,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,LARGESEND,CHAIN>
    inet 127.0.0.1 netmask 0xff000000 broadcast 127.255.255.255
    inet6 ::1%1/0
    tcp_sendspace 131072 tcp_recvspace 131072 rfc1323 1
      再次嘗試手動(dòng)啟動(dòng)本地監(jiān)聽(tīng)器:
    cdfy740a@root[/]su - oracle
    $ lsnrctl start listener_cdfy740a
    LSNRCTL for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production on 20-NOV-2014 20:18:37
    Copyright (c) 1991, 2007, Oracle.  All rights reserved.
    Starting /oracle/app/oracle/product/11.1.0/db_1/bin/tnslsnr: please wait...
    TNSLSNR for IBM/AIX RISC System/6000: Version 11.1.0.6.0 - Production
    System parameter file is /oracle/app/oracle/product/11.1.0/db_1/network/admin/listener.ora
    Log messages written to /oracle/app/oracle/diag/tnslsnr/cdfy740a/listener_cdfy740a/alert/log.xml
    Listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=10.107.64.1)(PORT=1521)))
    Error listening on: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=10.107.64.1)(PORT=1521)(IP=FIRST)))
    TNS-12542: TNS:address already in use
    TNS-12560: TNS:protocol adapter error
    TNS-00512: Address already in use
    IBM/AIX RISC System/6000 Error: 67: Address already in use
    Listener failed to start. See the error message(s) above...
      啟動(dòng)依然失敗。
      檢查監(jiān)聽(tīng)器配置文件:
    $ cat listener.ora
    # listener.ora.cdfy740a Network Configuration File: /oracle/app/oracle/product/11.1.0/db_1/network/admin/listener.ora.cdfy740a
    # Generated by Oracle configuration tools.
    LISTENER_CDFY740A =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = vip1)(PORT = 1521))
    (ADDRESS = (PROTOCOL = TCP)(HOST = 10.107.64.1)(PORT = 1521)(IP = FIRST))
    (ADDRESS = (PROTOCOL = TCP)(HOST = 10.107.64.3)(PORT = 1521)(IP = FIRST))
    )
    )
      在監(jiān)聽(tīng)配置文件中,vip1和10.107.64.1是兩個(gè)重復(fù)的地址,手動(dòng)將10.107.64.1所在行去掉之后,監(jiān)聽(tīng)即可正常的啟動(dòng)。
      之后恢復(fù)節(jié)點(diǎn)2的HACMP服務(wù),Oracle RAC隨即恢復(fù)正常。
      另外,還發(fā)現(xiàn)客戶(hù)的監(jiān)聽(tīng)日志已經(jīng)被填得很大,大概在1.6GB左右,過(guò)大的監(jiān)聽(tīng)日志文件也會(huì)導(dǎo)致監(jiān)聽(tīng)器不穩(wěn)定,這里將兩個(gè)節(jié)點(diǎn)的監(jiān)聽(tīng)日志進(jìn)行了重命名操作。
      《10g RAC監(jiān)聽(tīng)器配置文件listener.ora中的IP=FIRST》:http://blog.itpub.net/23135684/viewspace-715967/
      《IP=FIRST作用說(shuō)明》:http://www.xifenfei.com/2713.html

    posted on 2014-11-27 12:00 順其自然EVO 閱讀(245) 評(píng)論(0)  編輯  收藏 所屬分類(lèi): 測(cè)試學(xué)習(xí)專(zhuān)欄

    <2014年11月>
    2627282930311
    2345678
    9101112131415
    16171819202122
    23242526272829
    30123456

    導(dǎo)航

    統(tǒng)計(jì)

    常用鏈接

    留言簿(55)

    隨筆分類(lèi)

    隨筆檔案

    文章分類(lèi)

    文章檔案

    搜索

    最新評(píng)論

    閱讀排行榜

    評(píng)論排行榜

    主站蜘蛛池模板: 久久精品视频免费播放| 亚洲AV无码一区二区三区电影| 国产av天堂亚洲国产av天堂 | 国产精品高清免费网站| 美女扒开尿口给男人爽免费视频| 香蕉视频亚洲一级| 污污视频网站免费观看| 九九九国产精品成人免费视频| 永久免费无码日韩视频| 一级毛片视频免费| 人妻在线日韩免费视频| 久久久久久久99精品免费观看| 免费91麻豆精品国产自产在线观看 | 免费a级毛片在线观看| 亚洲成AⅤ人影院在线观看| 亚洲日本一区二区一本一道| 亚洲色偷偷偷鲁综合| 久久久久亚洲精品影视| 亚洲精品日韩中文字幕久久久| 亚洲国产成人手机在线电影bd| 色婷五月综激情亚洲综合| 无码亚洲成a人在线观看| 日韩毛片一区视频免费| a视频在线免费观看| 99久久免费精品高清特色大片| 成人AV免费网址在线观看| 免费黄色app网站| 亚洲免费视频一区二区三区| 亚洲国产另类久久久精品| 亚洲无圣光一区二区| 国产精品亚洲一区二区在线观看| 国产免费牲交视频免费播放| 久久爰www免费人成| 永久免费的网站在线观看| 蜜臀91精品国产免费观看| 亚洲精品无码专区久久同性男| 亚洲AV无码专区电影在线观看| 亚洲一卡二卡三卡四卡无卡麻豆| 国产成人亚洲综合a∨| 成全动漫视频在线观看免费高清版下载| 中文字幕免费视频一|