WARNING: Subscription for node down event still pending

bruce

系统信息：SunOS OraDB1 5.10 Generic_147440-01 sun4u sparc SUNW,SPARC-Enterprise
DB Version：TNSLSNR for Solaris: Version 11.2.0.1.0 - Production

最近我的1节点监听服务隔三差五停止，一直没解决掉；现在把alert_XXX.log和listener的log贴出来，请大家帮忙看看，多谢了！

alert.log:
***********************************************************************

Fatal NI connect error 12170.

  VERSION INFORMATION:
        TNS for Solaris: Version 11.2.0.1.0 - Production
        Oracle Bequeath NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
        TCP/IP NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
  Time: 28-MAY-2014 13:35:24
  Tracing not turned on.
  Tns error struct:
    ns main err code: 12535
   
TNS-12535: TNS:operation timed out
    ns secondary err code: 12560
    nt main err code: 505
   
TNS-00505: Operation timed out
    nt secondary err code: 145
    nt OS err code: 0
  Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=172.16.150.101)(PORT=50991))
Wed May 28 13:44:29 2014

***********************************************************************

Fatal NI connect error 12170.

  VERSION INFORMATION:
        TNS for Solaris: Version 11.2.0.1.0 - Production
        Oracle Bequeath NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
        TCP/IP NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
  Time: 28-MAY-2014 13:44:29
  Tracing not turned on.
  Tns error struct:
    ns main err code: 12535
   
TNS-12535: TNS:operation timed out
    ns secondary err code: 12560
    nt main err code: 505
   
TNS-00505: Operation timed out
    nt secondary err code: 145
    nt OS err code: 0
  Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=172.16.150.101)(PORT=50974))
***********************************************************************

Fatal NI connect error 12170.

  VERSION INFORMATION:
        TNS for Solaris: Version 11.2.0.1.0 - Production
        Oracle Bequeath NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
        TCP/IP NT Protocol Adapter for Solaris: Version 11.2.0.1.0 - Production
  Time: 28-MAY-2014 14:56:21
  Tracing not turned on.
  Tns error struct:
    ns main err code: 12535
   
TNS-12535: TNS:operation timed out
    ns secondary err code: 12560
    nt main err code: 505
   
TNS-00505: Operation timed out
    nt secondary err code: 145
    nt OS err code: 0
  Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=10.152.2.48)(PORT=61707))
Wed May 28 15:02:32 2014

Archived Log entry 166663 added for thread 1 sequence 99619 ID 0x1b2ede1f dest 1:


listener.log:

<msg time='2014-05-28T09:53:32.474+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:32 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=OraDB1)(USER=grid))(COMMAND=status)(ARGUMENTS=64)(SERVICE=LISTENER)(VERSION=186646784)) * status * 0
</txt>
</msg>
<msg time='2014-05-28T09:53:32.474+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>WARNING: Subscription for node down event still pending </txt>
</msg>
<msg time='2014-05-28T09:53:32.475+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:32 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=OraDB1)(USER=oracle))(COMMAND=status)(ARGUMENTS=64)(SERVICE=LISTENER)(VERSION=186646784)) * status * 0
</txt>
</msg>
<msg time='2014-05-28T09:53:32.545+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:32 * (CONNECT_DATA=(SERVICE_NAME=+ASM1)(INSTANCE_NAME=+ASM1)(UR=A)(CID=(PROGRAM=perl@OraDB1)(HOST=OraDB1)(USER=oracle))) * (ADDRESS=(PROTOCOL=tc
p)(HOST=10.30.110.15)(PORT=45268)) * establish * +ASM1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:53:32.577+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:32 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=__jdbc__)(USER=train))(SID=CBIODEV)) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.30.110.70)(PORT=63354)) * establi
sh * CBIODEV * 12505
</txt>
</msg>
<msg time='2014-05-28T09:53:32.577+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>TNS-12505: TNS:listener does not currently know of SID given in connect descriptor
</txt>
</msg>
<msg time='2014-05-28T09:53:54.164+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:54 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=__jdbc__)(USER=oracle))(SERVICE_NAME=CBiOPRD)(CID=(PROGRAM=)(HOST=__jdbc__)(USER=oracle))) * (ADDRESS=(P
ROTOCOL=tcp)(HOST=10.30.110.15)(PORT=45281)) * establish * CBiOPRD * 0
</txt>
</msg>
<msg time='2014-05-28T09:53:54.210+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:53:54 * (CONNECT_DATA=(SID=CBiOPRD1)(CID=(PROGRAM=perl@OraDB1)(HOST=OraDB1)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.30.110.15)(PORT=45283)
) * establish * CBiOPRD1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.816+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * (CONNECT_DATA=(GLOBAL_NAME=CBiOPRD)(SERVER=dedicated)(SERVICE_NAME=CBiOPRD)(SID=CBiOPRD1)(CID=(PROGRAM=sqlplus@ZainFS)(HOST=ZainFS)(USER=ro
ot))) * (ADDRESS=(PROTOCOL=tcp)(HOST=172.16.102.71)(PORT=47950)) * establish * CBiOPRD * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.816+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * (CONNECT_DATA=(SERVICE_NAME=+ASM1)(INSTANCE_NAME=+ASM1)(UR=A)(CID=(PROGRAM=emagent)(HOST=OraDB1)(USER=oracle))) * (ADDRESS=(PROTOCOL=tcp)(H
OST=10.30.110.15)(PORT=45282)) * establish * +ASM1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.816+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * (CONNECT_DATA=(GLOBAL_NAME=CBiOPRD)(SERVER=dedicated)(SERVICE_NAME=CBiOPRD)(SID=CBiOPRD1)(CID=(PROGRAM=sqlplus@ZainFS)(HOST=ZainFS)(USER=ro
ot))) * (ADDRESS=(PROTOCOL=tcp)(HOST=172.16.102.71)(PORT=47948)) * establish * CBiOPRD * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.818+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * service_update * CBiOPRD1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.818+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * service_update * +ASM1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.818+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * (CONNECT_DATA=(CID=(PROGRAM=)(HOST=__jdbc__)(USER=train))(SID=CBIODEV)) * (ADDRESS=(PROTOCOL=tcp)(HOST=10.30.110.70)(PORT=63361)) * establi
sh * CBIODEV * 12505
</txt>
</msg>
<msg time='2014-05-28T09:54:01.818+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>TNS-12505: TNS:listener does not currently know of SID given in connect descriptor
</txt>
</msg>
<msg time='2014-05-28T09:54:01.827+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * service_update * CBiOPRD1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:01.831+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>28-MAY-2014 09:54:01 * service_update * CBiOPRD1 * 0
</txt>
</msg>
<msg time='2014-05-28T09:54:03.880+03:00' org_id='oracle' comp_id='tnslsnr'
type='UNKNOWN' level='16' host_id='OraDB1'
host_addr='10.30.110.15'>
<txt>TNS-12505: TNS:listener does not currently know of SID given in connect descriptor
</txt>
</msg>