Oracle数据库数据恢复、性能优化

找回密码
注册
搜索
热搜: 活动 交友 discuz
Oracle数据库数据恢复、性能优化»论坛 › Oracle › Oracle数据库管理 › evmd 报错
发新帖
felix

0

积分

0

好友

1

主题

[升级] evmd 报错

1#
发表于 2014-7-2 16:12:36 | 查看: 5632| 回复: 3
环境：操作系统：RedHat 5.6     数据库：oracle 10.2.0.5 x64  rac +asm
问题：rac 第二个节点正常，第一个（/u01/app/oracle/product/10.2.0/db_1/log/crfdb1/racg/）中的imon.log日志一直报[ COMMCRS][463233728]Authorization failed, network error错误信息，连续几天都报这样的错误信息；且使用crsctl check evmd命令时，无法显示结果，停留在运行状态，检查了第一个节点的全部日志信息，都没报错。
imon.log日志：

2014-07-02 09:43:20.988: [ COMMCRS][646636224]Authorization failed, network error

2014-07-02 09:43:20.989: [    RACG][646636224] [3183][646636224][ora.crfdb1.ASM1.asm]: CLSR-0501: Error 13 encountered when connecting to EVM daemon

2014-07-02 09:43:20.989: [    RACG][646636224] [3183][646636224][ora.crfdb1.ASM1.asm]: clsrcesubevt: pool connection accquiring error

2014-07-02 09:43:20.989: [    RACG][646636224] [3183][646636224][ora.crfdb1.ASM1.asm]: clsrimon: Unable to subscribe event

2014-07-02 09:51:49.260: [ COMMCRS][2811884224]Authorization failed (0x8ad0e70), timed out, start 09:51:19.257, duration 30010

2014-07-02 09:51:49.261: [    RACG][2811884224] [7112][2811884224][ora.webp2p.webp2p1.inst]: CLSR-0501: Error 13 encountered when connecting to EVM daemon

2014-07-02 09:51:49.261: [    RACG][2811884224] [7112][2811884224][ora.webp2p.webp2p1.inst]: clsrcesubevt: pool connection accquiring error

2014-07-02 09:51:49.261: [    RACG][2811884224] [7112][2811884224][ora.webp2p.webp2p1.inst]: clsrimon: Unable to subscribe event

2014-07-02 09:53:53.200: [ COMMCRS][1156522688]Authorization failed (0x1d374e70), timed out, start 09:53:23.195, duration 30010

2014-07-02 09:53:53.201: [    RACG][1156522688] [8154][1156522688][ora.crfdb1.ASM1.asm]: CLSR-0501: Error 13 encountered when connecting to EVM daemon

2014-07-02 09:53:53.201: [    RACG][1156522688] [8154][1156522688][ora.crfdb1.ASM1.asm]: clsrcesubevt: pool connection accquiring error

2014-07-02 09:53:53.201: [    RACG][1156522688] [8154][1156522688][ora.crfdb1.ASM1.asm]: clsrimon: Unable to subscribe event

2014-07-02 10:02:21.459: [ COMMCRS][178467520]Authorization failed, network error

2014-07-02 10:02:21.460: [    RACG][178467520] [12119][178467520][ora.webp2p.webp2p1.inst]: CLSR-0501: Error 13 encountered when connecting to EVM daemon

2014-07-02 10:02:21.461: [    RACG][178467520] [12119][178467520][ora.webp2p.webp2p1.inst]: clsrcesubevt: pool connection accquiring error

2014-07-02 10:02:21.461: [    RACG][178467520] [12119][178467520][ora.webp2p.webp2p1.inst]: clsrimon: Unable to subscribe event

2014-07-02 10:04:25.403: [ COMMCRS][2982695616]Authorization failed (0x18d5ae70), timed out, start 10:03:55.399, duration 30010

2014-07-02 10:04:25.404: [    RACG][2982695616] [13057][2982695616][ora.crfdb1.ASM1.asm]: CLSR-0501: Error 13 encountered when connecting to EVM daemon

2014-07-02 10:04:25.404: [    RACG][2982695616] [13057][2982695616][ora.crfdb1.ASM1.asm]: clsrcesubevt: pool connection accquiring error

2014-07-02 10:04:25.404: [    RACG][2982695616] [13057][2982695616][ora.crfdb1.ASM1.asm]: clsrimon: Unable to subscribe event
2#
发表于 2014-7-3 20:50:32
FYI

Pre-11gR2: "crsctl check crs" command hangs at EVMD check (文档 ID 1578875.1)

APPLIES TO:

Oracle Database - Enterprise Edition - Version 10.2.0.3 to 11.1.0.7 [Release 10.2 to 11.1]
Information in this document applies to any platform.
SYMPTOMS

In a 2 node RAC environment, with 11.1.0.7 CRS, execution of the command "crsctl check crs" hangs at EVMD check only in Node 1

[oracle@srv03401 bin]$ ./crsctl check crs
Cluster Synchronization Services appears healthy
Cluster Ready Services appears healthy

From Node1, below is the output of strace for the command "crsctl check crs"

# strace -f -t -o /tmp/crschk.trc crsctl check crs

Content of the generated output file :/tmp/crschk.trc is as follows:  

28268 11:47:03 execve("./crsctl", ["./crsctl", "check", "crs"], [/* 23 vars */]) = 0
28268 11:47:03 brk(0)                   = 0x193d2000
28268 11:47:03 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b35b9436000
28268 11:47:03 uname({sys="Linux", node="srv03401.metra.com", ...}) = 0
28268 11:47:03 access("/etc/ld.so.preload", R_OK) = -1 ENOENT (No such file or directory)
28268 11:47:03 open("/etc/ld.so.cache", O_RDONLY) = 3
28268 11:47:03 fstat(3, {st_mode=S_IFREG|0644, st_size=92563, ...}) = 0
28268 11:47:03 mmap(NULL, 92563, PROT_READ, MAP_PRIVATE, 3, 0) = 0x2b35b9437000
28268 11:47:03 close(3)                 = 0
28268 11:47:03 open("/lib64/libtermcap.so.2", O_RDONLY) = 3
28268 11:47:03 read(3, "\177ELF\2\1\1\0\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0`\20\300z2\0\0\0"..., 832) = 832
28268 11:47:03 fstat(3, {st_mode=S_IFREG|0755, st_size=15840, ...}) = 0
28268 11:47:03 mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x2b35b944e000
28268 11:47:03 mmap(0x327ac00000, 2108944, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x327ac00000
28268 11:47:03 mprotect(0x327ac03000, 2093056, PROT_NONE) = 0
28268 11:47:03 mmap(0x327ae02000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2000) = 0x327ae02000
28268 11:47:03 close(3)                 = 0
28268 11:47:03 open("/lib64/libdl.so.2", O_RDONLY) = 3
..
..
28268 11:47:03 close(3)                 = 0
28268 11:47:03 write(1, "Cluster Ready Services appears h"..., 39) = 39
28268 11:47:03 socket(PF_INET6, SOCK_DGRAM, IPPROTO_IP) = 3
28268 11:47:03 setsockopt(3, SOL_SOCKET, SO_REUSEADDR, [1], 4) = 0
28268 11:47:03 bind(3, {sa_family=AF_INET6, sin6_port=htons(0), inet_pton(AF_INET6, "::1", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, 28) = 0
28268 11:47:03 getsockname(3, {sa_family=AF_INET6, sin6_port=htons(42027), inet_pton(AF_INET6, "::1", &sin6_addr), sin6_flowinfo=0, sin6_scope_id=0}, [140733193388060]) = 0
28268 11:47:03 getpeername(3, 0x7fff5f19e1e0, [140733193388060]) = -1 ENOTCONN (Transport endpoint is not connected)
28268 11:47:03 getsockopt(3, SOL_SOCKET, SO_SNDBUF, [5536382933839118336], [4]) = 0
28268 11:47:03 getsockopt(3, SOL_SOCKET, SO_RCVBUF, [5536382933843050496], [4]) = 0
28268 11:47:03 fcntl(3, F_SETFD, FD_CLOEXEC) = 0
28268 11:47:03 fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
28268 11:47:03 geteuid()                = 700
28268 11:47:03 times({tms_utime=1, tms_stime=2, tms_cutime=0, tms_cstime=0}) = 7422615891
28268 11:47:03 socket(PF_FILE, SOCK_STREAM, 0) = 4
28268 11:47:03 access("/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth", F_OK) = 0
28268 11:47:03 connect(4, {sa_family=AF_FILE, path="/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth"...}, 110
  

CAUSE

Analysing  the strace output, looks like it was trying to write to a socket.

========
28268 11:47:03 socket(PF_FILE, SOCK_STREAM, 0) = 4
28268 11:47:03 access("/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth", F_OK) = 0
28268 11:47:03 connect(4, {sa_family=AF_FILE, path="/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth"...}, 110   <<<<<<<
========
This, indicates a problem with the network socket file.

SOLUTION

Get the PID of evmd.bin process and kill it

$ ps -ef | grep 'd.bin'

oracle   21046 21045  0  2012 ?        00:07:46 /u01/app/ract/crs/bin/evmd.bin         
root     21054 15845  0  2012 ?        11:34:47 /u01/app/ract/crs/bin/crsd.bin reboot
oracle   22072 21453  0  2012 ?        05:44:50 /u01/app/ract/crs/bin/ocssd.bin
root     22135     1  0  2012 ?        00:00:00 /u01/app/ract/crs/bin/oclskd.bin
oracle   22410     1  0  2012 ?        00:00:00 /u01/app/ract/crs/bin/oclskd.bin
oracle   29834 27854  0 13:22 pts/8    00:00:00 egrep d.bin

$ kill -9 21046

After killing evmd.bin process, the command "crsctl check crs" returns the complete output without any hangs.

[oracle@srv03401 bin]$ ./crsctl check crs

CSS appears healthy
CRS appears healthy
EVM appears healthy

回复 只看该作者 道具 举报

3#
发表于 2014-7-9 11:41:10
通过# strace -f -t -o /tmp/crschk.trc crsctl check crs进行跟踪
Content of the generated output file :/tmp/crschk.trc is as follows:
write(1, "CSS appears healthy\n", 20) = 20
24514 11:03:40 brk(0x144bd000)          = 0x144bd000
24514 11:03:40 brk(0x144df000)          = 0x144df000
24514 11:03:40 brk(0x14501000)          = 0x14501000
24514 11:03:40 access("/u01/app/oracle/product/10.2.0/crs_1/log/crfdb1/ ", F_OK) = -1 ENOENT (No such file or directory)
24514 11:03:40 access("/u01/app/oracle/product/10.2.0/crs_1/log/crfdb1/client/clsc.ini", F_OK) = -1 ENOENT (No such file or directory)
24514 11:03:40 access("/u01/app/oracle/product/10.2.0/db_1/network/admin/sqlnet.ora", F_OK) = -1 ENOENT (No such file or directory)
24514 11:03:40 access("/u01/app/oracle/product/10.2.0/crs_1/network/admin/sqlnet.ora", F_OK) = -1 ENOENT (No such file or directory)
24514 11:03:40 getrlimit(RLIMIT_NOFILE, {rlim_cur=64*1024, rlim_max=64*1024}) = 0
24514 11:03:40 brk(0x14524000)          = 0x14524000
24514 11:03:40 brk(0x1455f000)          = 0x1455f000
24514 11:03:40 socket(PF_INET, SOCK_DGRAM, IPPROTO_IP) = 3
24514 11:03:40 bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
24514 11:03:40 getsockname(3, {sa_family=AF_INET, sin_port=htons(40770), sin_addr=inet_addr("127.0.0.1")}, [47888885350416]) = 0
24514 11:03:40 getpeername(3, 0x7fff22c6786c, [47888885350416]) = -1 ENOTCONN (Transport endpoint is not connected)
24514 11:03:40 getsockopt(3, SOL_SOCKET, SO_SNDBUF, [262144], [4]) = 0
24514 11:03:40 getsockopt(3, SOL_SOCKET, SO_RCVBUF, [1048576], [4]) = 0
24514 11:03:40 fcntl(3, F_SETFD, FD_CLOEXEC) = 0
24514 11:03:40 fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 gettimeofday({1404875020, 996993}, NULL) = 0
24514 11:03:40 access("/var/tmp/.oracle", F_OK) = 0
24514 11:03:40 chmod("/var/tmp/.oracle", 01777) = -1 EPERM (Operation not permitted)
24514 11:03:40 socket(PF_FILE, SOCK_STREAM, 0) = 4
24514 11:03:40 chmod(0x2, 0777)         = -1 EFAULT (Bad address)
24514 11:03:40 access("/var/tmp/.oracle/sCRSD_UI_SOCKET", F_OK) = 0
24514 11:03:40 connect(4, {sa_family=AF_FILE, path="/var/tmp/.oracle/sCRSD_UI_SOCKET"...}, 110) = 0
24514 11:03:40 fcntl(4, F_SETFD, FD_CLOEXEC) = 0
24514 11:03:40 rt_sigaction(SIGPIPE, {0x1, ~[ILL ABRT BUS FPE SEGV USR2 XCPU XFSZ SYS RTMIN RT_1], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x38ee80e7c0}, {0x1, ~[ILL ABRT BUS FPE KILL SEGV USR2 STOP XCPU XFSZ SYS RTMIN RT_1], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x38ee80e7c0}, 8) = 0
24514 11:03:40 gettimeofday({1404875020, 997832}, NULL) = 0
24514 11:03:40 gettimeofday({1404875020, 997904}, NULL) = 0
24514 11:03:40 fcntl(4, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
24514 11:03:40 write(4, "0\0\0\0\1\0\1\0\1\0\1\0\1\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 48) = 48
24514 11:03:40 gettimeofday({1404875020, 998155}, NULL) = 0
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLOUT|POLLRDNORM}], 2, -1) = 1 ([{fd=4, revents=POLLIN|POLLOUT|POLLRDNORM}])
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 read(4, "0\0\0\0\1\0\1\0\1\0\1\0\1\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 32768) = 168
24514 11:03:40 gettimeofday({1404875020, 998625}, NULL) = 0
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 times(NULL)              = 1869111068
24514 11:03:40 write(4, "4\0\0\0\1\0\2\0\1\1\1\1\2\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 52) = 52
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 open("/u01/app/oracle/product/10.2.0/crs_1/crs/auth/A0660125/95bf1f61", O_WRONLY|O_CREAT|O_EXCL, 0644) = 5
24514 11:03:41 fchmod(5, 0644)          = 0
24514 11:03:41 write(5, "4j\335\236", 4) = 4
24514 11:03:41 close(5)                 = 0
24514 11:03:41 write(4, "4\0\0\0\2\0\2\0\1\1\1\1\3\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 52) = 52
24514 11:03:41 write(4, "8\0\0\0\3\0\2\0\1\1\1\1\4\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 56) = 56
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 gettimeofday({1404875021, 1250}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLRDNORM}], 2, -1) = 1 ([{fd=4, revents=POLLIN|POLLRDNORM}])
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 read(4, "8\0\0\0\3\0\2\0\1\1\1\1\3\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 32768) = 56
24514 11:03:41 write(4, "9\1\0\0PC\0\0\t\2\2\0\5\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 313) = 313
24514 11:03:41 gettimeofday({1404875021, 1847}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111068
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLRDNORM}], 2, -1) = 1 ([{fd=4, revents=POLLIN|POLLRDNORM}])
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 read(4, "y\3\0\0PC\0\0\t\2\2\0\4\0\0\0\0\0\0\0\1\0\0\0\30\267\23Z\0\0\0\0"..., 32768) = 937
24514 11:03:41 gettimeofday({1404875021, 7550}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 fcntl(4, F_GETFL)        = 0x802 (flags O_RDWR|O_NONBLOCK)
24514 11:03:41 fcntl(4, F_SETFL, O_RDWR) = 0
24514 11:03:41 close(4)                 = 0
24514 11:03:41 close(3)                 = 0
24514 11:03:41 write(1, "CRS appears healthy\n", 20) = 20
24514 11:03:41 socket(PF_INET, SOCK_DGRAM, IPPROTO_IP) = 3
24514 11:03:41 bind(3, {sa_family=AF_INET, sin_port=htons(0), sin_addr=inet_addr("127.0.0.1")}, 16) = 0
24514 11:03:41 getsockname(3, {sa_family=AF_INET, sin_port=htons(29108), sin_addr=inet_addr("127.0.0.1")}, [47888885350416]) = 0
24514 11:03:41 getpeername(3, 0x7fff22c6918c, [47888885350416]) = -1 ENOTCONN (Transport endpoint is not connected)
24514 11:03:41 getsockopt(3, SOL_SOCKET, SO_SNDBUF, [262144], [4]) = 0
24514 11:03:41 getsockopt(3, SOL_SOCKET, SO_RCVBUF, [1048576], [4]) = 0
24514 11:03:41 fcntl(3, F_SETFD, FD_CLOEXEC) = 0
24514 11:03:41 fcntl(3, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
24514 11:03:41 geteuid()                = 500
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 gettimeofday({1404875021, 9446}, NULL) = 0
24514 11:03:41 socket(PF_FILE, SOCK_STREAM, 0) = 4
24514 11:03:41 chmod(0x2, 0777)         = -1 EFAULT (Bad address)
24514 11:03:41 access("/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth", F_OK) = 0
24514 11:03:41 connect(4, {sa_family=AF_FILE, path="/var/tmp/.oracle/sSYSTEM.evm.acceptor.auth"...}, 110) = 0
24514 11:03:41 fcntl(4, F_SETFD, FD_CLOEXEC) = 0
24514 11:03:41 rt_sigaction(SIGPIPE, {0x1, ~[ILL ABRT BUS FPE SEGV USR2 XCPU XFSZ SYS RTMIN RT_1], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x38ee80e7c0}, {0x1, ~[ILL ABRT BUS FPE KILL SEGV USR2 STOP XCPU XFSZ SYS RTMIN RT_1], SA_RESTORER|SA_RESTART|SA_SIGINFO, 0x38ee80e7c0}, 8) = 0
24514 11:03:41 gettimeofday({1404875021, 10142}, NULL) = 0
24514 11:03:41 gettimeofday({1404875021, 10211}, NULL) = 0
24514 11:03:41 fcntl(4, F_SETFL, O_RDONLY|O_NONBLOCK) = 0
24514 11:03:41 write(4, "0\0\0\0\1\0\1\0\1\0\1\0\1\0\0\0\0\0\0\0\1\0\0\0\"\267\23Z\0\0\0\0"..., 48) = 48
24514 11:03:41 gettimeofday({1404875021, 10453}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLOUT|POLLRDNORM}], 2, -1) = 1 ([{fd=4, revents=POLLOUT}])
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 times(NULL)              = 1869111069
24514 11:03:41 gettimeofday({1404875021, 10828}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLRDNORM}], 2, -1) = 1 ([{fd=4, revents=POLLIN|POLLRDNORM}])
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 read(4, "0\0\0\0\1\0\1\0\1\0\1\0\1\0\0\0\0\0\0\0\1\0\0\0\"\267\23Z\0\0\0\0"..., 32768) = 48
24514 11:03:41 gettimeofday({1404875021, 11299}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 write(4, "4\0\0\0\1\0\2\0\1\1\1\1\2\0\0\0\0\0\0\0\1\0\0\0\"\267\23Z\0\0\0\0"..., 52) = 52
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 gettimeofday({1404875021, 11657}, NULL) = 0
24514 11:03:41 times(NULL)              = 1869111070
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLRDNORM}], 2, -1) = -1 EINTR (Interrupted system call)


CAUSE：
24514 11:03:41 poll([{fd=3, events=POLLIN|POLLRDNORM}, {fd=4, events=POLLIN|POLLRDNORM}], 2, -1) = -1  是不是poll函数调用失败，检测不到socket信息？

处理方式：
是否killing evmd.bin process，然后进行crsctl check crs？


回复 只看该作者 道具 举报

4#
发表于 2014-7-9 15:44:40
TRY YOUR BEST

回复 只看该作者 道具 举报

返回列表
高级模式
B Color Image Link Quote Code Smilies
您需要登录后才可以回帖 登录 | 注册

QQ|手机版|Archiver|Oracle数据库数据恢复、性能优化

GMT+8, 2024-12-21 03:04 , Processed in 0.052263 second(s), 20 queries .

Powered by Discuz! X2.5

© 2001-2012 Comsenz Inc.

回顶部
TEL/電話+86 13764045638
Email service@parnassusdata.com
QQ 47079569