空包网,空包代发,空包平台
Logo
搜 索        高级搜索

Oracle10g RAC:IPC Send timeout detected. Receiver ospid

 
Linux AS 5.3 ,  Oracle10.2.0.4  ,  64bit ,  RAC , 3 NODES
.\Z/xM5rvfc+Y0ITPUB个人空间)v8s;u^*HaBbssgC

:JMM+B0i0
Y WE:},N'd0ITPUB个人空间Ms4r#V:V_dKM l
2/11  16:00 点之前节点1负载从 11 降低到了 16:00左右的 1.0, 节点3是同样的负载趋势, 节点4 负载一直保持 2.3 以下 。
fAj+n#i0为什么会报  IPC Send timeout detected. Receiver ospid 25822 的问题,  现在查询ospid = 25822 对应的
d;V}+tw'g-Rj6u0session应该查不到了 。
#Nx.B1P,KL2Fi0
H*x"~g9n;V UZ0什么原因会导致这个错误发生 , 心跳线的网络问题 ? 交换机的log正在找网络管理员查看, 还没有出结果 。 不知道还有没有其他原因  ?   ITPUB个人空间HR^V_;V2mn)h
ITPUB个人空间:~4~ x5vk
ITPUB个人空间(e1f,nxwz0T A%wl7g

Vn0Ba5_9i0ITPUB个人空间;uxV#r H%^Q+Z

-sX ^TI8P(JG&F0
2O_4R*m2?z3lhci7U0---------------------------------------------------------------------------------------------------------   
(oY`Kw/`^0
2LL0H ~t^0NODE1  alert log  Message  :  :
A-Ec0YA0
M5{)y:r%g.X~q _0Thu Feb 11 16:12:16 2010
!Xsb$\ Ut0Thread 1 advanced to log sequence 8254 (LGWR switch)
N]q-Da0  Current log# 28 seq# 8254 mem# 0: /ocfs_ctrl_redo/mxdell/redo28.log
%c!G-_!dj;Ht&agx$?K j0  Current log# 28 seq# 8254 mem# 1: /ocfs_data/mxdell/redo28.logITPUB个人空间#S.s*Yv#I
Thu Feb 11 16:30:02 2010ITPUB个人空间`:`tBni^n
IPC Send timeout detected. Receiver ospid 25822ITPUB个人空间*AL:Lo-W'eB
Thu Feb 11 16:30:02 2010ITPUB个人空间 Bx|Zr"[ }?k
Errors in file /u01/product/admin/mxdell/udump/mxdell1_ora_25822.trc:ITPUB个人空间 AU @]V#t%j z.c,Wx
IPC Send timeout detected. Receiver ospid 25822ITPUB个人空间.VocIO(C
Thu Feb 11 16:30:03 2010
O0B4dXg7C2v3vz9c0Errors in file /u01/product/admin/mxdell/udump/mxdell1_ora_25822.trc:
xr6C%g a \"r3U.}4?-B0Thu Feb 11 16:34:05 2010
pwk"t%V}uJ6p~0Thread 1 advanced to log sequence 8255 (LGWR switch)ITPUB个人空间2w1^ i%_t9w7X:MM1X
  Current log# 30 seq# 8255 mem# 0: /ocfs_ctrl_redo/mxdell/redo30.log
2Giw!WGN#n2w ['o0  Current log# 30 seq# 8255 mem# 1: /ocfs_data/mxdell/redo30.log
#kxFrD6]0
5j#Jqutix^0ITPUB个人空间 i4^&R*TK$E
----------------------------------------------------------------------------------------------------------
vW d9\^4Ho#Bc D \0
v B2|#nE6Q0ITPUB个人空间Cm h$i#F].V;d]
NODE3  alert log  Message  :
5@2QPo;_7~0
p6dA9[:h#e0ITPUB个人空间(i$]2\*w$B2z&f3B9\
Thu Feb 11 16:22:11 2010
a/_b)bqjD9{${J0Thread 3 advanced to log sequence 7402 (LGWR switch)
{5J:I}rQ4xx6p;p0  Current log# 22 seq# 7402 mem# 0: /ocfs_ctrl_redo/mxdell/redo22.logITPUB个人空间3X ^x!b*mm'HrY
  Current log# 22 seq# 7402 mem# 1: /ocfs_data/mxdell/redo22.log
dg,t c0w\-k$z)o0Thu Feb 11 16:30:02 2010ITPUB个人空间4c m#d;B H#E(O
IPC Send timeout detected.Sender: ospid 15764ITPUB个人空间1pQ Z:ggLS
Receiver: inst 1 binc 6 ospid 25822
]h:d7GL/m0Thu Feb 11 16:30:02 2010ITPUB个人空间 F6_5E-\&yx5m!^D4u
IPC Send timeout detected.Sender: ospid 15766ITPUB个人空间x1k)h] q6c
Receiver: inst 1 binc 6 ospid 25822
$R&{ m#OjxlD!VS0Thu Feb 11 16:34:41 2010ITPUB个人空间/g\#Mi9Rx |B
Thread 3 advanced to log sequence 7403 (LGWR switch)
w[,eQ+Y0MC0  Current log# 23 seq# 7403 mem# 0: /ocfs_ctrl_redo/mxdell/redo23.logITPUB个人空间}7i$G.L4AH W}L_
  Current log# 23 seq# 7403 mem# 1: /ocfs_data/mxdell/redo23.logITPUB个人空间p0hG&{bn"e7k*a
ITPUB个人空间2DS5\a K
----------------------------------------------------------------------------------------------------------
etq q3^v0
r"RJV$q1a0NODE4 alert log  Message
z K&j0Uv-uYl9L0ITPUB个人空间r |UNY
Thu Feb 11 16:12:16 2010
_ fTZ%A:y0Thread 4 advanced to log sequence 3194 (LGWR switch)ITPUB个人空间ltg'y])vY
  Current log# 9 seq# 3194 mem# 0: /ocfs_ctrl_redo/mxdell/redo09_1.log
2FU"A7?6D|t0  Current log# 9 seq# 3194 mem# 1: /ocfs_data/mxdell/redo09_2.logITPUB个人空间[9@CpAO
Thu Feb 11 16:30:02 2010
(P^ DC6U4z+|Ts0IPC Send timeout detected.Sender: ospid 6046ITPUB个人空间 Y&H`0t#]
Receiver: inst 1 binc 6 ospid 25822ITPUB个人空间XLMP"G
Thu Feb 11 16:30:02 2010ITPUB个人空间8[VVdb I
IPC Send timeout detected.Sender: ospid 6071ITPUB个人空间x$AM;`U.o9VP#UAg
Receiver: inst 1 binc 6 ospid 25822
p$dD-a}&d\lQ0Thu Feb 11 16:30:02 2010ITPUB个人空间 Z&Z_0M0pd
IPC Send timeout detected.Sender: ospid 6003
'h3|*Aq]w"| m0Receiver: inst 1 binc 6 ospid 25822
xoWx|2NM/L0Thu Feb 11 16:30:02 2010ITPUB个人空间 ?7P]oF&I7zL
IPC Send timeout detected.Sender: ospid 6035ITPUB个人空间'Q4b8m!Op
Receiver: inst 1 binc 6 ospid 25822
R3HpMPL B;ERP8^9Q0Thu Feb 11 16:30:02 2010ITPUB个人空间+FG)Ek/T7L J/X
IPC Send timeout detected.Sender: ospid 6016
YW,nSiw u0Receiver: inst 1 binc 6 ospid 25822
uGLo6S0Thu Feb 11 16:30:03 2010ITPUB个人空间0d(I EI5ryyM9uYx
IPC Send timeout detected.Sender: ospid 6067ITPUB个人空间5_!KB$R.Dx5w xy7w
Receiver: inst 1 binc 6 ospid 25822ITPUB个人空间8[ S'{~Z E-z%?
Thu Feb 11 16:42:08 2010
Vj K`0@g/x0Thread 4 advanced to log sequence 3195 (LGWR switch)ITPUB个人空间`-G W'woUf9Uga+s#\
  Current log# 10 seq# 3195 mem# 0: /ocfs_ctrl_redo/mxdell/redo10_1.logITPUB个人空间~W+qiw za5T
  Current log# 10 seq# 3195 mem# 1: /ocfs_data/mxdell/redo10_2.logITPUB个人空间7X1cQ@C

7_:y VV I;J0ITPUB个人空间;v/y9O8bR b'Z&m7n6k

yuaP)|)_0----------------------------------------------------------------------------------------------------------
t&j N x8]DP9~q0ITPUB个人空间N;a(}+}bfc

9a4T|!Xz0NODE1 trace file message :  ITPUB个人空间%HQ#P {`6_U }
ITPUB个人空间L-@T `7q7w
/u01/product/admin/mxdell/udump/mxdell1_ora_25822.trc
%V#@^:J[n7~4{,v:B\0Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit ProductionITPUB个人空间9J^:l[!Rb
With the Partitioning, Real Application Clusters, OLAP, Data MiningITPUB个人空间'BP MfWD
and Real Application Testing optionsITPUB个人空间g wxeF'nk
ORACLE_HOME = /u01/product/oracleITPUB个人空间G9YOK9L f3K"m
System name:    Linux
M DQ6JDIO"k0Node name:      mxrac01
!J,O"i"qu5Lc!C i:y0Release:        2.6.18-128.el5
tsN,]4Yv.qJ0Version:        #1 SMP Wed Dec 17 11:41:38 EST 2008ITPUB个人空间 x&ZC(m*J-|2z
Machine:        x86_64ITPUB个人空间nS(vc?w
Instance name: mxdell1ITPUB个人空间&|!F7iA"Z,QI
Redo thread mounted by this instance: 1ITPUB个人空间M*\3v-? e[f}|
Oracle process number: 583ITPUB个人空间+Z ftx@YQmt
Unix process pid: 25822, image: oracle@mxrac01
5Il(PAY3CD0
8z!|^R!U{0*** 2010-02-11 16:24:05.672
}K Il6Y\8f0*** ACTION NAME) 2010-02-11 16:24:05.672ITPUB个人空间GM'Y4?d.e!J$]
*** MODULE NAMETOAD 9.0.1.8) 2010-02-11 16:24:05.672ITPUB个人空间;v/b&CT[u
*** SERVICE NAMEmxdell) 2010-02-11 16:24:05.672ITPUB个人空间d y2O9cCPqoQY2w
*** SESSION ID2015.6536) 2010-02-11 16:24:05.672ITPUB个人空间@l-k(Rp
SKGXPSEGRCV: MESSAGE TRUNCATED user data 48 bytes payload 2104 bytesITPUB个人空间O9G)^~'k'}
SKGXPSEGRCV: trucated message buffer data skgxpmsg meta. data header 0x0x7fff7775a678 len 48 bytesITPUB个人空间6w/n0R ]8kW,X#] Y
SKGXPLOSTACK: message truncation expected
t6q)l'NZXv_0SKGXPLOSTACK: data sent to port with no buffers queued from
:ujA(cV D n0SKGXPGPID 0x7fff7775a7c8        Internet address 192.168.1.14   UDP port number 17506ITPUB个人空间 Q9n6A"u fbi!Ec^
SKGXPLOSTACK: sent seq 32787 expecting 32788
0}Y YTcb \0p0SKGXPLOSTACK: lost ack detected retransmit ack
!]G/Hz,p.Ti;~;O0SKGXPSEGRCV: MESSAGE TRUNCATED user data 48 bytes payload 2104 bytesITPUB个人空间e^4d_\ _$N9R
SKGXPSEGRCV: trucated message buffer data skgxpmsg meta. data header 0x0x7fff7775a678 len 48 bytesITPUB个人空间 Wy!i8wecZemRV
SKGXPLOSTACK: message truncation expectedITPUB个人空间 W Q |(fPO9|h
SKGXPLOSTACK: data sent to port with no buffers queued from
{:qf6S.S Ugb7Q0SKGXPGPID 0x7fff7775a7c8        Internet address 192.168.1.14   UDP port number 13121ITPUB个人空间 ~/T&tY e#K I
SKGXPLOSTACK: sent seq 32787 expecting 32788
nL&mTg0SKGXPLOSTACK: lost ack detected retransmit ackITPUB个人空间-g,`v+H}N
SKGXPSEGRCV: MESSAGE TRUNCATED user data 48 bytes payload 2104 bytesITPUB个人空间 X_1H0F$j
SKGXPSEGRCV: trucated message buffer data skgxpmsg meta. data header 0x0x7fff7775a678 len 48 bytesITPUB个人空间Tm H?*`8]&XylZ9M
SKGXPLOSTACK: message truncation expectedITPUB个人空间-HF5|.es
SKGXPLOSTACK: data sent to port with no buffers queued fromITPUB个人空间%v#Y6{*wb
SKGXPGPID 0x7fff7775a7c8        Internet address 192.168.1.14   UDP port number 30817
r/fg\-@Wd0SKGXPLOSTACK: sent seq 32787 expecting 32788
'ftN{0R!dQ b L)z0SKGXPLOSTACK: lost ack detected retransmit ack
k/~O%[ k b} MD;L0SKGXPSEGRCV: MESSAGE TRUNCATED user data 48 bytes payload 2104 bytes
a9V5H mz"a|0SKGXPSEGRCV: trucated message buffer data skgxpmsg meta. data header 0x0x7fff7775a678 len 48 bytes
p/|[;NP:r0SKGXPLOSTACK: message truncation expected
z;|/p$oO9h`0SKGXPLOSTACK: data sent to port with no buffers queued fromITPUB个人空间+y3I6HE'@~} Xa
SKGXPGPID 0x7fff7775a7c8        Internet address 192.168.1.14   UDP port number 47606
:F1R2O!S{@R0
JC#~'CG0ITPUB个人空间C&kaY} zbbS
ITPUB个人空间iz8o8wm0V
ITPUB个人空间x~]4?&^-dGT
ITPUB个人空间pw[q2K3p a3e0@
ITPUB个人空间5Z)V8iN#d b?(MDq
ITPUB个人空间/c P!]2I K#Z
ITPUB个人空间BU5?$i~4U?
ITPUB个人空间hj~"B,@ld?

-m$t+`_Dp8y%Um8R{0eygle 's blog .
m8t B_Bg]`^7y0
h-W'i)`3T"h?'{g-B w v$~0
v+SL2x5gh'zK0ITPUB个人空间7k)}%\@)~ D%zC*s
链接:http://www.eygle.com/archives/20 ... stance_evicted.htmlITPUB个人空间&O1o9FB.?5S
ITPUB个人空间yU$E"^W$a%pv
ITPUB个人空间m&a"j w DR2y4h
ITPUB个人空间*@1D GZbx
IPC Send timeout 是 Oracle10g Rac中非常让人头痛的一个问题,在资源紧张、网络拥堵等情况下,就有可能发生IPC超时的问题,而RAC随后就会将问题节点驱逐,引发一轮重新配置。ITPUB个人空间g9j'Zt\
ITPUB个人空间Hv_.K$Q ~ z`)n
可喜的是Metalink上针对10.2.0.3有了一个Patch可以修正,而且在10.2.0.4中彻底修正了该问题。ITPUB个人空间x}|f ?;o |
常见的错误提示是这样的:ITPUB个人空间&yg|)p]1?:UN2GS:m]

kqo;^ [3g,~0
]&GLR)|-@K1Vm8t0
p'F!d@*z0Thu Nov 27 11:32:05 2008
?#Ci'bY0IPC Send timeout detected. Receiver ospid 4001974ITPUB个人空间(A6Kh/`J,~Iv8Q
Thu Nov 27 11:33:08 2008ITPUB个人空间8f`!Yr-s
Trace dumping is performing id=[cdmp_20081127113236]ITPUB个人空间/@Jdid
Thu Nov 27 11:34:37 2008
8n@cgwR&u0Errors in file /oracle/app/product/admin/srs/bdump/srs1_lms1_4001974.trc:ITPUB个人空间 n1cnBy yV
Thu Nov 27 11:34:38 2008ITPUB个人空间^%b7H:z!] FB'bc
Errors in file /oracle/app/product/admin/srs/bdump/srs1_lmon_3977348.trc:ITPUB个人空间d |J0Pf
ORA-29740: evicted by member 1, group incarnation 32
Nh9k$iK5jL k9Sv0Thu Nov 27 11:34:38 2008ITPUB个人空间(B X+[(ED1{t
LMON: terminating instance due to error 29740
dQ`'tFI6V*b]c$l;f]0
i'M+dDP!u~DpL0
2A$X)})_p0V f ]tZ3M;P0这个BUG号是Bug 5190596 。
U-`1|v,g+] R y6q0
1liF.Gkdr0在我的印象里10.2.0.3的确常有这个问题,而10.2.0.4却很少看到   
$Ug#L)}+Q(c0ITPUB个人空间 ~$w#Y ?OK3H
ITPUB个人空间9jO,{!Q lQ d

2x+a&c2F#Apr/j F8?0ITPUB个人空间*L)OF0q1^G

3{;m"G:X0j3H*mL0ITPUB个人空间ZL+O7@J!W
ITPUB个人空间1|C9xm7q
ITPUB个人空间&q4sLr Q(M I
---------------------------------------------------------------------------  ITPUB个人空间&w N~(a!nz Qh-ru m

/I{B [!og"O&n0
%w Z.X bo{c}b1f2|0
VbsTI&u0
h)F:@Z-l1qfI0M0Bug on windows
F(`)bcx1~6Y;]0ITPUB个人空间,K6~^E(v?7jy s
ITPUB个人空间$s @1f8o&h2`&@
Bug 6782276 Win: ORA-27508 from RAC IPC
1t qOuE$|2z @7?"[0ITPUB个人空间:`"u]*hZX4s
This note gives a brief overview of bug 6782276.
0BrE5h2vf*r+Y{ [5|0The content was last updated on: 03-APR-2009ITPUB个人空间+sW\h%a
Click here for details of each of the sections below.
v_#T4[4e*W#O+iv7g0ITPUB个人空间O CSZ:wR
Affects:ITPUB个人空间$j,A%YuTK
ITPUB个人空间c^0P1E@
Product (Component)ITPUB个人空间~TzA6|P ]9r
Oracle Server (Rdbms)ITPUB个人空间,g%^csL

/Md-E ydrx Wj.{0Range of versions believed to be affected
7vy-Kd0`5{V.r \ ^/J2s0Versions < 11.2ITPUB个人空间Q{![mRD6V-F
ITPUB个人空间,W!x%iN*[
Versions confirmed as being affected
8vz4S_NB011.1.0.6ITPUB个人空间ss&F J}
ITPUB个人空间*~+b,T9?%}V)J-S?:C
Platforms affectedITPUB个人空间N%sd6R9cD&hWqe'|
Windows/NT/XPITPUB个人空间r$t#IHFy
ITPUB个人空间4y dL[t \UA:W

M6K%N i!dI't4a0a_0Fixed:
+|G?v_0
P;I O ]YdB(Bf0This issue is fixed inITPUB个人空间)V$c!n!Bk
10.2.0.4 Patch 9 on Windows PlatformsITPUB个人空间g(w8];qs$Y*Q
11.1.0.7 (Server Patch Set)
+@.q+`%K+kE7R&E5}011.2 (Future Release)ITPUB个人空间'mLA/{S/BH
ITPUB个人空间jkbO@
Symptoms:
d}ze({ w2\ uh0Related To:ITPUB个人空间ZKi[ CI
ITPUB个人空间`3l't Pp
(None Specified)
LS7M:`%fO0ORA-27508 / ORA-27300ITPUB个人空间^vr,J%~ J:V3T
RAC (Real Application Clusters) / OPSITPUB个人空间)NRu;D-d TX;@.p q

P.A,^ _XX/m_#x7Vd j0     ITPUB个人空间)f)\:O L8P4Q+X4j
ITPUB个人空间V__;n"{Ap
DescriptionITPUB个人空间 p6Pe:v r*M P D+\
ITPUB个人空间 U,~~3fr'o
RAC instance on Windows may get failures such as:ITPUB个人空间yK6[!@M-z&cS

r9[ i;nbYB,rC0ORA-27508: IPC error sending a message
hW-S'P/H#n"zN t0
Nu\8zG;_0ORA-27300: OS system dependent operation:IPCSOCK_Send failed with status: 10055
~2d;q2II1dvt0ITPUB个人空间;x~h5pz9q#P
ORA-27301: OS failure message: An operation on a socket could not be performed ...ITPUB个人空间cs5G6a1j

cmk&?*n0H+^e'x0ORA-27302: failure occurred at: send_3
上一篇 Linux下Oracle随机自动启动脚本设置 下一篇 Oracle10g AWR (Automatic Workload Repository)
友荐云推荐
文章评论 以下网友留言只代表其个人观点,不代表本网站的观点和立场。
 相关文章推荐!