[
https://issues.jboss.org/browse/MODCLUSTER-239?page=com.atlassian.jira.pl...
]
Michal Babacek reopened MODCLUSTER-239:
---------------------------------------
Assignee: Jean-Frederic Clere (was: Michal Babacek)
I "managed" to get *500 Internal Server Error* here:
h3.RHEL 6 i386
{code:title=driver's log (debug)|borderStyle=solid}
2011/06/15 08:25:23:767 EDT [WARN ][Runner - 1536] HOST
perf09.mw.lab.eng.bos.redhat.com:rootProcess:sf - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
2011/06/15 08:25:23:768 EDT [WARN ][Runner - 1536] SFCORE_LOG - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
2011/06/15 08:25:23:768 EDT [WARN ][Runner - 1379] HOST
perf09.mw.lab.eng.bos.redhat.com:rootProcess:sf - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
2011/06/15 08:25:23:775 EDT [WARN ][Runner - 1379] SFCORE_LOG - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
{code}
{code:title=error_log (errors only)|borderStyle=solid}
[Wed Jun 15 08:25:23 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:25:23 2011] [error] ajp_read_header: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (70014)End of file found: ajp_ilink_receive() can't
receive header
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
read response failed from 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] ajp_read_header: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
read response failed from 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:25:23 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:25:23 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.179:8009 (10.16.88.179) failed
[Wed Jun 15 08:25:23 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.179
[Wed Jun 15 08:25:23 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.179:8009 (10.16.88.179) failed
[Wed Jun 15 08:25:23 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.179
[Wed Jun 15 08:25:23 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:25:23 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.179:8009 (10.16.88.179) failed
[Wed Jun 15 08:25:23 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.179
[Wed Jun 15 08:25:23 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:25:23 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:25:23 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.179:8009 (10.16.88.179)
[Wed Jun 15 08:25:23 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.179:8009 (10.16.88.179) failed
[Wed Jun 15 08:25:23 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.179
{code}
Complete httpd debug log:
[
11-ews-10-mod_cluster-rhel6-i386-failover-httpd.zip|http://scratch.englab...]
h3.RHEL 4 x86_64
{code:title=driver's log (debug)|borderStyle=solid}
2011/06/15 08:40:24:328 EDT [WARN ][Runner - 496] HOST
perf09.mw.lab.eng.bos.redhat.com:rootProcess:sf - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
2011/06/15 08:40:24:329 EDT [WARN ][Runner - 496] SFCORE_LOG - Error sampling data:
<org.jboss.smartfrog.loaddriver.RequestProcessingException: Invalid response code:
500
{code}
{code:title=error_log (errors only)|borderStyle=solid}
[Wed Jun 15 08:40:24 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:40:24 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:40:24 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:40:24 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:40:24 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.180:8009 (10.16.88.180)
[Wed Jun 15 08:40:24 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.180:8009 (10.16.88.180)
[Wed Jun 15 08:40:24 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:40:24 2011] [error] (104)Connection reset by peer: ajp_ilink_receive()
can't receive header
[Wed Jun 15 08:40:24 2011] [error] ajp_read_header: ajp_ilink_receive failed
[Wed Jun 15 08:40:24 2011] [error] (120006)APR does not understand this error code: proxy:
read response failed from 10.16.88.180:8009 (10.16.88.180)
[Wed Jun 15 08:40:24 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.180:8009 (10.16.88.180) failed
[Wed Jun 15 08:40:24 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.180:8009 (10.16.88.180) failed
[Wed Jun 15 08:40:24 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.180
[Wed Jun 15 08:40:24 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.180
[Wed Jun 15 08:40:24 2011] [error] ajp_handle_cping_cpong: ajp_ilink_receive failed
[Wed Jun 15 08:40:24 2011] [error] (120006)APR does not understand this error code: proxy:
AJP: cping/cpong failed to 10.16.88.180:8009 (10.16.88.180)
[Wed Jun 15 08:40:24 2011] [error] (111)Connection refused: proxy: AJP: attempt to connect
to 10.16.88.180:8009 (10.16.88.180) failed
[Wed Jun 15 08:40:24 2011] [error] proxy: AJP: failed to make connection to backend:
10.16.88.180
{code}
Complete httpd debug log:
[
3-ews-10-mod_cluster-rhel4-x86_64-failover-httpd.zip|http://scratch.engla...]
Any ideas...?
Failover triggers 500 Internal Server Error
-------------------------------------------
Key: MODCLUSTER-239
URL:
https://issues.jboss.org/browse/MODCLUSTER-239
Project: mod_cluster
Issue Type: Bug
Affects Versions: 1.0.10
Environment: failover tests killing nodes with -9
Reporter: Jean-Frederic Clere
Assignee: Jean-Frederic Clere
Fix For: MOD_CLUSTER_1_0_10_GA_CP01
Attachments: patch.txt
the access_log contains errors like:
10.16.89.42 - - [24/May/2011:13:54:52 -0500] "GET /st/SessionTestServlet?
HTTP/1.1" 500 608 "-" "Jakarta Commons-HttpClient/3.1"
error_log in debug shows the corresponding error:
+++
[Tue May 24 13:54:52 2011] [debug] mod_proxy_cluster.c(1245): proxy: byrequests balancer
DONE (ajp://10.16.88.180:8009)
[Tue May 24 13:54:52 2011] [debug] mod_proxy.c(1015): Running scheme balancer handler
(attempt 0)
[Tue May 24 13:54:52 2011] [debug] mod_proxy_http.c(1955): proxy: HTTP: declining URL
ajp://10.16.88.180:8009/st/SessionTestServlet?
[Tue May 24 13:54:52 2011] [debug] mod_proxy_ajp.c(668): proxy: AJP: serving URL
ajp://10.16.88.180:8009/st/SessionTestServlet?
[Tue May 24 13:54:52 2011] [debug] proxy_util.c(2011): proxy: AJP: has acquired
connection for (10.16.88.180)
[Tue May 24 13:54:52 2011] [debug] proxy_util.c(2067): proxy: connecting
ajp://10.16.88.180:8009/st/SessionTestServlet? to 10.16.88.180:8009
[Tue May 24 13:54:52 2011] [debug] proxy_util.c(2193): proxy: connected
/st/SessionTestServlet? to 10.16.88.180:8009
[Tue May 24 13:54:52 2011] [debug] ajp_utils.c(31): Into ajp_handle_cping_cpong
[Tue May 24 13:54:52 2011] [debug] ajp_utils.c(102): ajp_handle_cping_cpong: Done
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(224): Into ajp_marshal_into_msgb
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(290): ajp_marshal_into_msgb: Header[0]
[User-Agent] = [Jakarta Commons-HttpClient/3.1]
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(290): ajp_marshal_into_msgb: Header[1]
[Host] = [dev66:8888]
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(450): ajp_marshal_into_msgb: Done
[Tue May 24 13:54:52 2011] [debug] mod_proxy_ajp.c(265): proxy: APR_BUCKET_IS_EOS
[Tue May 24 13:54:52 2011] [debug] mod_proxy_ajp.c(270): proxy: data to read (max 8186 at
4)
[Tue May 24 13:54:52 2011] [debug] mod_proxy_ajp.c(285): proxy: got 0 bytes of data
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(687): ajp_read_header: ajp_ilink_received
09
[Tue May 24 13:54:52 2011] [debug] ajp_header.c(697): ajp_parse_type: got 09
[Tue May 24 13:54:52 2011] [debug] mod_proxy_ajp.c(555): proxy: Processing of request
failed backend: 1, output: 0
[Tue May 24 13:54:52 2011] [error] proxy: dialog to 10.16.88.180:8009 (10.16.88.180)
failed
+++
In fact it is due to failing cping/cpong a lot earlier:
+++
[Tue May 24 13:52:30 2011] [error] ajp_cping_cpong: apr_socket_recv failed
[Tue May 24 13:52:35 2011] [error] ajp_cping_cpong: apr_socket_recv failed
+++
--
This message is automatically generated by JIRA.
For more information on JIRA, see:
http://www.atlassian.com/software/jira