How to implement Streaming server like The Bayeux Protocol
Trustin Lee (이희승)
trustin at gmail.com
Tue Nov 24 11:21:13 EST 2009
Your ChunkedInput implementation never terminates since hasNextChunk()
always return true. Refer to the source code of the existing
ChunkedInput implementations to figure out how to implement it
correctly.
— Trustin Lee, http://gleamynode.net/
On Tue, Nov 24, 2009 at 11:51 PM, sumitatgharkikhoj
<mailtosumitsingh at gmail.com> wrote:
>
> chunked writer is same as above mentioned.
>
>
> sumitatgharkikhoj wrote:
>>
>> Hi Trustin, i replaced the line in the static file server example:
>> //ChannelFuture writeFuture = ch.write(new ChunkedFile(raf, 0,
>> fileLength, 8192));
>> with line :
>> ChannelFuture writeFuture = e.getChannel().write(new
>> ChunkedInput() {
>>
>> my server still getting blocked after two requests all other requests get
>> piled up.
>> What i did:
>> 1) Took the example httpstatic file server
>> 2) Instead of using chunked file use my own chunked input
>> 3) Opened three different browsers: firefox, chrmoe,ie ( to make sure the
>> test does not gets affected by browser)
>> 4) First two requests succeed and data starts streaming to both firefox
>> and chrome but ie request does not event reach my handler.
>> 5) When i escape or close one of the browser the third request goes
>> through and my static file server handler gets the response.
>>
>> I still get the same results the server gets blocked.
>>
>>
>>
>>
>> Trustin Lee wrote:
>>>
>>> On Tue, Nov 24, 2009 at 1:02 PM, sumitatgharkikhoj
>>> <mailtosumitsingh at gmail.com> wrote:
>>>>
>>>> First of all thank you for the nice framework, forum and documentation.
>>>> My problem is i am trying to write a http server with small footprint (
>>>> will
>>>> go as a component in bigger framework) but it needs to have streaming
>>>> support .
>>>> Different clients will connect at different times ranging from 100-1000
>>>> clients max and this server will be used for both streaming and short
>>>> data.
>>>> the data is streamed using XHR multipart request and continously (24/7)
>>>> .
>>>> But when i used the example code (please see below) the server blocks
>>>> after
>>>> first thread.
>>>
>>> In your handler, you check if the returned future.isSuccess() is true
>>> or false right after calling write(). It will be almost always false
>>> because the write operation is asynchronous. You are using
>>> ChunkedInput, so I'd recommend you take a look into the
>>> HttpStaticFileServerHandler.
>>>
>>>> Other option that i tried was jetty with continuation or cometd but i am
>>>> more inclined about netty (since i want to replace my mina udp layer
>>>> with
>>>> mina and maintain one single library ).
>>>>
>>>> Any help will be appreciated, I have my machine available via webex to
>>>> debug
>>>> as well.
>>>>
>>>>
>>>> my server gets block at second request in the following code :
>>>>
>>>> 1) in my http server:
>>>> ServerBootstrap bootstrap = new ServerBootstrap(new
>>>> NioServerSocketChannelFactory(Executors.newCachedThreadPool(),Executors.newCachedThreadPool()));
>>>> bootstrap.setPipelineFactory(new
>>>> HttpServerPipelineFactory(requestHandler));
>>>> bootstrap.bind(new InetSocketAddress(8080));
>>>> 2) in my pipelinefactory:
>>>> public ChannelPipeline getPipeline() throws Exception {
>>>> ChannelPipeline pipeline = pipeline();
>>>> pipeline.addLast("decoder", new HttpRequestDecoder());
>>>> pipeline.addLast("encoder", new HttpResponseEncoder());
>>>> pipeline.addLast("chunkedWriter", new ChunkedWriteHandler());
>>>> pipeline.addLast("handler", requestHandler);
>>>> return pipeline;
>>>> 3)my http request handler sends event using following code
>>>> private void writeResponse(MessageEvent e) {
>>>> ChannelBuffer buf =
>>>> ChannelBuffers.copiedBuffer(responseContent.toString(), "UTF-8");
>>>> buf.setBytes(0, responseContent.toString().getBytes() );
>>>> responseContent.setLength(0);
>>>> boolean close =
>>>> HttpHeaders.Values.CLOSE.equalsIgnoreCase(request
>>>> .getHeader(HttpHeaders.Names.CONNECTION))
>>>> ||
>>>> request.getProtocolVersion().equals(HttpVersion.HTTP_1_0)
>>>> &&
>>>> !HttpHeaders.Values.KEEP_ALIVE.equalsIgnoreCase(request
>>>>
>>>> .getHeader(HttpHeaders.Names.CONNECTION));
>>>>
>>>> HttpResponse response = new
>>>> DefaultHttpResponse(HttpVersion.HTTP_1_1,
>>>> HttpResponseStatus.OK);
>>>> //response.setContent(buf);
>>>> //response.setHeader(HttpHeaders.Names.CONTENT_TYPE,
>>>> "text/html;
>>>> charset=UTF-8");
>>>> response.setHeader(HttpHeaders.Names.CONTENT_TYPE,
>>>> "multipart/x-mixed-replace;boundary=XXoXoX");
>>>> //if (!close)
>>>> {
>>>> response.setHeader("Connection", "Keep-Alive");
>>>> response.setHeader("Cache-Control", "no-cache");
>>>> response.setHeader("Access-Control-Allow-Origin",
>>>> "*");
>>>> }
>>>>
>>>> String cookieString =
>>>> request.getHeader(HttpHeaders.Names.COOKIE);
>>>> if (cookieString != null) {
>>>> CookieDecoder cookieDecoder = new
>>>> CookieDecoder();
>>>> Set<Cookie> cookies =
>>>> cookieDecoder.decode(cookieString);
>>>> if (!cookies.isEmpty()) {
>>>> CookieEncoder cookieEncoder = new
>>>> CookieEncoder(true);
>>>> for (Cookie cookie : cookies) {
>>>> cookieEncoder.addCookie(cookie);
>>>> }
>>>>
>>>> response.addHeader(HttpHeaders.Names.SET_COOKIE,
>>>> cookieEncoder.encode());
>>>> }
>>>> }
>>>> ChannelFuture future =null;
>>>> future = e.getChannel().write(response);
>>>> String temp ="";
>>>>
>>>> if(future.isSuccess()==false)
>>>> return;
>>>>
>>>> e.getChannel().write(new ChunkedInput() {
>>>>
>>>> int i = 0;
>>>> public Object nextChunk() throws Exception {
>>>> i++;
>>>> String temp ="";
>>>> //temp ="--XXoXoX\r\n";
>>>> temp = "Content-Type: text/plain
>>>> \r\n\r\n";
>>>> temp += "{\"data\":\""+i+"\"}";
>>>> temp +="\r\n--XXoXoX\r\n";
>>>> ChannelBuffer buf2 =
>>>> ChannelBuffers.copiedBuffer(temp.toString(),
>>>> "UTF-8");
>>>> Thread.sleep(100);
>>>> return buf2;
>>>> }
>>>>
>>>> @Override
>>>> public boolean hasNextChunk() throws Exception {
>>>> return true;
>>>> }
>>>>
>>>> @Override
>>>> public void close() throws Exception {
>>>> // TODO Auto-generated method stub
>>>>
>>>> }
>>>> });
>>>>
>>>> if(close){
>>>> future.addListener(ChannelFutureListener.CLOSE);
>>>> }
>>>> }
>>>>
>>>> --
>>>> View this message in context:
>>>> http://n2.nabble.com/How-to-implement-Streaming-server-like-The-Bayeux-Protocol-tp4055722p4055722.html
>>>> Sent from the Netty User Group mailing list archive at Nabble.com.
>>>> _______________________________________________
>>>> netty-users mailing list
>>>> netty-users at lists.jboss.org
>>>> https://lists.jboss.org/mailman/listinfo/netty-users
>>>>
>>>
>>> — Trustin Lee, http://gleamynode.net/
>>>
>>> _______________________________________________
>>> netty-users mailing list
>>> netty-users at lists.jboss.org
>>> https://lists.jboss.org/mailman/listinfo/netty-users
>>>
>>>
>>
>>
>
> --
> View this message in context: http://n2.nabble.com/How-to-implement-Streaming-server-like-The-Bayeux-Protocol-tp4055722p4058231.html
> Sent from the Netty User Group mailing list archive at Nabble.com.
>
> _______________________________________________
> netty-users mailing list
> netty-users at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/netty-users
>
More information about the netty-users
mailing list