How to implement Streaming server like The Bayeux Protocol

[sumitatgharkikhoj]

chunked writer is same as above mentioned.


sumitatgharkikhoj wrote:
> 
> Hi Trustin, i replaced the line in the static file server example:
>  //ChannelFuture writeFuture = ch.write(new ChunkedFile(raf, 0,
> fileLength, 8192));
> with line :
>         ChannelFuture writeFuture = e.getChannel().write(new
> ChunkedInput() {
> 
> my server still getting blocked after two requests all other requests get
> piled up.
> What i did:
> 1) Took the example httpstatic file server
> 2) Instead of using chunked file use my own chunked input
> 3) Opened three different browsers: firefox, chrmoe,ie  ( to make sure the
> test does not gets affected by browser)
> 4) First two requests succeed and data starts streaming to both firefox
> and chrome but ie request does not event reach my handler.
> 5) When i escape or close one of the browser the third request goes
> through and my static file server handler gets the response.
> 
> I still get the same results the server gets blocked.
> 
> 
> 
> 
> Trustin Lee wrote:
>> 
>> On Tue, Nov 24, 2009 at 1:02 PM, sumitatgharkikhoj
>> <mailtosumitsingh at gmail.com> wrote:
>>>
>>> First of all thank you for the nice framework, forum and documentation.
>>> My problem is i am trying to write a http server with small footprint (
>>> will
>>> go as a component in bigger framework) but it needs to have streaming
>>> support .
>>> Different clients will connect at different times ranging from 100-1000
>>> clients max and this server will be used for both streaming and short
>>> data.
>>> the data is streamed using XHR multipart request and continously (24/7)
>>> .
>>> But when i used the example code (please see below) the server blocks
>>> after
>>> first thread.
>> 
>> In your handler, you check if the returned future.isSuccess() is true
>> or false right after calling write().  It will be almost always false
>> because the write operation is asynchronous.  You are using
>> ChunkedInput, so I'd recommend you take a look into the
>> HttpStaticFileServerHandler.
>> 
>>> Other option that i tried was jetty with continuation or cometd but i am
>>> more inclined about netty (since i want to replace my mina udp layer
>>> with
>>> mina and maintain one single library ).
>>>
>>> Any help will be appreciated, I have my machine available via webex to
>>> debug
>>> as well.
>>>
>>>
>>> my server gets block at second request in the following code :
>>>
>>> 1) in my http server:
>>>           ServerBootstrap bootstrap = new ServerBootstrap(new
>>> NioServerSocketChannelFactory(Executors.newCachedThreadPool(),Executors.newCachedThreadPool()));
>>>           bootstrap.setPipelineFactory(new
>>> HttpServerPipelineFactory(requestHandler));
>>>          bootstrap.bind(new InetSocketAddress(8080));
>>> 2) in my pipelinefactory:
>>>    public ChannelPipeline getPipeline() throws Exception {
>>>        ChannelPipeline pipeline = pipeline();
>>>        pipeline.addLast("decoder", new HttpRequestDecoder());
>>>        pipeline.addLast("encoder", new HttpResponseEncoder());
>>>        pipeline.addLast("chunkedWriter", new ChunkedWriteHandler());
>>>        pipeline.addLast("handler", requestHandler);
>>>        return pipeline;
>>> 3)my http request handler sends event using following code
>>>        private void writeResponse(MessageEvent e) {
>>>                ChannelBuffer buf =
>>> ChannelBuffers.copiedBuffer(responseContent.toString(), "UTF-8");
>>>                buf.setBytes(0, responseContent.toString().getBytes() );
>>>                responseContent.setLength(0);
>>>                boolean close =
>>>  HttpHeaders.Values.CLOSE.equalsIgnoreCase(request
>>>                                .getHeader(HttpHeaders.Names.CONNECTION))
>>>                                ||
>>> request.getProtocolVersion().equals(HttpVersion.HTTP_1_0)
>>>                                &&
>>> !HttpHeaders.Values.KEEP_ALIVE.equalsIgnoreCase(request
>>>                                              
>>>  .getHeader(HttpHeaders.Names.CONNECTION));
>>>
>>>                HttpResponse response = new
>>> DefaultHttpResponse(HttpVersion.HTTP_1_1,
>>> HttpResponseStatus.OK);
>>>                //response.setContent(buf);
>>>                //response.setHeader(HttpHeaders.Names.CONTENT_TYPE,
>>> "text/html;
>>> charset=UTF-8");
>>>                response.setHeader(HttpHeaders.Names.CONTENT_TYPE,
>>> "multipart/x-mixed-replace;boundary=XXoXoX");
>>>                //if (!close)
>>>                {
>>>                        response.setHeader("Connection", "Keep-Alive");
>>>                        response.setHeader("Cache-Control", "no-cache");
>>>                        response.setHeader("Access-Control-Allow-Origin",
>>> "*");
>>>                }
>>>
>>>                String cookieString =
>>> request.getHeader(HttpHeaders.Names.COOKIE);
>>>                if (cookieString != null) {
>>>                        CookieDecoder cookieDecoder = new
>>> CookieDecoder();
>>>                        Set<Cookie> cookies =
>>> cookieDecoder.decode(cookieString);
>>>                        if (!cookies.isEmpty()) {
>>>                                CookieEncoder cookieEncoder = new
>>> CookieEncoder(true);
>>>                                for (Cookie cookie : cookies) {
>>>                                        cookieEncoder.addCookie(cookie);
>>>                                }
>>>                              
>>>  response.addHeader(HttpHeaders.Names.SET_COOKIE,
>>> cookieEncoder.encode());
>>>                        }
>>>                }
>>>                ChannelFuture future =null;
>>>                future = e.getChannel().write(response);
>>>                String temp ="";
>>>
>>>                if(future.isSuccess()==false)
>>>                        return;
>>>
>>>                e.getChannel().write(new ChunkedInput() {
>>>
>>>                        int i = 0;
>>>                        public Object nextChunk() throws Exception {
>>>                                i++;
>>>                                String temp ="";
>>>                                //temp ="--XXoXoX\r\n";
>>>                                temp = "Content-Type: text/plain
>>> \r\n\r\n";
>>>                                temp += "{\"data\":\""+i+"\"}";
>>>                                temp +="\r\n--XXoXoX\r\n";
>>>                                ChannelBuffer buf2 =
>>> ChannelBuffers.copiedBuffer(temp.toString(),
>>> "UTF-8");
>>>                                Thread.sleep(100);
>>>                                return buf2;
>>>                        }
>>>
>>>                        @Override
>>>                        public boolean hasNextChunk() throws Exception {
>>>                                        return true;
>>>                        }
>>>
>>>                        @Override
>>>                        public void close() throws Exception {
>>>                                // TODO Auto-generated method stub
>>>
>>>                        }
>>>                });
>>>
>>>        if(close){
>>>                future.addListener(ChannelFutureListener.CLOSE);
>>>        }
>>>        }
>>>
>>> --
>>> View this message in context:
>>> http://n2.nabble.com/How-to-implement-Streaming-server-like-The-Bayeux-Protocol-tp4055722p4055722.html
>>> Sent from the Netty User Group mailing list archive at Nabble.com.
>>> _______________________________________________
>>> netty-users mailing list
>>> netty-users at lists.jboss.org
>>> https://lists.jboss.org/mailman/listinfo/netty-users
>>>
>> 
>> — Trustin Lee, http://gleamynode.net/
>> 
>> _______________________________________________
>> netty-users mailing list
>> netty-users at lists.jboss.org
>> https://lists.jboss.org/mailman/listinfo/netty-users
>> 
>> 
> 
> 

-- 
View this message in context: http://n2.nabble.com/How-to-implement-Streaming-server-like-The-Bayeux-Protocol-tp4055722p4058231.html
Sent from the Netty User Group mailing list archive at Nabble.com.