[undertow-dev] Undertow Http Server - Handling 2 Millions Requests Per Second Per Instance

[Antoine Girard]

Do you warm up your jvm prior to the testing?

Cheers,
Antoine

On Thu, Jun 22, 2017 at 10:42 PM, SenthilKumar K <senthilec566 at gmail.com>
wrote:

> Thanks Bill n Antoine ..
>
>
> Here is the updated one : ( tried without Kafka API ) .
>
> public class HelloWorldServer {
>
> public static void main(final String[] args) {
> Undertow server = Undertow.builder().addHttpListener(8009,
> "localhost").setHandler(new HttpHandler() {
> @Override
> public void handleRequest(final HttpServerExchange exchange) throws
> Exception {
> if (exchange.getRequestMethod().equals(Methods.POST)) {
> exchange.getRequestReceiver().receiveFullString(new
> Receiver.FullStringCallback() {
>                    @Override
>                    public void handle(HttpServerExchange exchange, String
> message) {
>                     System.out.println(" Received String ==> "+message);
>                        exchange.getResponseSender().send(message);
>                    }
>                });
> } else {
> exchange.getResponseHeaders().put(Headers.CONTENT_TYPE, "text/plain");
> exchange.getResponseSender().send("FAILURE");
> }
> }
> }).build();
> server.start();
> }
> }
>
>
> Oops seems to no improvement :
>
> Running 1m test @ http://localhost:8009/
>   100 threads and 1000 connections
>   Thread Stats   Avg      Stdev     Max   +/- Stdev
>     Latency    25.79ms   22.18ms 289.48ms   67.66%
>     Req/Sec   437.76     61.71     2.30k    80.26%
>   Latency Distribution
>      50%   22.60ms
>      75%   37.83ms
>      90%   55.32ms
>      99%   90.47ms
>   2625607 requests in 1.00m, 2.76GB read
> *Requests/sec:  43688.42*
> Transfer/sec:     47.08MB
>
>
> :-( :-( ..
>
>
> --Senthil
>
>
> On Fri, Jun 23, 2017 at 1:47 AM, Antoine Girard <antoine.girard at ymail.com>
> wrote:
>
>> You can use the Receiver API, specifically for that purpose.
>> On the exchange, call: getRequestReceiver();
>>
>> You will get a receiver object:
>> https://github.com/undertow-io/undertow/blob/master/core/src
>> /main/java/io/undertow/io/Receiver.java
>>
>> On the receiver you can call: receiveFullString, you have to pass it a
>> callback that will be called when the whole body has been read.
>>
>> Please share your results when you test this further!
>>
>> Cheers,
>> Antoine
>>
>>
>> On Thu, Jun 22, 2017 at 8:27 PM, SenthilKumar K <senthilec566 at gmail.com>
>> wrote:
>>
>>> Seems to Reading Request body is wrong , So what is the efficient way of
>>> reading request body in undertow ?
>>>
>>> --Senthil
>>>
>>> On Thu, Jun 22, 2017 at 11:30 PM, SenthilKumar K <senthilec566 at gmail.com
>>> > wrote:
>>>
>>>> Hello Undertow Dev Team ,
>>>>
>>>>       I have been working on the use case where i should create simple
>>>> http server to serve 1.5 Million Requests per Second per Instance ..
>>>>
>>>>
>>>> Here is the benchmark result of Undertow :
>>>>
>>>> Running 1m test @ http://127.0.0.1:8009/
>>>>   20 threads and 40 connections
>>>>   Thread Stats   Avg      Stdev     Max   +/- Stdev
>>>>     Latency     2.51ms   10.75ms 282.22ms   99.28%
>>>>     Req/Sec     1.12k   316.65     1.96k    54.50%
>>>>   Latency Distribution
>>>>      50%    1.43ms
>>>>      75%    2.38ms
>>>>      90%    2.90ms
>>>>      99%   10.45ms
>>>>   1328133 requests in 1.00m, 167.19MB read
>>>> Requests/sec:  *22127*.92
>>>> Transfer/sec:      2.79MB
>>>>
>>>> This is less compared to other frameworks like Jetty and Netty .. But
>>>> originally Undertow is high performant http server ..
>>>>
>>>> Hardware details:
>>>> Xeon CPU E3-1270 v5 machine with 4 cores ( Clock 100 MHz, Capacity 4
>>>> GHz) , Memory : 32 G , Available memory 31 G.
>>>>
>>>> I would need Undertow experts to review the server code below and
>>>> advice me on tuning to achieve my goal( ~1.5 Million requests/sec ).
>>>>
>>>> Server :
>>>>
>>>> Undertow server = Undertow.builder()
>>>>                .addHttpListener(8009, "localhost")
>>>>                .setHandler(new Handler()).build();
>>>> server.start();
>>>>
>>>>
>>>> Handler.Java
>>>>
>>>>     final Pooled<ByteBuffer> pooledByteBuffer =
>>>>                  exchange.getConnection().getBufferPool().allocate();
>>>> final ByteBuffer byteBuffer = pooledByteBuffer.getResource();
>>>>    byteBuffer.clear();
>>>>    exchange.getRequestChannel().read(byteBuffer);
>>>>    int pos = byteBuffer.position();
>>>>    byteBuffer.rewind();
>>>>    byte[] bytes = new byte[pos];
>>>>    byteBuffer.get(bytes);
>>>>    String requestBody = new String(bytes, Charset.forName("UTF-8") );
>>>>    byteBuffer.clear();
>>>>    pooledByteBuffer.free();
>>>>    final PostToKafka post2Kafka = new PostToKafka();
>>>> try {
>>>> *post2Kafka.write2Kafka(requestBody);  { This API can handle  ~2
>>>> Millions events per sec }*
>>>> } catch (Exception e) {
>>>> e.printStackTrace();
>>>> }
>>>>     exchange.getResponseHeaders().put(Headers.CONTENT_TYPE,
>>>> "text/plain");
>>>>     exchange.getResponseSender().send("SUCCESS");
>>>>
>>>>
>>>> --Senthil
>>>>
>>>
>>>
>>> _______________________________________________
>>> undertow-dev mailing list
>>> undertow-dev at lists.jboss.org
>>> https://lists.jboss.org/mailman/listinfo/undertow-dev
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/undertow-dev/attachments/20170622/d5fb7ba8/attachment.html