<div dir="ltr">Do you warm up your jvm prior to the testing?<div><br></div><div>Cheers,</div><div>Antoine</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 22, 2017 at 10:42 PM, SenthilKumar K <span dir="ltr"><<a href="mailto:senthilec566@gmail.com" target="_blank">senthilec566@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Bill n Antoine ..<div><br></div><div><br></div><div>Here is the updated one : ( tried without Kafka API ) .</div><div><br></div><div><div>public class HelloWorldServer {</div><div><br></div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>public static void main(final String[] args) {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span></div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>Undertow server = Undertow.builder().<wbr>addHttpListener(8009, "localhost").setHandler(new HttpHandler() {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>@Override</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>public void handleRequest(final HttpServerExchange exchange) throws Exception {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>if (exchange.getRequestMethod().<wbr>equals(Methods.POST)) {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>exchange.getRequestReceiver().<wbr>receiveFullString(new Receiver.FullStringCallback() {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> @Override</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> public void handle(HttpServerExchange exchange, String message) {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> <span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>System.out.println(" Received String ==> "+message);</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> exchange.getResponseSender().<wbr>send(message);</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> }</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> });</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>} else {</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>exchange.getResponseHeaders().<wbr>put(Headers.CONTENT_TYPE, "text/plain");</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>exchange.getResponseSender().<wbr>send("FAILURE");</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>}</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>}</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>}).build();</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>server.start();</div><div><span class="m_-3676070728771089480gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>}</div><div>}</div></div><div><br></div><div><br></div><div>Oops seems to no improvement :</div><div><br></div><div><div>Running 1m test @ <a href="http://localhost:8009/" target="_blank">http://localhost:8009/</a></div><div> 100 threads and 1000 connections</div><span class=""><div> Thread Stats Avg Stdev Max +/- Stdev</div></span><div> Latency 25.79ms 22.18ms 289.48ms 67.66%</div><div> Req/Sec 437.76 61.71 2.30k 80.26%</div><div> Latency Distribution</div><div> 50% 22.60ms</div><div> 75% 37.83ms</div><div> 90% 55.32ms</div><div> 99% 90.47ms</div><div> 2625607 requests in 1.00m, 2.76GB read</div><div><b>Requests/sec: 43688.42</b></div><div>Transfer/sec: 47.08MB</div></div><div><br></div><div><br></div><div>:-( :-( ..</div><div><br></div><div><br></div><div>--Senthil</div><div><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Jun 23, 2017 at 1:47 AM, Antoine Girard <span dir="ltr"><<a href="mailto:antoine.girard@ymail.com" target="_blank">antoine.girard@ymail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">You can use the Receiver API, specifically for that purpose.<div>On the exchange, call: getRequestReceiver();</div><div><br></div><div>You will get a receiver object:</div><div><a href="https://github.com/undertow-io/undertow/blob/master/core/src/main/java/io/undertow/io/Receiver.java" target="_blank">https://github.com/undertow-io<wbr>/undertow/blob/master/core/src<wbr>/main/java/io/undertow/io/Rece<wbr>iver.java</a><br></div><div><br></div><div>On the receiver you can call: receiveFullString, you have to pass it a callback that will be called when the whole body has been read.</div><div><br></div><div>Please share your results when you test this further!</div><div><br></div><div>Cheers,</div><div>Antoine</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_-3676070728771089480h5">On Thu, Jun 22, 2017 at 8:27 PM, SenthilKumar K <span dir="ltr"><<a href="mailto:senthilec566@gmail.com" target="_blank">senthilec566@gmail.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_-3676070728771089480h5"><div dir="ltr">Seems to Reading Request body is wrong , So what is the efficient way of reading request body in undertow ?<div><br></div><div>--Senthil</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jun 22, 2017 at 11:30 PM, SenthilKumar K <span dir="ltr"><<a href="mailto:senthilec566@gmail.com" target="_blank">senthilec566@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello Undertow Dev Team ,<div><br></div><div> I have been working on the use case where i should create simple http server to serve 1.5 Million Requests per Second per Instance .. </div><div><br></div><div><br></div><div>Here is the benchmark result of Undertow :</div><div><br></div><div><div>Running 1m test @ <a href="http://127.0.0.1:8009/" target="_blank">http://127.0.0.1:8009/</a></div><div> 20 threads and 40 connections</div><div> Thread Stats Avg Stdev Max +/- Stdev</div><div> Latency 2.51ms 10.75ms 282.22ms 99.28%</div><div> Req/Sec 1.12k 316.65 1.96k 54.50%</div><div> Latency Distribution</div><div> 50% 1.43ms</div><div> 75% 2.38ms</div><div> 90% 2.90ms</div><div> 99% 10.45ms</div><div> 1328133 requests in 1.00m, 167.19MB read</div><div>Requests/sec: <b>22127</b>.92</div><div>Transfer/sec: 2.79MB</div></div><div><br></div><div>This is less compared to other frameworks like Jetty and Netty .. But originally Undertow is high performant http server .. </div><div><br></div><div>Hardware details:</div><div><span style="color:rgb(128,128,128);font-family:arial,helvetica,"helvetica neue",verdana,sans-serif;font-size:14px">Xeon CPU E3-1270 v5 machine with 4 cores ( Clock 100 MHz, Capacity 4 GHz) , Memory : 32 G , Available memory 31 G.</span><br></div><div><br></div><div>I would need Undertow experts to review the server code below and advice me on tuning to achieve my goal( ~1.5 Million requests/sec ).</div><div><br></div><div>Server :</div><div><br></div><div><div>Undertow server = Undertow.builder()</div><div> .addHttpListener(8009, "localhost")</div><div> .setHandler(new Handler()).build();</div><div>server.start();</div></div><div><br></div><div><br></div><div>Handler.Java</div><div><br></div><div><div> final Pooled<ByteBuffer> pooledByteBuffer = </div><div> exchange.getConnection().getB<wbr>ufferPool().allocate();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>final ByteBuffer byteBuffer = pooledByteBuffer.getResource()<wbr>;</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> byteBuffer.clear();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> exchange.getRequestChannel().<wbr>read(byteBuffer);</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> int pos = byteBuffer.position();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> byteBuffer.rewind();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> byte[] bytes = new byte[pos];</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> byteBuffer.get(bytes);</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> String requestBody = new String(bytes, Charset.forName("UTF-8") );</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> byteBuffer.clear();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> pooledByteBuffer.free();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span> final PostToKafka post2Kafka = new PostToKafka();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>try {</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span><b>post2Kafka.write2Kafka(request<wbr>Body); { This API can handle ~2 Millions events per sec }</b></div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>} catch (Exception e) {</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>e.printStackTrace();</div><div><span class="m_-3676070728771089480m_-162504116655362687m_3588420656321499578m_5540164263429922309gmail-Apple-tab-span" style="white-space:pre-wrap"> </span>}</div><div> exchange.getResponseHeaders().<wbr>put(Headers.CONTENT_TYPE, "text/plain");</div><div> exchange.getResponseSender().s<wbr>end("SUCCESS");</div></div><div><br></div><div><br></div><div>--Senthil</div></div>
</blockquote></div><br></div>
<br></div></div><span>______________________________<wbr>_________________<br>
undertow-dev mailing list<br>
<a href="mailto:undertow-dev@lists.jboss.org" target="_blank">undertow-dev@lists.jboss.org</a><br>
<a href="https://lists.jboss.org/mailman/listinfo/undertow-dev" rel="noreferrer" target="_blank">https://lists.jboss.org/mailma<wbr>n/listinfo/undertow-dev</a><br></span></blockquote></div><br></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>