[infinispan-dev] Benchmarking Hadoop/Infinispan M/R implementation

Vladimir Blagojevic vblagoje at redhat.com
Thu Jul 31 08:19:05 EDT 2014


Yes, that is what I had in mind Gustavo. I'll see how I can adapt these 
Mapper/Reducer classes for the sorting benchmark. We can run our native, 
Hadoop/HDFS and Hadoop/Infinispan variants. That way we could get some 
really interesting results.

Vladimir
On 2014-07-31, 6:03 AM, Gustavo Fernandes wrote:
> Yes, that would be interesting!
>
> Also, what do you think of running this benchmark on top of Infinispan 
> native map-reduce implementation, to compare with Hadoop/HDFS and 
> Hadoop/Infinispan?
>
>
> Gustavo
>
>
> On Thu, Jul 31, 2014 at 9:20 AM, Vladimir Blagojevic 
> <vblagoje at redhat.com <mailto:vblagoje at redhat.com>> wrote:
>
>     Pedro/Gustavo,
>
>     How do you plan to benchmark our Hadoop implementation? It seems
>     TeraSort benchmark suite is an interesting option. Maybe not using
>     1 TB data set right away, but eventually, why not? Especially now
>     that we can easily run 500 nodes cluster on GCE. I would love to
>     see if we can, when you guys start benchmarking our Hadoop impl,
>     give TeraSort a run on a regular Map/Reduce implementation as well.
>
>     What do you think?
>
>     Vladimir
>
>     [1]
>     http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/#terasort-benchmark-suite
>
>
>     _______________________________________________
>     infinispan-dev mailing list
>     infinispan-dev at lists.jboss.org <mailto:infinispan-dev at lists.jboss.org>
>     https://lists.jboss.org/mailman/listinfo/infinispan-dev
>
>
>
>
> _______________________________________________
> infinispan-dev mailing list
> infinispan-dev at lists.jboss.org
> https://lists.jboss.org/mailman/listinfo/infinispan-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.jboss.org/pipermail/infinispan-dev/attachments/20140731/23b364d1/attachment.html 


More information about the infinispan-dev mailing list