[infinispan-dev] [Cloudtm-discussion] Transactional Distributed B+Tree over ISPN

[Shane Johnson]

+1

----- Original Message -----
From: "Randall Hauch" <rhauch at redhat.com>
To: "infinispan -Dev List" <infinispan-dev at lists.jboss.org>
Sent: Thursday, October 10, 2013 5:25:35 PM
Subject: Re: [infinispan-dev] [Cloudtm-discussion] Transactional Distributed	B+Tree over ISPN

"scalable, distributed transactional index (B+tree) over ISPN" 

This is **REALLY** interesting. Mark, can you send me the paper if it can't be attached to the mailing list? 

On Oct 3, 2013, at 12:38 PM, Mark Little < m.c.little at ncl.ac.uk > wrote: 




FYI I presented on the current state of cloud-TM at HPTS a week or so ago and there was much interest. I pointed people at our website. 

Sent from my iPad 

On 3 Oct 2013, at 18:16, Paolo Romano < romano at inesc-id.pt > wrote: 



Hi all, 

even the Cloud-TM project is officially over, we thought to share with you one of our last efforts, which unfortunately were a tad too late to make it into the submitted version of the platform (and deliverables etc). 

This is a scalable, distributed transactional index (B+tree) over ISPN, which combines a number of optimizations (in areas like data locality, concurrency, load balancing/elastic scaling) and builds over previous work (in particular, GMU [1] and Bumper [2]) that made it possible to achieve linear scalability up to 100 VMs even in update intensive workloads. 

Hot features: 
- at most 1 remote data access per each index operation thanks to : 
i) transaction migration, 
ii) combined use of full and partial replication (transparent and self-tuning depending on cluster size), 
iii) optimized data placement via customi hash functions 
- almost total avoidance of data contention thanks to the exploitation of commutativity operations on the index (via dirty reads and delayed actions) 
- it's built directly on top of ISPN (it does not depend on Fenix, unlike the collections' implementation that were used, e.g., by GeoGraph ). 

Details in the attached paper! 

We believe that this index implementation could be something generally useful for the ISPN community, especially given all the recent efforts in the areas of query. On the other hand, we should point out that the current implementation [3]: 
i) depends on transactional features (transaction migration, dirty reads, delayed actions) that have not been integrated in the official version of ISPN; 
ii) has been for the moment implemented as a Radargun extension, i.e. no effort was spent to modularize it/polish its API. 

...so it would take some effort to have it fully integrated in the master version of ISPN.... but you know the saying: no pain no gain ;-) 

We'd love to hear your feedback of course! 

Nuno & Paolo 

[1] Sebastiano Peluso, Pedro Ruivo, Paolo Romano , Francesco Quaglia, and Luis Rodrigues, When Scalability Meets Consistency: Genuine Multiversion Update Serializable Partial Data Replication, 32nd International Conference on Distributed Computing Systems (ICDCS 2012) 

[2] Nuno Diegues and Paolo Romano , Bumper: Sheltering Transactions from Conflicts , The 32th IEEE Symposium on Reliable Distributed Systems (SRDS 2013) , Braga, Portugal, Oct. 2013 

[3] https://github.com/cloudtm/sti-bt 

<STI-BT-report.pdf> 

------------------------------------------------------------------------------ 
October Webinars: Code for Performance 
Free Intel webinars can help you accelerate application performance. 
Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from 
the latest Intel processors and coprocessors. See abstracts and register > 
http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk 

_______________________________________________ 
Cloudtm-discussion mailing list 
Cloudtm-discussion at lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion 
_______________________________________________ 
infinispan-dev mailing list 
infinispan-dev at lists.jboss.org 
https://lists.jboss.org/mailman/listinfo/infinispan-dev 


_______________________________________________
infinispan-dev mailing list
infinispan-dev at lists.jboss.org
https://lists.jboss.org/mailman/listinfo/infinispan-dev