Re: [infinispan-dev] [Cloudtm-discussion] Transactional Distributed B+Tree over ISPN

Hi all, even the Cloud-TM project is officially over, we thought to share with you one of our last efforts, which unfortunately were a tad too late to make it into the submitted version of the platform (and deliverables etc). This is a scalable, distributed transactional index (B+tree) over ISPN, which combines a number of optimizations (in areas like data locality, concurrency, load balancing/elastic scaling) and builds over previous work (in particular, GMU [1] and Bumper [2]) that made it possible to achieve linear scalability up to 100 VMs even in update intensive workloads. Hot features: - at most 1 remote data access per each index operation thanks to : i) transaction migration, ii) combined use of full and partial replication (transparent and self-tuning depending on cluster size), iii) optimized data placement via customi hash functions - almost total avoidance of data contention thanks to the exploitation of commutativity operations on the index (via dirty reads and delayed actions) - it's built directly on top of ISPN (it does not depend on Fenix, unlike the collections' implementation that were used, e.g., by GeoGraph ). Details in the attached paper! We believe that this index implementation could be something generally useful for the ISPN community, especially given all the recent efforts in the areas of query. On the other hand, we should point out that the current implementation [3]: i) depends on transactional features (transaction migration, dirty reads, delayed actions) that have not been integrated in the official version of ISPN; ii) has been for the moment implemented as a Radargun extension, i.e. no effort was spent to modularize it/polish its API. ...so it would take some effort to have it fully integrated in the master version of ISPN.... but you know the saying: no pain no gain ;-) We'd love to hear your feedback of course! Nuno & Paolo [1] Sebastiano Peluso, Pedro Ruivo, Paolo Romano, Francesco Quaglia, and Luis Rodrigues,When Scalability Meets Consistency: Genuine Multiversion Update Serializable Partial Data Replication, 32nd International Conference on Distributed Computing Systems (ICDCS 2012) [2] Nuno Diegues and Paolo Romano,Bumper: Sheltering Transactions from Conflicts,The 32th IEEE Symposium on Reliable Distributed Systems (SRDS 2013), Braga, Portugal, Oct. 2013 [3] https://github.com/cloudtm/sti-bt <STI-BT-report.pdf> ------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.... _______________________________________________ Cloudtm-discussion mailing list Cloudtm-discussion(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion