FYI I presented on the current state of cloud-TM at HPTS a week or so ago and there was much interest. I pointed people at our website. Sent from my iPad On 3 Oct 2013, at 18:16, Paolo Romano <romano(a)inesc-id.pt&gt; wrote: > Hi all, > > even the Cloud-TM project is officially over, we thought to share with you one of our last efforts, which unfortunately were a tad too late to make it into the submitted version of the platform (and deliverables etc). > > This is a scalable, distributed transactional index (B+tree) over ISPN, which combines a number of optimizations (in areas like data locality, concurrency, load balancing/elastic scaling) and builds over previous work (in particular, GMU [1] and Bumper [2]) that made it possible to achieve linear scalability up to 100 VMs even in update intensive workloads. > > Hot features: > - at most 1 remote data access per each index operation thanks to : > i) transaction migration, > ii) combined use of full and partial replication (transparent and self-tuning depending on cluster size), > iii) optimized data placement via customi hash functions > - almost total avoidance of data contention thanks to the exploitation of commutativity operations on the index (via dirty reads and delayed actions) > - it's built directly on top of ISPN (it does not depend on Fenix, unlike the collections' implementation that were used, e.g., by GeoGraph ). > > Details in the attached paper! > > We believe that this index implementation could be something generally useful for the ISPN community, especially given all the recent efforts in the areas of query. On the other hand, we should point out that the current implementation [3]: > i) depends on transactional features (transaction migration, dirty reads, delayed actions) that have not been integrated in the official version of ISPN; > ii) has been for the moment implemented as a Radargun extension, i.e. no effort was spent to modularize it/polish its API. > > ...so it would take some effort to have it fully integrated in the master version of ISPN.... but you know the saying: no pain no gain ;-) > > We'd love to hear your feedback of course! > > Nuno & Paolo > > [1] Sebastiano Peluso, Pedro Ruivo, Paolo Romano, Francesco Quaglia, and Luis Rodrigues,When Scalability Meets Consistency: Genuine Multiversion Update Serializable Partial Data Replication, 32nd International Conference on Distributed Computing Systems (ICDCS 2012) > > [2] Nuno Diegues and Paolo Romano,Bumper: Sheltering Transactions from Conflicts,The 32th IEEE Symposium on Reliable Distributed Systems (SRDS 2013), Braga, Portugal, Oct. 2013 > > [3] https://github.com/cloudtm/sti-bt > <STI-BT-report.pdf> > ------------------------------------------------------------------------------ > October Webinars: Code for Performance > Free Intel webinars can help you accelerate application performance. > Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from > the latest Intel processors and coprocessors. See abstracts and register > > http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.... > _______________________________________________ > Cloudtm-discussion mailing list > Cloudtm-discussion(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev

Also, it looks like https://github.com/cloudtm/sti-bt is licensed under LGPL2.1. Would you might asking if they'd consider relicensing under ASL2.0 so that it's more compatible with the relicensed ISPN? On Oct 10, 2013, at 5:25 PM, Randall Hauch <rhauch(a)redhat.com <mailto:rhauch@redhat.com>> wrote: > "scalable, distributed transactional index (B+tree) over ISPN" > > This is **REALLY** interesting. Mark, can you send me the paper if it > can't be attached to the mailing list? > > On Oct 3, 2013, at 12:38 PM, Mark Little <m.c.little(a)ncl.ac.uk > <mailto:m.c.little@ncl.ac.uk>> wrote: > >> FYI I presented on the current state of cloud-TM at HPTS a week or >> so ago and there was much interest. I pointed people at our website. >> >> Sent from my iPad >> >> On 3 Oct 2013, at 18:16, Paolo Romano <romano(a)inesc-id.pt >> <mailto:romano@inesc-id.pt>> wrote: >> >>> Hi all, >>> >>> even the Cloud-TM project is officially over, we thought to share >>> with you one of our last efforts, which unfortunately were a tad >>> too late to make it into the submitted version of the platform (and >>> deliverables etc). >>> >>> This is a scalable, distributed transactional index (B+tree) over >>> ISPN, which combines a number of optimizations (in areas like data >>> locality, concurrency, load balancing/elastic scaling) and builds >>> over previous work (in particular, GMU [1] and Bumper [2]) that >>> made it possible to achieve linear scalability up to 100 VMs even >>> in update intensive workloads. >>> >>> Hot features: >>> - at most 1 remote data access per each index operation thanks to : >>> i) transaction migration, >>> ii) combined use of full and partial replication (transparent >>> and self-tuning depending on cluster size), >>> iii) optimized data placement via customi hash functions >>> - almost total avoidance of data contention thanks to the >>> exploitation of commutativity operations on the index (via dirty >>> reads and delayed actions) >>> - it's built directly on top of ISPN (it does not depend on Fenix, >>> unlike the collections' implementation that were used, e.g., by >>> GeoGraph ). >>> >>> Details in the attached paper! >>> >>> We believe that this index implementation could be something >>> generally useful for the ISPN community, especially given all the >>> recent efforts in the areas of query. On the other hand, we should >>> point out that the current implementation [3]: >>> i) depends on transactional features (transaction migration, dirty >>> reads, delayed actions) that have not been integrated in the >>> official version of ISPN; >>> ii) has been for the moment implemented as a Radargun extension, >>> i.e. no effort was spent to modularize it/polish its API. >>> >>> ...so it would take some effort to have it fully integrated in the >>> master version of ISPN.... but you know the saying: no pain no >>> gain ;-) >>> >>> We'd love to hear your feedback of course! >>> >>> Nuno & Paolo >>> >>> [1] Sebastiano Peluso, Pedro Ruivo,**Paolo**Romano** >>> <http://www.gsd.inesc-id.pt/%7Eromanop>;, Francesco Quaglia, and >>> Luis Rodrigues,*When Scalability Meets Consistency: Genuine >>> Multiversion Update Serializable Partial Data Replication, >>> <http://www.gsd.inesc-id.pt/%7Eromanop/files/papers/icdcs12.pdf>*/**32nd >>> International Conference on Distributed Computing Systems (ICDCS 2012)/ >>> >>> [2] Nuno Diegues and**Paolo**Romano** >>> <http://www.gsd.inesc-id.pt/%7Eromanop>,*Bumper: Sheltering >>> Transactions from Conflicts >>> <http://www.gsd.inesc-id.pt/%7Eromanop/files/papers/SRDS13.pdf>*,//The >>> 32th IEEE Symposium on Reliable Distributed Systems (SRDS 2013)/, >>> Braga, Portugal, Oct. 2013/ >>> >>> [3] https://github.com/cloudtm/sti-bt >>> <STI-BT-report.pdf> >>> ------------------------------------------------------------------------------ >>> October Webinars: Code for Performance >>> Free Intel webinars can help you accelerate application performance. >>> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the >>> most from >>> the latest Intel processors and coprocessors. See abstracts and >>> register > >>> http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.... >>> _______________________________________________ >>> Cloudtm-discussion mailing list >>> Cloudtm-discussion(a)lists.sourceforge.net >>> <mailto:Cloudtm-discussion@lists.sourceforge.net> >>> https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion >> _______________________________________________ >> infinispan-dev mailing list >> infinispan-dev(a)lists.jboss.org <mailto:infinispan-dev@lists.jboss.org> >> https://lists.jboss.org/mailman/listinfo/infinispan-dev > > _______________________________________________ > infinispan-dev mailing list > infinispan-dev(a)lists.jboss.org <mailto:infinispan-dev@lists.jboss.org> > https://lists.jboss.org/mailman/listinfo/infinispan-dev _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev

+1 ----- Original Message ----- From: "Randall Hauch" <rhauch(a)redhat.com&gt; To: "infinispan -Dev List" <infinispan-dev(a)lists.jboss.org&gt; Sent: Thursday, October 10, 2013 5:25:35 PM Subject: Re: [infinispan-dev] [Cloudtm-discussion] Transactional Distributed B+Tree over ISPN "scalable, distributed transactional index (B+tree) over ISPN" This is **REALLY** interesting. Mark, can you send me the paper if it can't be attached to the mailing list? On Oct 3, 2013, at 12:38 PM, Mark Little < m.c.little(a)ncl.ac.uk > wrote: FYI I presented on the current state of cloud-TM at HPTS a week or so ago and there was much interest. I pointed people at our website. Sent from my iPad On 3 Oct 2013, at 18:16, Paolo Romano < romano(a)inesc-id.pt > wrote: Hi all, even the Cloud-TM project is officially over, we thought to share with you one of our last efforts, which unfortunately were a tad too late to make it into the submitted version of the platform (and deliverables etc). This is a scalable, distributed transactional index (B+tree) over ISPN, which combines a number of optimizations (in areas like data locality, concurrency, load balancing/elastic scaling) and builds over previous work (in particular, GMU [1] and Bumper [2]) that made it possible to achieve linear scalability up to 100 VMs even in update intensive workloads. Hot features: - at most 1 remote data access per each index operation thanks to : i) transaction migration, ii) combined use of full and partial replication (transparent and self-tuning depending on cluster size), iii) optimized data placement via customi hash functions - almost total avoidance of data contention thanks to the exploitation of commutativity operations on the index (via dirty reads and delayed actions) - it's built directly on top of ISPN (it does not depend on Fenix, unlike the collections' implementation that were used, e.g., by GeoGraph ). Details in the attached paper! We believe that this index implementation could be something generally useful for the ISPN community, especially given all the recent efforts in the areas of query. On the other hand, we should point out that the current implementation [3]: i) depends on transactional features (transaction migration, dirty reads, delayed actions) that have not been integrated in the official version of ISPN; ii) has been for the moment implemented as a Radargun extension, i.e. no effort was spent to modularize it/polish its API. ...so it would take some effort to have it fully integrated in the master version of ISPN.... but you know the saying: no pain no gain ;-) We'd love to hear your feedback of course! Nuno & Paolo [1] Sebastiano Peluso, Pedro Ruivo, Paolo Romano , Francesco Quaglia, and Luis Rodrigues, When Scalability Meets Consistency: Genuine Multiversion Update Serializable Partial Data Replication, 32nd International Conference on Distributed Computing Systems (ICDCS 2012) [2] Nuno Diegues and Paolo Romano , Bumper: Sheltering Transactions from Conflicts , The 32th IEEE Symposium on Reliable Distributed Systems (SRDS 2013) , Braga, Portugal, Oct. 2013 [3] https://github.com/cloudtm/sti-bt <STI-BT-report.pdf> ------------------------------------------------------------------------------ October Webinars: Code for Performance Free Intel webinars can help you accelerate application performance. Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most from the latest Intel processors and coprocessors. See abstracts and register > http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.... _______________________________________________ Cloudtm-discussion mailing list Cloudtm-discussion(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev _______________________________________________ infinispan-dev mailing list infinispan-dev(a)lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev