FYI I presented on the current state of
cloud-TM at HPTS a week or so ago and there
was much interest. I pointed people at our
website.
Sent from my iPad
Hi all,
even the Cloud-TM project is officially over,
we thought to share with you one of our last
efforts, which unfortunately were a tad too
late to make it into the submitted version of
the platform (and deliverables etc).
This is a scalable, distributed transactional
index (B+tree) over ISPN, which combines a
number of optimizations (in areas like data
locality, concurrency, load balancing/elastic
scaling) and builds over previous work (in
particular, GMU [1] and Bumper [2]) that made
it possible to achieve linear scalability up
to 100 VMs even in update intensive workloads.
Hot features:
- at most 1 remote data access per each index
operation thanks to :
i) transaction migration,
ii) combined use of full and partial
replication (transparent and self-tuning
depending on cluster size),
iii) optimized data placement via customi
hash functions
- almost total avoidance of data contention
thanks to the exploitation of commutativity
operations on the index (via dirty reads and
delayed actions)
- it's built directly on top of ISPN (it does
not depend on Fenix, unlike the collections'
implementation that were used, e.g., by
GeoGraph ).
Details in the attached paper!
We believe that this index implementation
could be something generally useful for the
ISPN community, especially given all the
recent efforts in the areas of query. On the
other hand, we should point out that the
current implementation [3]:
i) depends on transactional features
(transaction migration, dirty reads, delayed
actions) that have not been integrated in the
official version of ISPN;
ii) has been for the moment implemented as a
Radargun extension, i.e. no effort was spent
to modularize it/polish its API.
...so it would take some effort to have it
fully integrated in the master version of
ISPN.... but you know the saying: no pain no
gain ;-)
We'd love to hear your feedback of course!
Nuno & Paolo
[1] Sebastiano Peluso, Pedro Ruivo, Paolo Romano, Francesco
Quaglia, and Luis Rodrigues,When
Scalability Meets Consistency: Genuine
Multiversion Update Serializable Partial
Data Replication,
32nd International Conference on
Distributed Computing Systems (ICDCS 2012)
[2] Nuno Diegues and Paolo Romano,Bumper:
Sheltering Transactions from Conflicts,The
32th IEEE Symposium on Reliable
Distributed Systems (SRDS 2013),
Braga, Portugal, Oct. 2013
[3] https://github.com/cloudtm/sti-bt
<STI-BT-report.pdf>
------------------------------------------------------------------------------
October Webinars: Code for Performance
Free Intel webinars can help you
accelerate application performance.
Explore tips for MPI, OpenMP, advanced
profiling, and more. Get the most from
the latest Intel processors and
coprocessors. See abstracts and register
>
http://pubads.g.doubleclick.net/gampad/clk?id=60134791&iu=/4140/ostg.clktrk
_______________________________________________
Cloudtm-discussion mailing list
Cloudtm-discussion@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/cloudtm-discussion
_______________________________________________