Tuesday, April 23, 2013

HBase put methods for multithreading environment

According to some interesting aricle i found on Hbase 0.20 they got following conclusion

1. Write performances seems to be good when lesser threads are used for writing.
2.  All 3 variants seems to perform more or less similarly.  In our application, we use HTablePool based approach and its nice to see that it performs equally nice.  Another thing which I observed during my tests is that pool size may not have much role to play.  With pool size of 10 too, the results are more or less similar.
3. As number of threads increase, the write performance deteriorates.  A potential reason for this behavior is that HBase opens only one connection per region server from a single JVM.  So, will increasing the number of JVMs help in horizontally scaling the writes?

It would be interesting reruning those tests on 0.94 and see what happens now with the performence.
Thats probably what i will do in upcomming days.

Link: http://www.srikanthps.com/2011/06/hbase-benchmarking-for-multi-threaded.html

No comments:

Post a Comment