We have a small Hbase cluster on EC2 with 6 region servers. Lately we found that the data in one of the column families is really not that useful for us and decided to chuck it. This particular column family takes more than 50 percent of space on disk.
We altered the table,removes the column family and ran major compaction.
We also ran major compaction on the ‘-ROOT-‘ and the ‘.META.’ tables.
But there is still no reduction in total DFS file size?
Are we missing something here.
Any help/pointers would be greatly appreciated.
regards.
Got it!
It was a bug in Hbase. They are not deleting the filer from the HDFS. We had to find and delete the files from the hadoop-files system.