Re: 回复： how to make carbon run faster

Posted by David CaiQiang on Jan 04, 2017; 4:28am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/how-to-make-carbon-run-faster-tp5305p5427.html

HI,
Total memory of cluster is 16G*40 = 640GB,  total size of data file is 600/1024GB*60 = 35GB, so I suggest to load all data files(60 days) once.

BTW, if loading small data file(total size) for each data loading, it will generate small carbon files.
You can add "carbon.enable.auto.load.merge=true" to carbon.properties file to enable compaction feature.
When loading data again, will trigger compaction.