Re: Discussion about using multi local directorys to improve dataloading perfomance

Posted by Liang Chen on Oct 10, 2016; 2:21am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-about-using-multi-local-directorys-to-improve-dataloading-perfomance-tp1678p1718.html

+1 for the solution.

Regards
Liang

QiangCai wrote

Hi All,
  For each dataloading, we write the sorted temp files into only one different local directory. I think this is a bottle neck of dataloading. It is neccessary to use multi local directorys in multi disks for each dataloading to improve dataloading performance.