Re: [Proposal] Proposal to change default value of two parameters for data loading

Posted by Jacky Li on Oct 18, 2018; 3:39am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Proposal-Proposal-to-change-default-value-of-two-parameters-for-data-loading-tp65009p65257.html

+1

> 在 2018年10月15日，下午9:03，xuchuanyin <[hidden email]> 写道：
>
> Hi, all:
>
> About a year ago, we introduced 'multiple dirs for temp data' to solve disk
> hotspot problem in data loading.
>
> This feature enables carbon randomly pick one of the local directories
> configured in yarn-local-dirs when it writes any temp files to disk (for
> example: sort temp files and fact data files).
>
> For about one years' usage in productive environment, this feature turns out
> to be effective and correct. So here I propose to enable the related
> parameters by default.
>
> The related parameters are
>
> 1. `carbon.use.local.dir` : Currently it is `false` by default, we will turn
> it to `true` by default;
>
> 2. `carbon.user.multiple.dir` : Currently it is `false` by default, we will
> turn it to `true` by default.
>
>
> --
> Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>