[Discussion] Some confused properties

[cenyuhai]

Hi, all:
    I am trying to use carbon,  but I am confused about the properties as blow:


carbon.storelocation=hdfs://hacluster/Opt/CarbonStore
#Base directory for Data files
carbon.ddl.base.hdfs.url=hdfs://hacluster/opt/data
#Path where the bad records are stored
carbon.badRecords.location=/opt/Carbon/Spark/badrecords





Why do I need to set carbon.storelocation and  carbon.ddl.base.hdfs.url before I create carbon table?


Best Regards
yuhai

[Liang Chen]

Hi

Thanks you started the discussion.
the storelocation is for storing all CarbonData files.

Regards
Liang

cenyuhai wrote

Hi, all:
    I am trying to use carbon,  but I am confused about the properties as blow:


carbon.storelocation=hdfs://hacluster/Opt/CarbonStore
#Base directory for Data files
carbon.ddl.base.hdfs.url=hdfs://hacluster/opt/data
#Path where the bad records are stored
carbon.badRecords.location=/opt/Carbon/Spark/badrecords





Why do I need to set carbon.storelocation and  carbon.ddl.base.hdfs.url before I create carbon table?


Best Regards
yuhai

[ravipesala]

Hi,

Carbon takes store location from CarbonContext and sets to CarbonProperties
as carbon.storelocation , so it is not required to add store location in
properties file. And carbon.ddl.base.hdfs.url is not a mandatory property
it is just used when load path is provided with prefix then it appends this
configured prefix to it.

Regards,
Ravi

On 8 December 2016 at 15:03, Sea <[hidden email]> wrote:

> Hi, all:
>     I am trying to use carbon,  but I am confused about the properties as
> blow:
>
>
> carbon.storelocation=hdfs://hacluster/Opt/CarbonStore
> #Base directory for Data files
> carbon.ddl.base.hdfs.url=hdfs://hacluster/opt/data
> #Path where the bad records are stored
> carbon.badRecords.location=/opt/Carbon/Spark/badrecords
>
>
>
>
>
> Why do I need to set carbon.storelocation and  carbon.ddl.base.hdfs.url
> before I create carbon table?
>
>
> Best Regards
> yuhai

--
Thanks & Regards,
Ravi

[jarray888]

when you load data into carbon , if the source data file have dirty data , it will forward to this location.

#Path where the bad records are stored
carbon.badRecords.location=/opt/Carbon/Spark/badrecords