Posted by
ravipesala on
Mar 13, 2017; 5:43am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/column-auto-mapping-when-loading-data-from-csv-file-tp8717p8731.html
Hi Yinwei,
Even I feel it is little cumbersome to let user forced to add the header to
CSV file or to loading script.
But what Manish said is also true. I think we should come with some new
option in loading script to accept auto mapping of DDL columns and CSV
columns. If user knows that DDL columns and CSV file columns are in same
order then he may mention like below
LOAD DATA INPATH INTO TABLE OPTIONS('AUTOFILEHEADER'='true')
when user mention this then it can take all DDL columns as file header.
May be can have more discussion on this option. Please others comment on
it.
Regards,
Ravindra.
On 13 March 2017 at 10:36, manish gupta <
[hidden email]> wrote:
> Hi Yinwei,
>
> Thanks for this suggestion. From my opinion providing first 2 options
> ensures that user is aware about the data he is going to load and column
> data mapping.
>
> For the 3rd option suggested by you I think it will be something that we
> are taking the decision without intimating the user and we cannot be sure
> that this is exactly how user wanted to load the data. So from my opinion
> we should let user decide this behavior.
>
> Regards
> Manish Gupta
>
> On Mon, Mar 13, 2017 at 7:48 AM, Yinwei Li <
[hidden email]> wrote:
>
> > Hi all,
> >
> >
> > when loading data from a csv file to carbondata table, we have 2
> choices
> > to mapping the columns from csv file to carbondata table:
> >
> >
> > 1. add columns' names at the start of the csv file
> > 2. declare the column mapping at the data loading script
> >
> >
> > shall we add a feature which make an auto mapping in the order of the
> > columns at the csv file and the carbondata table at default, so that
> users
> > don't have to do the above jobs any more under most of the circumstance.
>
--
Thanks & Regards,
Ravi