load data from local file system using beeline

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

load data from local file system using beeline

Harmeet Singh
Hey team, I am using Thriftserver and Beeline client for executing carbon data queries. I want to load the data from csv into carbon data table. The CSV file is exist at out local system. When i am trying to execute the query, i got an exception, invalid path. Below is the example;

0: jdbc:hive2://127.0.0.1:10000> load data local inpath '/home/harmeet/CarbonDataInputs/sample3.csv' into table newone options('quotechar'='`');
Error: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: /home/harmeet/CarbonDataInputs/sample3.csv (state=,code=0)

Please confirm this is an issue, or carbon data not support load file from local system. If this is not a feature, then i will suggest that feature. We will load the data from local csv file instead of hadoop.
Reply | Threaded
Open this post in threaded view
|

Re: load data from local file system using beeline

Zhangshunyu
Hi Harmeet,
  Actually,local is not supported yet,you can put the files on hdfs,and then load them.
And i think this is a good suggestion to support load data from local file.

Regards
Sunday
My English name is Sunday
Reply | Threaded
Open this post in threaded view
|

Re: load data from local file system using beeline

Harmeet Singh
Hello Zhangshunyu,

Yes, we need to give option for load data from beeline, because carbondata data have "local" option in his load command, and from carbon shell, the load from local files is working. We need to raise suggestion on jira also, Please confirm ?