Is HDFS is mandatory for Carbon Data while creating table?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Is HDFS is mandatory for Carbon Data while creating table?

vnkesarwani
Hi,

I am trying to run example on Carbon data guide.
https://carbondata.apache.org/quick-start-guide.html

When i run it through spark-shell or spark-sql or spark submit command.. it
is throwing error that not able to connect to hadoop URL
http://localhost:9000

Even after changing the query to

carbon.sql("CREATE TABLE IF NOT EXISTS test_table(id string,name string,city
string,age Int) STORED AS carbondata LOCATION
file:///home/vinay/carbonData/tables")

It is trying to connect to HDFS. My question is whether carbonData is
totally dependent on HDFS system??

Can it create table to local file system or any NAS???

Thanks,
Vinay




--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: Is HDFS is mandatory for Carbon Data while creating table?

xubo245
not mandatory。

CarbonData support local file system,HDFS and S3(Huawei OBS)

There are some examples, for
example:./carbondata/examples/spark2/src/main/scala/org/apache/carbondata/examples/CarbonSessionExample.scala



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/