回复: [Discussion] Support Spark/Hive based partition in carbon
Posted by cenyuhai11 on Dec 05, 2017; 4:42am URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Support-Spark-Hive-based-partition-in-carbon-tp27594p29184.html
Hi, Ravindra:
I read your design documents, why not use the standard hive/spark folder structure, is there any problem if use the hive/spark folder structure?
On 27 November 2017 at 17:36, cenyuhai11 <[hidden email]> wrote:
The datasource api still have a problem that it do not support hybird
fileformat table.
Detail description about hybird fileformat table is in this issue:
https://issues.apache.org/jira/browse/CARBONDATA-1377.
All partitions' fileformat of datasource table must be the same.
So we can't change fileformat to carbodata by command "alter table table_xxx
set fileformat carbondata;"
So I think implement TableReader is the right way.