Login  Register

回复: [Discussion] Support Spark/Hive based partition in carbon

Posted by cenyuhai11 on Dec 05, 2017; 4:42am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Support-Spark-Hive-based-partition-in-carbon-tp27594p29184.html

Hi,  Ravindra:
   I read your design documents, why not use the standard hive/spark folder structure, is there any problem if use the hive/spark folder structure?








Best regards!
Yuhai Cen


在2017年12月4日 14:09,Ravindra Pesala<[hidden email]> 写道:
Hi,


Please find the design document for standard partition support in carbon.
https://docs.google.com/document/d/1NJo_Qq4eovl7YRuT9O7yWTL0P378HnC8WT0-6pkQ7GQ/edit?usp=sharing







Regards,
Ravindra.


On 27 November 2017 at 17:36, cenyuhai11 <[hidden email]> wrote:
The datasource api still have a problem that it do not support hybird
fileformat table.
Detail description about hybird fileformat table is in this issue:
https://issues.apache.org/jira/browse/CARBONDATA-1377.

All partitions' fileformat of datasource table must be the same.
So we can't change fileformat to carbodata by command "alter table table_xxx
set fileformat carbondata;"

So I think implement TableReader is the right way.







--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/






--

Thanks & Regards,
Ravi