Re: [DISCUSSION] Support Standard Spark's FileFormat interface in Carbondata

Posted by Liang Chen on Aug 23, 2018; 4:13pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-Standard-Spark-s-FileFormat-interface-in-Carbondata-tp59908p60100.html

HI

+1, agree to support standard spark file format interface in carbondata, it
will be significantly helpful for broadening apache carbondata's ecosystem.

Regards
Liang


ravipesala wrote

> Hi,
>
> Current Carbondata has deep integration with Spark to provide
> optimizations
> in performance and also supports features like compaction, IUD, data maps
> and metadata management etc. This type of integration forces user to use
> CarbonSession instance to use carbon even for read and write operations.
>
> So I am proposing standard spark's FileFormat implementation in carbon for
> simple integration with Spark. Please check the jira for the design
> document.
> https://issues.apache.org/jira/browse/CARBONDATA-2872
>
> --
> Thanks & Regards,
> Ravindra

--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/