Login  Register

Re: [DISCUSSION] Support Standard Spark's FileFormat interface in Carbondata

Posted by kumarvishal09 on Aug 23, 2018; 4:21pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-Standard-Spark-s-FileFormat-interface-in-Carbondata-tp59908p60102.html

+1
-Regards
Kumar Vishal

On Thu, Aug 23, 2018 at 9:43 PM Liang Chen <[hidden email]> wrote:

> HI
>
> +1, agree to support standard spark file format interface in carbondata, it
> will be significantly helpful for broadening apache carbondata's ecosystem.
>
> Regards
> Liang
>
>
> ravipesala wrote
> > Hi,
> >
> > Current Carbondata has deep integration with Spark to provide
> > optimizations
> > in performance and also supports features like compaction, IUD, data maps
> > and metadata management etc. This type of integration forces user to use
> > CarbonSession instance to use carbon even for read and write operations.
> >
> > So I am proposing standard spark's FileFormat implementation in carbon
> for
> > simple integration with Spark. Please check the jira for the design
> > document.
> > https://issues.apache.org/jira/browse/CARBONDATA-2872
> >
> > --
> > Thanks & Regards,
> > Ravindra
>
>
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>
kumar vishal