[jira] [Updated] (CARBONDATA-322) Integration with spark 2.x

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jihong MA updated CARBONDATA-322:
---------------------------------
    Issue Type: New Feature  (was: Improvement)

> Integration with  spark 2.x
> ----------------------------
>
>                 Key: CARBONDATA-322
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-322
>             Project: CarbonData
>          Issue Type: New Feature
>          Components: spark-integration
>    Affects Versions: 0.2.0-incubating
>            Reporter: Fei Wang
>            Assignee: Fei Wang
>             Fix For: 1.0.0-incubating
>
>
> Since spark 2.0 released. there are many nice features such as more efficient parser, vectorized execution, adaptive execution.
> It is good to integrate with spark 2.x
> current integration up to Spark v1.6 is tightly coupled with spark, we would like to cleanup the interface with following design points in mind:
> 1. decoupled with Spark, integration based on Spark's v2 datasource API
> 2. Enable vectorized carbon reader
> 3. Support saving DataFrame to Carbondata file through Carbondata's output format.
> ...

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)