[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li updated CARBONDATA-312:
--------------------------------
    Description:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

In this Issue, change CarbonDatasourceHadoopRelation to use CarbonScanRDD in buildScan function.

  was:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

In this Issue, following change is required:
1. Move the dictionary stratey out of CarbonTableScan, make a separate strategy for it.
2. CarbonDatasourceHadoopRelation should use CarbonScanRDD in buildScan function.
3. Change CarbonSource to use CarbonDatasourceHadoopRelation only, remove extension of BaseRelation, extend from HadoopFsRelation only.


> Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation
> ---------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-312
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-312
>             Project: CarbonData
>          Issue Type: Sub-task
>          Components: spark-integration
>            Reporter: Jacky Li
>             Fix For: 0.2.0-incubating
>
>
> Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy
> In this Issue, change CarbonDatasourceHadoopRelation to use CarbonScanRDD in buildScan function.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)