[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li updated CARBONDATA-312:
--------------------------------
    Description:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed

  was:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

In this Issue, change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD, then CarbonHadoopFSRDD can be removed


> Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation
> ---------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-312
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-312
>             Project: CarbonData
>          Issue Type: Sub-task
>          Components: spark-integration
>            Reporter: Jacky Li
>             Fix For: 0.2.0-incubating
>
>
> Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy
> Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)