Login  Register

[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

classic Classic list List threaded Threaded
1 message Options Options
Embed post
Permalink
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li updated CARBONDATA-312:
--------------------------------
    Description:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed

  was:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

In this Issue, change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD, then CarbonHadoopFSRDD can be removed


> Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation
> ---------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-312
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-312
>             Project: CarbonData
>          Issue Type: Sub-task
>          Components: spark-integration
>            Reporter: Jacky Li
>             Fix For: 0.2.0-incubating
>
>
> Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy
> Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)