Login  Register

[jira] [Updated] (CARBONDATA-312) Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation

Posted by Akash R Nilugal (Jira) on Oct 13, 2016; 8:13am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Updated-CARBONDATA-312-Unify-two-datasource-CarbonDatasourceHadoopRelation-and-CarbonDatasourcen-tp1867.html


     [ https://issues.apache.org/jira/browse/CARBONDATA-312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacky Li updated CARBONDATA-312:
--------------------------------
    Description:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed

  was:
Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy

In this Issue, change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD, then CarbonHadoopFSRDD can be removed


> Unify two datasource: CarbonDatasourceHadoopRelation and CarbonDatasourceRelation
> ---------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-312
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-312
>             Project: CarbonData
>          Issue Type: Sub-task
>          Components: spark-integration
>            Reporter: Jacky Li
>             Fix For: 0.2.0-incubating
>
>
> Take CarbonDatasourceHadoopRelation as the target datasource definition, after that, CarbonContext can use standard Datasource strategy
> Since CarbonHadoopFSRDD need to be removed, and it is used by CarbonDatasourceHadoopRelation. So we need to change CarbonDatasourceHadoopRelation.buildScan function to return CarbonScanRDD instead CarbonHadoopFSRDD, then CarbonHadoopFSRDD can be removed



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)