Posted by
Akash R Nilugal (Jira) on
Sep 06, 2016; 9:55am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Commented-CARBONDATA-212-Use-SQLContext-to-read-CarbonData-file-tp797.html
[
https://issues.apache.org/jira/browse/CARBONDATA-212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467004#comment-15467004 ]
ASF GitHub Bot commented on CARBONDATA-212:
-------------------------------------------
Github user QiangCai commented on a diff in the pull request:
https://github.com/apache/incubator-carbondata/pull/126#discussion_r77605228
--- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonDatasourceRelation.scala ---
@@ -123,24 +120,24 @@ class CarbonSource
dataSchema: Option[StructType],
partitionColumns: Option[StructType],
parameters: Map[String, String]): HadoopFsRelation = {
- CarbonDatasourceHadoopRelation(sqlContext, paths, parameters)
+ CarbonDatasourceHadoopRelation(sqlContext, paths, parameters, dataSchema)
--- End diff --
You can validate the parameters here.
> Use SQLContext to read CarbonData file
> --------------------------------------
>
> Key: CARBONDATA-212
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-212> Project: CarbonData
> Issue Type: New Feature
> Reporter: Jacky Li
> Assignee: Jacky Li
> Fix For: 0.2.0-incubating
>
>
> User should be enable to use Spark's SQLContext to read CarbonData files. SQLContext will use datasource API to read corresponding CarbonData files.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)