[jira] [Commented] (CARBONDATA-240) Use SQLContext to query CarbonData directly without creating table

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-240) Use SQLContext to query CarbonData directly without creating table

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491077#comment-15491077 ]

ASF GitHub Bot commented on CARBONDATA-240:
-------------------------------------------

GitHub user jackylk opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/157

    [CARBONDATA-240] Use SQLContext to query CarbonData directly without creating table

    When using Spark 1.6, user can use SQLContext to query CarbonData files directly without creating table:
    ```
        // This requires Spark 1.6 or later version to run
        val sqlContext = new SQLContext(sc)
        sqlContext.sql(
          """
            | SELECT c1, c2, count(*)
            | FROM carbondata.`./examples/target/store/default/table1`
            | WHERE c3 > 100
            | GROUP BY c1, c2
          """.stripMargin).show
    ```

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/jackylk/incubator-carbondata direct

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/157.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #157
   
----
commit 9293e1b5c0c6c14b5f3d8f7aec89a812d785a452
Author: jackylk <[hidden email]>
Date:   2016-09-05T15:36:04Z

    use SqlContext for read

commit f0f7a4a2f0144dc1088ba2e8c6d4a606dc50a36a
Author: jackylk <[hidden email]>
Date:   2016-09-05T15:43:30Z

    revert CarbonScan

commit cc6c749115c35effed493d9064d982438c11cb59
Author: jackylk <[hidden email]>
Date:   2016-09-05T15:45:33Z

    add class

commit c53b2ef268b487f602350d4c93bc3cdda70e8c39
Author: jackylk <[hidden email]>
Date:   2016-09-05T16:36:13Z

    fix stylecheck

commit acb3ac2d0a5caf665835f08a69fbe375a7c00c40
Author: jackylk <[hidden email]>
Date:   2016-09-06T12:30:24Z

    use path only

commit 2fad8ba0ad99f9a36d67592342ddcb741dcde7a0
Author: jackylk <[hidden email]>
Date:   2016-09-10T00:26:25Z

    directly run SQL

commit 5421475642c94d0eba7a676afb98247ada7091fd
Author: jackylk <[hidden email]>
Date:   2016-09-10T04:11:24Z

    add CarbonDataFrameWriter

commit 89ef52816a5b5c5fc465206805a11cace41817bd
Author: jackylk <[hidden email]>
Date:   2016-09-10T04:31:54Z

    rebase

commit b9a40eb33545b4842e20353d657b125cd55b8c41
Author: jackylk <[hidden email]>
Date:   2016-09-10T04:48:14Z

    modify testcase

commit c29288d5b5e092afea9e5cd10053b7829ba44b17
Author: jackylk <[hidden email]>
Date:   2016-09-12T15:13:40Z

    revert API

commit d7af4603b2df4fc2593413bbb90a495084c88010
Author: jackylk <[hidden email]>
Date:   2016-09-12T15:14:20Z

    Merge branch 'master' of https://github.com/apache/incubator-carbondata into ds1

commit f158f84b8336780fb2960191e4b1b238707c6d54
Author: jackylk <[hidden email]>
Date:   2016-09-13T01:45:38Z

    Merge branch 'direct' of https://github.com/jackylk/incubator-carbondata into direct

commit 8c26ab03103939c13d4b941887024f3231477be8
Author: jackylk <[hidden email]>
Date:   2016-09-13T01:55:57Z

    add testcase

commit 7a7728bdd8ed1f5c6d9ef63d2b4e5231677ad60e
Author: jackylk <[hidden email]>
Date:   2016-09-13T02:56:20Z

    add testcase

commit 7588b1113ab18f180002813eff4452a6040dee17
Author: jackylk <[hidden email]>
Date:   2016-09-13T08:54:13Z

    modify testcase

commit d66cb8b1bc811bd72f0109ba9bb096175a39698c
Author: jackylk <[hidden email]>
Date:   2016-09-13T08:56:37Z

    support windows

commit 53f32bd8577f50043c677a3ab1b3bedde2f8f0ed
Author: jackylk <[hidden email]>
Date:   2016-09-13T14:17:02Z

    Merge branch 'ds1' of https://github.com/jackylk/incubator-carbondata into direct

commit adb6a57192688d65461dfe7e649f392190e29426
Author: jackylk <[hidden email]>
Date:   2016-09-13T14:26:09Z

    add example

commit d648ff57b882dc022f6c58e94a8b1b312ce2fccb
Author: jackylk <[hidden email]>
Date:   2016-09-13T14:26:46Z

    change pom.xml

commit 856ee529ab2f9d1814efbb9d6cdfc7a9f518a287
Author: jackylk <[hidden email]>
Date:   2016-09-14T16:52:03Z

    rebase

commit 90f7eaa2b57140e04feb092308c68c2ee71bd378
Author: jackylk <[hidden email]>
Date:   2016-09-14T17:44:07Z

    fix style

----


> Use SQLContext to query CarbonData directly without creating table
> ------------------------------------------------------------------
>
>                 Key: CARBONDATA-240
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-240
>             Project: CarbonData
>          Issue Type: New Feature
>            Reporter: Jacky Li
>             Fix For: 0.2.0-incubating
>
>
> When using Spark 1.6, user can use SQLContext to query CarbonData files directly without creating table



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)