[jira] [Commented] (CARBONDATA-2318) Remove invalid table name(.ds_store) of presto integration

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-2318) Remove invalid table name(.ds_store) of presto integration

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16436954#comment-16436954 ]

Liang Chen commented on CARBONDATA-2318:
----------------------------------------

I tested it in sparkshell : 

Step1: ./bin/spark-shell --master local --jars ${carbon_jar} --driver-memory 4G

Step2: 

import org.apache.spark.sql.SparkSession
import org.apache.spark.sql.CarbonSession._
val carbon = SparkSession.builder().config(sc.getConf).getOrCreateCarbonSession("/Users/apple/DEMO/presto_test/data","/Users/apple/DEMO/presto_test/metadata")

Step3: reuse the old carbondata

1) : copy all data "default/carbon_table/.." to new location : /Users/apple/DEMO/presto_test/data
2) : run carbon.sql("refresh table carbon_table")

 

 

> Remove invalid table name(.ds_store) of presto integration
> -----------------------------------------------------------
>
>                 Key: CARBONDATA-2318
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2318
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: presto-integration
>            Reporter: Liang Chen
>            Priority: Minor
>
> For presto integration , will get the invalid table name via "show tables from default"
> As below.
> presto:default> show tables from default;
>  Table
> --------------------
>  .ds_store
>  carbon_table
>  carbontable
>  partition_bigtable
>  partition_table
> (5 rows)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)