[jira] [Commented] (CARBONDATA-2318) Remove invalid table name(.ds_store) of presto integration

[Akash R Nilugal (Jira)]

    [ https://issues.apache.org/jira/browse/CARBONDATA-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437283#comment-16437283 ]

anubhav tarar commented on CARBONDATA-2318:
-------------------------------------------

hi i tried again using same steps that you provided but didn't able to replicate the issue

step 1: create carbonsession using sparkshell
val carbon = SparkSession.builder().config(sc.getConf) .getOrCreateCarbonSession("/home/anubhav/Documents/prestostore/data","/home/anubhav/Documents/prestostore/metadata")

step2: copy old carbondata to new store location
/home/anubhav/Documents/carbondata/carbondata/examples/spark2/target/store/default to /home/anubhav/Documents/prestostore/data

step3:refresh table
scala> carbon.sql("refresh table carbonsession_table").show
18/04/13 13:43:48 AUDIT CarbonCreateTableCommand: [anubhav-Vostro-3559][anubhav][Thread-1]Creating Table with Database name [default] and Table name [carbonsession_table]
18/04/13 13:43:49 WARN HiveExternalCatalog: Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.CarbonSource. Persisting data source table `default`.`carbonsession_table` into Hive metastore in Spark SQL specific format, which is NOT compatible with Hive.
18/04/13 13:43:49 AUDIT CarbonCreateTableCommand: [anubhav-Vostro-3559][anubhav][Thread-1]Table created with Database name [default] and Table name [carbonsession_table]
18/04/13 13:43:49 AUDIT RefreshCarbonTableCommand: [anubhav-Vostro-3559][anubhav][Thread-1]Table registration with Database name [default] and Table name [carbonsession_table] is successful.

step4:query the new store from presto

./presto-cli-0.187-executable.jar --server localhost:9000 --catalog carbondata
presto> show tables from default;
 Table
---------------------
 carbonsession_table
(1 row)

Query 20180413_080021_00000_vev2q, FINISHED, 1 node
Splits: 18 total, 18 done (100.00%)
0:02 [1 rows, 36B] [0 rows/s, 22B/s]

> Remove invalid table name(.ds_store) of presto integration
> -----------------------------------------------------------
>
>                 Key: CARBONDATA-2318
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2318
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: presto-integration
>            Reporter: Liang Chen
>            Priority: Minor
>
> For presto integration , will get the invalid table name via "show tables from default"
> As below.
> presto:default> show tables from default;
>  Table
> --------------------
>  .ds_store
>  carbon_table
>  carbontable
>  partition_bigtable
>  partition_table
> (5 rows)

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)