[jira] [Commented] (CARBONDATA-1749) Carbon1.3.0- DB creation external path : mdt file is not created in directory as per configuration in carbon.properties

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-1749) Carbon1.3.0- DB creation external path : mdt file is not created in directory as per configuration in carbon.properties

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287404#comment-16287404 ]

anubhav tarar commented on CARBONDATA-1749:
-------------------------------------------

@chetan Bhat hi i tried it using your code
 val spark = ExampleUtils.createCarbonSession("CarbonSessionExample")
    spark.sparkContext.setLogLevel("WARN")

    spark.sql("DROP TABLE IF EXISTS tab7")

    spark.sql("DROP TABLE IF EXISTS tab7_carbon")

 CarbonProperties.getInstance()
      .addProperty(CarbonCommonConstants.CARBON_UPDATE_SYNC_FOLDER,
        "hdfs://localhost:54311/user/test1")
    CarbonProperties.getInstance()
      .addProperty(CarbonCommonConstants.LOCK_TYPE,
        CarbonCommonConstants.CARBON_LOCK_TYPE_HDFS)
 

    spark.sql("drop table if exists test_db1.ORDERS")
    spark.sql("create database if not exists test_db1 location 'hdfs://localhost:54311/user/test1' ")

    spark.sql("use test_db1")

    spark.sql("create table if not exists ORDERS(O_ORDERDATE string,O_ORDERPRIORITY string,O_ORDERSTATUS string,O_ORDERKEY string,O_CUSTKEY string,O_TOTALPRICE double,O_CLERK string,O_SHIPPRIORITY int,O_COMMENT string) STORED BY 'org.apache.carbondata.format'TBLPROPERTIES ('table_blocksize'='128')")

    spark.stop()

and .mdt file is getting created at specified location can you provide more steps

> Carbon1.3.0- DB creation external path : mdt file is not created in directory as per configuration in carbon.properties
> -----------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1749
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1749
>             Project: CarbonData
>          Issue Type: Bug
>          Components: other
>    Affects Versions: 1.3.0
>         Environment: 3 node cluster
>            Reporter: Chetan Bhat
>              Labels: Functional
>
> Steps :
> In carbon.properties the mdt file directory path is configured as Carbon.update.sync.folder=hdfs://hacluster/user/test1 or /tmp/test1/
> In beeline user creates a database by specifying the carbon store path and creates a carbon table in the db.
> drop database if exists test_db1 cascade;
> create database test_db1 location 'hdfs://hacluster/user/test1';
> use test_db1;
> create table if not exists ORDERS(O_ORDERDATE string,O_ORDERPRIORITY string,O_ORDERSTATUS string,O_ORDERKEY string,O_CUSTKEY string,O_TOTALPRICE double,O_CLERK string,O_SHIPPRIORITY int,O_COMMENT string) STORED BY 'org.apache.carbondata.format'TBLPROPERTIES ('table_blocksize'='128');
> User checks in HDFS UI if the mdt file is created in directory specified (hdfs://hacluster/user/test1) as per configuration in carbon.properties.
> Issue : mdt file is not created in directory specified (hdfs://hacluster/user/test1) as per configuration in carbon.properties. Also the folder is not created if the user configures the folder path as Carbon.update.sync.folder=/tmp/test1/
> Expected : mdt file should be created in directory specified (hdfs://hacluster/user/test1) or /tmp/test1/ as per configuration in carbon.properties.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)