[ https://issues.apache.org/jira/browse/CARBONDATA-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16287404#comment-16287404 ] anubhav tarar commented on CARBONDATA-1749: ------------------------------------------- @chetan Bhat hi i tried it using your code val spark = ExampleUtils.createCarbonSession("CarbonSessionExample") spark.sparkContext.setLogLevel("WARN") spark.sql("DROP TABLE IF EXISTS tab7") spark.sql("DROP TABLE IF EXISTS tab7_carbon") CarbonProperties.getInstance() .addProperty(CarbonCommonConstants.CARBON_UPDATE_SYNC_FOLDER, "hdfs://localhost:54311/user/test1") CarbonProperties.getInstance() .addProperty(CarbonCommonConstants.LOCK_TYPE, CarbonCommonConstants.CARBON_LOCK_TYPE_HDFS) spark.sql("drop table if exists test_db1.ORDERS") spark.sql("create database if not exists test_db1 location 'hdfs://localhost:54311/user/test1' ") spark.sql("use test_db1") spark.sql("create table if not exists ORDERS(O_ORDERDATE string,O_ORDERPRIORITY string,O_ORDERSTATUS string,O_ORDERKEY string,O_CUSTKEY string,O_TOTALPRICE double,O_CLERK string,O_SHIPPRIORITY int,O_COMMENT string) STORED BY 'org.apache.carbondata.format'TBLPROPERTIES ('table_blocksize'='128')") spark.stop() and .mdt file is getting created at specified location can you provide more steps > Carbon1.3.0- DB creation external path : mdt file is not created in directory as per configuration in carbon.properties > ----------------------------------------------------------------------------------------------------------------------- > > Key: CARBONDATA-1749 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1749 > Project: CarbonData > Issue Type: Bug > Components: other > Affects Versions: 1.3.0 > Environment: 3 node cluster > Reporter: Chetan Bhat > Labels: Functional > > Steps : > In carbon.properties the mdt file directory path is configured as Carbon.update.sync.folder=hdfs://hacluster/user/test1 or /tmp/test1/ > In beeline user creates a database by specifying the carbon store path and creates a carbon table in the db. > drop database if exists test_db1 cascade; > create database test_db1 location 'hdfs://hacluster/user/test1'; > use test_db1; > create table if not exists ORDERS(O_ORDERDATE string,O_ORDERPRIORITY string,O_ORDERSTATUS string,O_ORDERKEY string,O_CUSTKEY string,O_TOTALPRICE double,O_CLERK string,O_SHIPPRIORITY int,O_COMMENT string) STORED BY 'org.apache.carbondata.format'TBLPROPERTIES ('table_blocksize'='128'); > User checks in HDFS UI if the mdt file is created in directory specified (hdfs://hacluster/user/test1) as per configuration in carbon.properties. > Issue : mdt file is not created in directory specified (hdfs://hacluster/user/test1) as per configuration in carbon.properties. Also the folder is not created if the user configures the folder path as Carbon.update.sync.folder=/tmp/test1/ > Expected : mdt file should be created in directory specified (hdfs://hacluster/user/test1) or /tmp/test1/ as per configuration in carbon.properties. -- This message was sent by Atlassian JIRA (v6.4.14#64029) |
Free forum by Nabble | Edit this page |