[jira] [Created] (CARBONDATA-1929) carbon property configuration validation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1929) carbon property configuration validation

Akash R Nilugal (Jira)
Mohammad Shahid Khan created CARBONDATA-1929:
------------------------------------------------

             Summary: carbon property configuration validation
                 Key: CARBONDATA-1929
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1929
             Project: CarbonData
          Issue Type: Bug
            Reporter: Mohammad Shahid Khan


 Issue 1 :
  In carbon.properties carbon.timestamp.format=testserwerwerwer12312312312312 is configured and spark submit server is started using the command -
bin/spark-submit --master yarn-client  --executor-memory 10G --executor-cores 5 --driver-memory 5G --num-executors 3 --class org.apache.carbondata.spark.thriftserver.CarbonThriftServer --jars /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-core-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-format-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-hadoop-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-processing-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark-common-1.3.0.0100.jar,/srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-streaming-1.3.0.0100.jar /srv/spark2.2Bigdata/install/spark/sparkJdbc/carbonlib/carbondata-spark2-1.3.0.0100.jar "hdfs://hacluster/carbonstore"

  From Beeline User tries to create a table
  Create table parsing fails as shown below in snap.
   http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71DkJFN3iXJAG7vplZsvI%2bl7M%3d

Issue 2 :
 In carbon.properties the below properties is configured and spark submit server is started using the command
 carbon.sort.file.write.buffer.size=test
 carbon.sort.intermediate.files.limit=test

From Beeline User creates a table
User tries to load data.
Issue :Data loading fails as shown in snap.
http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71DjeZqxHmMLFdeVr460BZPL4%3d


Issue 3:
In carbon.properties the below properties is configured and spark submit server is started using the command
carbon.block.meta.size.reserved.percentage=test
From beeline user creates table and tries to load data.
Issue :Data loading fails as shown in snap.
http://dts.huawei.com/net/dts/fckeditor/download.ashx?Path=sEDRdBxs6%2f6a0ax2Ss3KJMdclw69E%2f%2bmwFVkT%2f6WxsOF1uA6IA71Ds5xK0%2fNEhBDzhdFVtoc3sg%3d

 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)