[Discussion]Simplify the deployment of carbondata

Posted by David CaiQiang on Dec 26, 2016; 6:31am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Simplify-the-deployment-of-carbondata-tp5000.html

hi all,
 
  I suggest to simplify deployment of CarbonData as following.
  1. remove kettle dependency completely, no need to deploy "carbonplugins" folder on each node, no need to set "carbhon.kettle.home"
  2. remove carbon.properties file from executor side, pass CarbonData configuration to executor side from driver side
  3. use "spark.sql.warehouse.dir"(spark2) or "hive.metastore.warehouse.dir"(spark1) instead of "carbon.storelocation"

  So we will just need to deploy CarbonData jars on cluster mode in the future.

  What's your opinion?

Best Regards
David Cai