[DISCUSSION] Whether Carbondata should keep carbon-spark-shell script

Posted by Erlu Chen on Jun 06, 2017; 4:24pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Whether-Carbondata-should-keep-carbon-spark-shell-script-tp14077.html

Hi community,

Recently, I viewed the implementation of carbon-spark-shell and tried to understand the function of this script.

This script just wrap some steps and provide existing CarbonContext or CarbonSession for users  to interact with Carbondata.

I hold my opinion that we can remove this script because this script is useless except providing a existing CarbonContext or CarbonSession.

Reasons as below:
1. Carbondata now has integration spark1.x and spark2.x, Carbondata should refactor carbon-spark-shell every time when spark update.
2. After run this script, it will generate redundant folders in project and user may forget to remove these folders.
3. The CarbonContext or CarbonSession may be created with store path and metastore path which user may not want.

I just share my idea about this, we can discuss about whether we should keep this script.

Thanks.

Regards.
Chenerlu.