Re: CarbonData propose major version number increment for next version (to 1.0.0)

Posted by Jacky Li on Nov 25, 2016; 2:36am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/CarbonData-propose-major-version-number-increment-for-next-version-to-1-0-0-tp3131p3181.html

+1,
and comments inline

> 在 2016年11月24日，上午12:09，Venkata Gollamudi <[hidden email]> 写道：
>
> Hi All,
>
> CarbonData 0.2.0 has been a good work and stable release with lot of
> defects fixed and with number of performance improvements.
> https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC
>
> Next version has many major and new value added features are planned,
> taking CarbonData capability to next level.
> Like
> - IUD(Insert-Update-Delete) support,

Actually, the design doc Aniket has shared is for Update and Delete only, Insert is not covered. I think Insert is a feature need to be designed in the future.

> - complete rewrite of data load flow with out Kettle,
> - Spark 2.x support,

Since Spark2.x has made changes to user level API and SQL, it will also make some CarbonData’s SQL command incompatible with earlier version. So I think upgrading CarbonData version to 1.0.0 also indicating this incompatibility.

> - Standardize CarbonInputFormat and CarbonOutputFormat,
> - alluxio(tachyon) file system support,
> - Carbon thrift format optimization for fast query,
> - Data loading performance improvement and In memory off heap sorting,
> - Query performance improvement using off heap,
> - Support Vectorized batch reader.
>
> https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC
>
> I think it makes sense to change CarbonData Major version in next version
> to 1.0.0.
> Please comment and vote on this.
>
> Thanks,
> Ramana