CarbonData propose major version number increment for next version (to 1.0.0)
Locked
CarbonData propose major version number increment for next version (to 1.0.0)
 
|
Hi All,
CarbonData 0.2.0 has been a good work and stable release with lot of defects fixed and with number of performance improvements. https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC Next version has many major and new value added features are planned, taking CarbonData capability to next level. Like - IUD(Insert-Update-Delete) support, - complete rewrite of data load flow with out Kettle, - Spark 2.x support, - Standardize CarbonInputFormat and CarbonOutputFormat, - alluxio(tachyon) file system support, - Carbon thrift format optimization for fast query, - Data loading performance improvement and In memory off heap sorting, - Query performance improvement using off heap, - Support Vectorized batch reader. https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC I think it makes sense to change CarbonData Major version in next version to 1.0.0. Please comment and vote on this. Thanks, Ramana |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
Administrator
|
Hi
Ya, good proposal. CarbonData 0.x version integrate with spark 1.x, and the load data solution of 0.x version is using kettle. CarbonData 1.x version integrate with spark 2.x, the load data solution of 1.x version will not use kettle . That would be helpful to reduce maintenance cost through distinguishing the major different version. +1 for the proposal. Regards Liang
|
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> wrote: > Hi > > Ya, good proposal. > CarbonData 0.x version integrate with spark 1.x, and the load data > solution > of 0.x version is using kettle. > CarbonData 1.x version integrate with spark 2.x, the load data solution of > 1.x version will not use kettle . > > That would be helpful to reduce maintenance cost through distinguishing the > major different version. > > +1 for the proposal. > > Regards > Liang > > > Venkata Gollamudi wrote > > Hi All, > > > > CarbonData 0.2.0 has been a good work and stable release with lot of > > defects fixed and with number of performance improvements. > > > https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > Next version has many major and new value added features are planned, > > taking CarbonData capability to next level. > > Like > > - IUD(Insert-Update-Delete) support, > > - complete rewrite of data load flow with out Kettle, > > - Spark 2.x support, > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > - alluxio(tachyon) file system support, > > - Carbon thrift format optimization for fast query, > > - Data loading performance improvement and In memory off heap sorting, > > - Query performance improvement using off heap, > > - Support Vectorized batch reader. > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > I think it makes sense to change CarbonData Major version in next version > > to 1.0.0. > > Please comment and vote on this. > > > > Thanks, > > Ramana > > > > > > -- > View this message in context: > http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/CarbonData-propose-major-version-number-increment-for-next-version-to-1-0-0-tp3131p3157.html > Sent from the Apache CarbonData Mailing List archive mailing list archive > at Nabble.com. > |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
-Regards Kumar Vishal On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < [hidden email]> wrote: > +1 > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > wrote: > > > Hi > > > > Ya, good proposal. > > CarbonData 0.x version integrate with spark 1.x, and the load data > > solution > > of 0.x version is using kettle. > > CarbonData 1.x version integrate with spark 2.x, the load data solution > of > > 1.x version will not use kettle . > > > > That would be helpful to reduce maintenance cost through distinguishing > the > > major different version. > > > > +1 for the proposal. > > > > Regards > > Liang > > > > > > Venkata Gollamudi wrote > > > Hi All, > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot of > > > defects fixed and with number of performance improvements. > > > > > <a href="https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > Next version has many major and new value added features are planned, > > > taking CarbonData capability to next level. > > > Like > > > - IUD(Insert-Update-Delete) support, > > > - complete rewrite of data load flow with out Kettle, > > > - Spark 2.x support, > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > - alluxio(tachyon) file system support, > > > - Carbon thrift format optimization for fast query, > > > - Data loading performance improvement and In memory off heap sorting, > > > - Query performance improvement using off heap, > > > - Support Vectorized batch reader. > > > > > > > > <a href="https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > I think it makes sense to change CarbonData Major version in next > version > > > to 1.0.0. > > > Please comment and vote on this. > > > > > > Thanks, > > > Ramana > > > > > > > > > > > > -- > > View this message in context: > > http://apache-carbondata-mailing-list-archive.1130556. > n5.nabble.com/CarbonData-propose-major-version-number- > increment-for-next-version-to-1-0-0-tp3131p3157.html > > Sent from the Apache CarbonData Mailing List archive mailing list archive > > at Nabble.com. > > >
kumar vishal
|
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
Regards Manish Gupta On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <[hidden email]> wrote: > +1 > > -Regards > Kumar Vishal > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > [hidden email]> wrote: > > > +1 > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > > wrote: > > > > > Hi > > > > > > Ya, good proposal. > > > CarbonData 0.x version integrate with spark 1.x, and the load data > > > solution > > > of 0.x version is using kettle. > > > CarbonData 1.x version integrate with spark 2.x, the load data solution > > of > > > 1.x version will not use kettle . > > > > > > That would be helpful to reduce maintenance cost through distinguishing > > the > > > major different version. > > > > > > +1 for the proposal. > > > > > > Regards > > > Liang > > > > > > > > > Venkata Gollamudi wrote > > > > Hi All, > > > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot of > > > > defects fixed and with number of performance improvements. > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-320? > jql=project%20%3D% > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > Next version has many major and new value added features are planned, > > > > taking CarbonData capability to next level. > > > > Like > > > > - IUD(Insert-Update-Delete) support, > > > > - complete rewrite of data load flow with out Kettle, > > > > - Spark 2.x support, > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > > - alluxio(tachyon) file system support, > > > > - Carbon thrift format optimization for fast query, > > > > - Data loading performance improvement and In memory off heap > sorting, > > > > - Query performance improvement using off heap, > > > > - Support Vectorized batch reader. > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301? > jql=project%20%3D% > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > I think it makes sense to change CarbonData Major version in next > > version > > > > to 1.0.0. > > > > Please comment and vote on this. > > > > > > > > Thanks, > > > > Ramana > > > > > > > > > > > > > > > > > > -- > > > View this message in context: > > > http://apache-carbondata-mailing-list-archive.1130556. > > n5.nabble.com/CarbonData-propose-major-version-number- > > increment-for-next-version-to-1-0-0-tp3131p3157.html > > > Sent from the Apache CarbonData Mailing List archive mailing list > archive > > > at Nabble.com. > > > > > > |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
On Thu, Nov 24, 2016, 10:37 PM manish gupta <[hidden email]> wrote: > +1 > > Regards > Manish Gupta > > On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <[hidden email]> > wrote: > > > +1 > > > > -Regards > > Kumar Vishal > > > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > > [hidden email]> wrote: > > > > > +1 > > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > > > wrote: > > > > > > > Hi > > > > > > > > Ya, good proposal. > > > > CarbonData 0.x version integrate with spark 1.x, and the load data > > > > solution > > > > of 0.x version is using kettle. > > > > CarbonData 1.x version integrate with spark 2.x, the load data > solution > > > of > > > > 1.x version will not use kettle . > > > > > > > > That would be helpful to reduce maintenance cost through > distinguishing > > > the > > > > major different version. > > > > > > > > +1 for the proposal. > > > > > > > > Regards > > > > Liang > > > > > > > > > > > > Venkata Gollamudi wrote > > > > > Hi All, > > > > > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot > of > > > > > defects fixed and with number of performance improvements. > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-320? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > Next version has many major and new value added features are > planned, > > > > > taking CarbonData capability to next level. > > > > > Like > > > > > - IUD(Insert-Update-Delete) support, > > > > > - complete rewrite of data load flow with out Kettle, > > > > > - Spark 2.x support, > > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > > > - alluxio(tachyon) file system support, > > > > > - Carbon thrift format optimization for fast query, > > > > > - Data loading performance improvement and In memory off heap > > sorting, > > > > > - Query performance improvement using off heap, > > > > > - Support Vectorized batch reader. > > > > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > I think it makes sense to change CarbonData Major version in next > > > version > > > > > to 1.0.0. > > > > > Please comment and vote on this. > > > > > > > > > > Thanks, > > > > > Ramana > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > View this message in context: > > > > http://apache-carbondata-mailing-list-archive.1130556. > > > n5.nabble.com/CarbonData-propose-major-version-number- > > > increment-for-next-version-to-1-0-0-tp3131p3157.html > > > > Sent from the Apache CarbonData Mailing List archive mailing list > > archive > > > > at Nabble.com. > > > > > > > > > > |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
Regards, Naresh On Nov 24, 2016 11:30 PM, "Ravindra Pesala" <[hidden email]> wrote: > +1 > > On Thu, Nov 24, 2016, 10:37 PM manish gupta <[hidden email]> > wrote: > > > +1 > > > > Regards > > Manish Gupta > > > > On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <[hidden email] > > > > wrote: > > > > > +1 > > > > > > -Regards > > > Kumar Vishal > > > > > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > > > [hidden email]> wrote: > > > > > > > +1 > > > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > > > > wrote: > > > > > > > > > Hi > > > > > > > > > > Ya, good proposal. > > > > > CarbonData 0.x version integrate with spark 1.x, and the load data > > > > > solution > > > > > of 0.x version is using kettle. > > > > > CarbonData 1.x version integrate with spark 2.x, the load data > > solution > > > > of > > > > > 1.x version will not use kettle . > > > > > > > > > > That would be helpful to reduce maintenance cost through > > distinguishing > > > > the > > > > > major different version. > > > > > > > > > > +1 for the proposal. > > > > > > > > > > Regards > > > > > Liang > > > > > > > > > > > > > > > Venkata Gollamudi wrote > > > > > > Hi All, > > > > > > > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot > > of > > > > > > defects fixed and with number of performance improvements. > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-320? > > > jql=project%20%3D% > > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0- > incubating%20ORDER%20BY% > > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > > > Next version has many major and new value added features are > > planned, > > > > > > taking CarbonData capability to next level. > > > > > > Like > > > > > > - IUD(Insert-Update-Delete) support, > > > > > > - complete rewrite of data load flow with out Kettle, > > > > > > - Spark 2.x support, > > > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > > > > - alluxio(tachyon) file system support, > > > > > > - Carbon thrift format optimization for fast query, > > > > > > - Data loading performance improvement and In memory off heap > > > sorting, > > > > > > - Query performance improvement using off heap, > > > > > > - Support Vectorized batch reader. > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301? > > > jql=project%20%3D% > > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0- > incubating%20ORDER%20BY% > > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > > > I think it makes sense to change CarbonData Major version in next > > > > version > > > > > > to 1.0.0. > > > > > > Please comment and vote on this. > > > > > > > > > > > > Thanks, > > > > > > Ramana > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > View this message in context: > > > > > http://apache-carbondata-mailing-list-archive.1130556. > > > > n5.nabble.com/CarbonData-propose-major-version-number- > > > > increment-for-next-version-to-1-0-0-tp3131p3157.html > > > > > Sent from the Apache CarbonData Mailing List archive mailing list > > > archive > > > > > at Nabble.com. > > > > > > > > > > > > > > > |
|
|
In reply to this post by Venkata Gollamudi
+1,
and comments inline > 在 2016年11月24日，上午12:09，Venkata Gollamudi <[hidden email]> 写道： > > Hi All, > > CarbonData 0.2.0 has been a good work and stable release with lot of > defects fixed and with number of performance improvements. > https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > Next version has many major and new value added features are planned, > taking CarbonData capability to next level. > Like > - IUD(Insert-Update-Delete) support, Actually, the design doc Aniket has shared is for Update and Delete only, Insert is not covered. I think Insert is a feature need to be designed in the future. > - complete rewrite of data load flow with out Kettle, > - Spark 2.x support, Since Spark2.x has made changes to user level API and SQL, it will also make some CarbonData’s SQL command incompatible with earlier version. So I think upgrading CarbonData version to 1.0.0 also indicating this incompatibility. > - Standardize CarbonInputFormat and CarbonOutputFormat, > - alluxio(tachyon) file system support, > - Carbon thrift format optimization for fast query, > - Data loading performance improvement and In memory off heap sorting, > - Query performance improvement using off heap, > - Support Vectorized batch reader. > > https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY%20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > I think it makes sense to change CarbonData Major version in next version > to 1.0.0. > Please comment and vote on this. > > Thanks, > Ramana |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1 for changing to major version given the list of items being covered in
the release. Agree with Jacky's comment on IUD, lets correct it to Update/Delete support instead of IUD. Best Regards, Aniket On Thu, Nov 24, 2016 at 6:36 PM, Jacky Li <[hidden email]> wrote: > +1, > and comments inline > > > 在 2016年11月24日，上午12:09，Venkata Gollamudi <[hidden email]> 写道： > > > > Hi All, > > > > CarbonData 0.2.0 has been a good work and stable release with lot of > > defects fixed and with number of performance improvements. > > <a href="https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > Next version has many major and new value added features are planned, > > taking CarbonData capability to next level. > > Like > > - IUD(Insert-Update-Delete) support, > > Actually, the design doc Aniket has shared is for Update and Delete only, > Insert is not covered. I think Insert is a feature need to be designed in > the future. > > > - complete rewrite of data load flow with out Kettle, > > - Spark 2.x support, > > Since Spark2.x has made changes to user level API and SQL, it will also > make some CarbonData’s SQL command incompatible with earlier version. So I > think upgrading CarbonData version to 1.0.0 also indicating this > incompatibility. > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > - alluxio(tachyon) file system support, > > - Carbon thrift format optimization for fast query, > > - Data loading performance improvement and In memory off heap sorting, > > - Query performance improvement using off heap, > > - Support Vectorized batch reader. > > > > <a href="https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > I think it makes sense to change CarbonData Major version in next version > > to 1.0.0. > > Please comment and vote on this. > > > > Thanks, > > Ramana > > > > |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
In reply to this post by manishgupta88
+1
Thanks, Sujith On Nov 24, 2016 10:37 PM, "manish gupta" <[hidden email]> wrote: > +1 > > Regards > Manish Gupta > > On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <[hidden email]> > wrote: > > > +1 > > > > -Regards > > Kumar Vishal > > > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > > [hidden email]> wrote: > > > > > +1 > > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > > > wrote: > > > > > > > Hi > > > > > > > > Ya, good proposal. > > > > CarbonData 0.x version integrate with spark 1.x, and the load data > > > > solution > > > > of 0.x version is using kettle. > > > > CarbonData 1.x version integrate with spark 2.x, the load data > solution > > > of > > > > 1.x version will not use kettle . > > > > > > > > That would be helpful to reduce maintenance cost through > distinguishing > > > the > > > > major different version. > > > > > > > > +1 for the proposal. > > > > > > > > Regards > > > > Liang > > > > > > > > > > > > Venkata Gollamudi wrote > > > > > Hi All, > > > > > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot > of > > > > > defects fixed and with number of performance improvements. > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-320? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > Next version has many major and new value added features are > planned, > > > > > taking CarbonData capability to next level. > > > > > Like > > > > > - IUD(Insert-Update-Delete) support, > > > > > - complete rewrite of data load flow with out Kettle, > > > > > - Spark 2.x support, > > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > > > - alluxio(tachyon) file system support, > > > > > - Carbon thrift format optimization for fast query, > > > > > - Data loading performance improvement and In memory off heap > > sorting, > > > > > - Query performance improvement using off heap, > > > > > - Support Vectorized batch reader. > > > > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > I think it makes sense to change CarbonData Major version in next > > > version > > > > > to 1.0.0. > > > > > Please comment and vote on this. > > > > > > > > > > Thanks, > > > > > Ramana > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > View this message in context: > > > > http://apache-carbondata-mailing-list-archive.1130556. > > > n5.nabble.com/CarbonData-propose-major-version-number- > > > increment-for-next-version-to-1-0-0-tp3131p3157.html > > > > Sent from the Apache CarbonData Mailing List archive mailing list > > archive > > > > at Nabble.com. > > > > > > > > > > |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
+1
Good idea. Generally speaking minor version is bug fix, major is breaking API and command change. Regards JB On Nov 25, 2016, 10:00, at 10:00, sujith chacko <[hidden email]> wrote: >+1 > >Thanks, >Sujith > >On Nov 24, 2016 10:37 PM, "manish gupta" <[hidden email]> >wrote: > >> +1 >> >> Regards >> Manish Gupta >> >> On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal ><[hidden email]> >> wrote: >> >> > +1 >> > >> > -Regards >> > Kumar Vishal >> > >> > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < >> > [hidden email]> wrote: >> > >> > > +1 >> > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen ><[hidden email]> >> > > wrote: >> > > >> > > > Hi >> > > > >> > > > Ya, good proposal. >> > > > CarbonData 0.x version integrate with spark 1.x, and the load >data >> > > > solution >> > > > of 0.x version is using kettle. >> > > > CarbonData 1.x version integrate with spark 2.x, the load data >> solution >> > > of >> > > > 1.x version will not use kettle . >> > > > >> > > > That would be helpful to reduce maintenance cost through >> distinguishing >> > > the >> > > > major different version. >> > > > >> > > > +1 for the proposal. >> > > > >> > > > Regards >> > > > Liang >> > > > >> > > > >> > > > Venkata Gollamudi wrote >> > > > > Hi All, >> > > > > >> > > > > CarbonData 0.2.0 has been a good work and stable release with >lot >> of >> > > > > defects fixed and with number of performance improvements. >> > > > > >> > > > https://issues.apache.org/jira/browse/CARBONDATA-320? >> > jql=project%20%3D% >> > > >20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% >> > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC >> > > > > >> > > > > Next version has many major and new value added features are >> planned, >> > > > > taking CarbonData capability to next level. >> > > > > Like >> > > > > - IUD(Insert-Update-Delete) support, >> > > > > - complete rewrite of data load flow with out Kettle, >> > > > > - Spark 2.x support, >> > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, >> > > > > - alluxio(tachyon) file system support, >> > > > > - Carbon thrift format optimization for fast query, >> > > > > - Data loading performance improvement and In memory off heap >> > sorting, >> > > > > - Query performance improvement using off heap, >> > > > > - Support Vectorized batch reader. >> > > > > >> > > > > >> > > > https://issues.apache.org/jira/browse/CARBONDATA-301? >> > jql=project%20%3D% >> > > >20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% >> > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC >> > > > > >> > > > > I think it makes sense to change CarbonData Major version in >next >> > > version >> > > > > to 1.0.0. >> > > > > Please comment and vote on this. >> > > > > >> > > > > Thanks, >> > > > > Ramana >> > > > >> > > > >> > > > >> > > > >> > > > >> > > > -- >> > > > View this message in context: >> > > > http://apache-carbondata-mailing-list-archive.1130556. >> > > n5.nabble.com/CarbonData-propose-major-version-number- >> > > increment-for-next-version-to-1-0-0-tp3131p3157.html >> > > > Sent from the Apache CarbonData Mailing List archive mailing >list >> > archive >> > > > at Nabble.com. >> > > > >> > > >> > >> |
|
|
In reply to this post by sujith chacko
-1
I think 1.0.0 should be a production-ready version, when we think carbon is ready, we can change it to 1.0.0. Regards yuhai ------------------ 原始邮件 ------------------ 发件人: "sujith chacko";<[hidden email]>; 发送时间: 2016年11月25日(星期五) 下午5:30 收件人: "dev"<[hidden email]>; 主题: Re: CarbonData propose major version number increment for nextversion (to 1.0.0) +1 Thanks, Sujith On Nov 24, 2016 10:37 PM, "manish gupta" <[hidden email]> wrote: > +1 > > Regards > Manish Gupta > > On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <[hidden email]> > wrote: > > > +1 > > > > -Regards > > Kumar Vishal > > > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > > [hidden email]> wrote: > > > > > +1 > > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen <[hidden email]> > > > wrote: > > > > > > > Hi > > > > > > > > Ya, good proposal. > > > > CarbonData 0.x version integrate with spark 1.x, and the load data > > > > solution > > > > of 0.x version is using kettle. > > > > CarbonData 1.x version integrate with spark 2.x, the load data > solution > > > of > > > > 1.x version will not use kettle . > > > > > > > > That would be helpful to reduce maintenance cost through > distinguishing > > > the > > > > major different version. > > > > > > > > +1 for the proposal. > > > > > > > > Regards > > > > Liang > > > > > > > > > > > > Venkata Gollamudi wrote > > > > > Hi All, > > > > > > > > > > CarbonData 0.2.0 has been a good work and stable release with lot > of > > > > > defects fixed and with number of performance improvements. > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-320? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > Next version has many major and new value added features are > planned, > > > > > taking CarbonData capability to next level. > > > > > Like > > > > > - IUD(Insert-Update-Delete) support, > > > > > - complete rewrite of data load flow with out Kettle, > > > > > - Spark 2.x support, > > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, > > > > > - alluxio(tachyon) file system support, > > > > > - Carbon thrift format optimization for fast query, > > > > > - Data loading performance improvement and In memory off heap > > sorting, > > > > > - Query performance improvement using off heap, > > > > > - Support Vectorized batch reader. > > > > > > > > > > > > > > https://issues.apache.org/jira/browse/CARBONDATA-301? > > jql=project%20%3D% > > > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > > > > > > > > > I think it makes sense to change CarbonData Major version in next > > > version > > > > > to 1.0.0. > > > > > Please comment and vote on this. > > > > > > > > > > Thanks, > > > > > Ramana > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > View this message in context: > > > > http://apache-carbondata-mailing-list-archive.1130556. > > > n5.nabble.com/CarbonData-propose-major-version-number- > > > increment-for-next-version-to-1-0-0-tp3131p3157.html > > > > Sent from the Apache CarbonData Mailing List archive mailing list > > archive > > > > at Nabble.com. > > > > > > > > > > |
Re: Re： CarbonData propose major version number increment for nextversion (to 1.0.0)
|
Administrator
|
Hi
Thanks you participated in discussion. Currently, CarbonData has been formally deployed by many users. Just like i mentioned in the previous post, take 1.0.0,it would be helpful to reduce maintenance cost through distinguishing the major different version. Regards Liang
|
|
|
In reply to this post by Venkata Gollamudi
+1
I think it is a good choice because the new features add into next version are disruptive changes in carbon architecture. Regards, Lionx |
|
|
+1. i think it's natural for that big changes will made.
another reason is,carbon is stable enough after many bug fixed. Regards Jay ------------------ Original ------------------ From: "Lion.X";<[hidden email]>; Date: Sat, Nov 26, 2016 09:47 AM To: "dev"<[hidden email]>; Subject: Re: CarbonData propose major version number increment for nextversion (to 1.0.0) +1 I think it is a good choice because the new features add into next version are disruptive changes in carbon architecture. Regards, Lionx -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/CarbonData-propose-major-version-number-increment-for-next-version-to-1-0-0-tp3131p3217.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. |
|
|
In reply to this post by Venkata Gollamudi
+1
Regards Bill
|
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
Administrator
|
In reply to this post by Jean-Baptiste Onofré
Hi
Agree with JB's point. For next version, will use native SparkSession to instead CarbonContext, so it would be better if next version number cloud use 1.0.0 for distinguishing major API changes. Please find the detail discussion of CarbonData integration with Spark 2.x : http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Feature-Proposal-Spark-2-integration-with-CarbonData-td3236.html#a3238 Regards Liang
|
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
|
In reply to this post by Venkata Gollamudi
+1
-vimal On Nov 23, 2016 9:39 PM, "Venkata Gollamudi" <[hidden email]> wrote: > Hi All, > > CarbonData 0.2.0 has been a good work and stable release with lot of > defects fixed and with number of performance improvements. > <a href="https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-320?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > Next version has many major and new value added features are planned, > taking CarbonData capability to next level. > Like > - IUD(Insert-Update-Delete) support, > - complete rewrite of data load flow with out Kettle, > - Spark 2.x support, > - Standardize CarbonInputFormat and CarbonOutputFormat, > - alluxio(tachyon) file system support, > - Carbon thrift format optimization for fast query, > - Data loading performance improvement and In memory off heap sorting, > - Query performance improvement using off heap, > - Support Vectorized batch reader. > > <a href="https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D%">https://issues.apache.org/jira/browse/CARBONDATA-301?jql=project%20%3D% > 20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC > > I think it makes sense to change CarbonData Major version in next version > to 1.0.0. > Please comment and vote on this. > > Thanks, > Ramana > |
|
|
In reply to this post by Liang Chen
+1
A rich set of features are planned to be included into next release, and more importantly there will be external API changes introduced as we integrate with Spark 2.x, Carbondata deserves a major version jump as it gets mature/production ready and powerful in terms of rich functionality and better performance compared to other file format alternatives on Hadoop ecosystem. Regards. Jihong -----Original Message----- From: Liang Chen [mailto:[hidden email]] Sent: Saturday, November 26, 2016 8:19 PM To: [hidden email] Subject: Re: CarbonData propose major version number increment for next version (to 1.0.0) Hi Agree with JB's point. For next version, will use native SparkSession to instead CarbonContext, so it would be better if next version number cloud use 1.0.0 for distinguishing major API changes. Please find the detail discussion of CarbonData integration with Spark 2.x : http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Feature-Proposal-Spark-2-integration-with-CarbonData-td3236.html#a3238 Regards Liang Jean-Baptiste Onofré wrote > +1 > > Good idea. > > Generally speaking minor version is bug fix, major is breaking API and > command change. > > Regards > JB > > On Nov 25, 2016, 10:00, at 10:00, sujith chacko < > sujithchacko.2010@ > > wrote: >>+1 >> >>Thanks, >>Sujith >> >>On Nov 24, 2016 10:37 PM, "manish gupta" < > tomanishgupta18@ > > >>wrote: >> >>> +1 >>> >>> Regards >>> Manish Gupta >>> >>> On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal >>< > kumarvishal1802@ > > >>> wrote: >>> >>> > +1 >>> > >>> > -Regards >>> > Kumar Vishal >>> > >>> > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < >>> > > carbondatacontributions@ >> wrote: >>> > >>> > > +1 >>> > > On Thu, 24 Nov 2016 at 2:30 PM, Liang Chen >>< > chenliang6136@ > > >>> > > wrote: >>> > > >>> > > > Hi >>> > > > >>> > > > Ya, good proposal. >>> > > > CarbonData 0.x version integrate with spark 1.x, and the load >>data >>> > > > solution >>> > > > of 0.x version is using kettle. >>> > > > CarbonData 1.x version integrate with spark 2.x, the load data >>> solution >>> > > of >>> > > > 1.x version will not use kettle . >>> > > > >>> > > > That would be helpful to reduce maintenance cost through >>> distinguishing >>> > > the >>> > > > major different version. >>> > > > >>> > > > +1 for the proposal. >>> > > > >>> > > > Regards >>> > > > Liang >>> > > > >>> > > > >>> > > > Venkata Gollamudi wrote >>> > > > > Hi All, >>> > > > > >>> > > > > CarbonData 0.2.0 has been a good work and stable release with >>lot >>> of >>> > > > > defects fixed and with number of performance improvements. >>> > > > > >>> > > > https://issues.apache.org/jira/browse/CARBONDATA-320? >>> > jql=project%20%3D% >>> > > >>20CARBONDATA%20AND%20fixVersion%20%3D%200.2.0-incubating%20ORDER%20BY% >>> > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC >>> > > > > >>> > > > > Next version has many major and new value added features are >>> planned, >>> > > > > taking CarbonData capability to next level. >>> > > > > Like >>> > > > > - IUD(Insert-Update-Delete) support, >>> > > > > - complete rewrite of data load flow with out Kettle, >>> > > > > - Spark 2.x support, >>> > > > > - Standardize CarbonInputFormat and CarbonOutputFormat, >>> > > > > - alluxio(tachyon) file system support, >>> > > > > - Carbon thrift format optimization for fast query, >>> > > > > - Data loading performance improvement and In memory off heap >>> > sorting, >>> > > > > - Query performance improvement using off heap, >>> > > > > - Support Vectorized batch reader. >>> > > > > >>> > > > > >>> > > > https://issues.apache.org/jira/browse/CARBONDATA-301? >>> > jql=project%20%3D% >>> > > >>20CARBONDATA%20AND%20fixVersion%20%3D%200.3.0-incubating%20ORDER%20BY% >>> > > 20updated%20DESC%2C%20priority%20DESC%2C%20created%20ASC >>> > > > > >>> > > > > I think it makes sense to change CarbonData Major version in >>next >>> > > version >>> > > > > to 1.0.0. >>> > > > > Please comment and vote on this. >>> > > > > >>> > > > > Thanks, >>> > > > > Ramana >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > -- >>> > > > View this message in context: >>> > > > http://apache-carbondata-mailing-list-archive.1130556. >>> > > n5.nabble.com/CarbonData-propose-major-version-number- >>> > > increment-for-next-version-to-1-0-0-tp3131p3157.html >>> > > > Sent from the Apache CarbonData Mailing List archive mailing >>list >>> > archive >>> > > > at Nabble.com. >>> > > > >>> > > >>> > >>> -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/CarbonData-propose-major-version-number-increment-for-next-version-to-1-0-0-tp3131p3239.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com. |
Re: CarbonData propose major version number increment for next version (to 1.0.0)
|
Administrator
|
In reply to this post by Venkata Gollamudi
Hi
Thanks for all of your comments, will change the current master-SNAPSHOT version to 1.0.0 Regards Liang
|
«
Return to Apache CarbonData Dev Mailing List archive
|
1 view|%1 views
| Free forum by Nabble | Edit this page |