[VOTE] Apache CarbonData 1.5.1(RC2) release

[ravipesala]

Hi

I submit the Apache CarbonData 1.5.1 (RC2) for your vote.

1.Release Notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320


    Some key features and improvements in this release:

   1. Optimized scan performance by avoiding multiple data copies and
   avoided double filtering for spark fileformat and presto by lazy loading
   and page pruning.
   2. Supported customize column compressor
   3. Supported concurrent reading through SDK reader to improve read
   performance.
   4. Supported fallback mechanism when offheap memory is not enough then
   switch to onheap
   5. Supported C++ interface for writing carbon data in CSDK
   6. Supported VectorizedReader for SDK Reader to improve read performance.
   7. Improved Blocklet DataMap pruning in driver using multi-threading.
   8. Make inverted index false by default
   9. Enable Local dictionary by default
   10. Support prefetch for compaction to improve compaction performance.
   11. Many Bug fixes and stabilized Carbondata.


 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
1d1eb7bd625f1af1745c555274dd69298a79ab65)
https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2


3. The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/


4. A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachecarbondata-1036/


5. Release artifacts are signed with the following key:

*https://people.apache.org/keys/committer/ravipesala.asc
<https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@.../9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*


Please vote on releasing this package as Apache CarbonData 1.5.1,  The vote

will be open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.


[ ] +1 Release this package as Apache CarbonData 1.5.1

[ ] 0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...


Regards,
Ravindra.

[xuchuanyin]

Hi, please consider this line of code: https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78

It uses apache-common-log directly instead of carbondata log. I’m not sure about the impact of this.
Please take care of this before voting.

Sent from laptop

From: Ravindra Pesala
Sent: Saturday, December 1, 2018 08:58
To: dev
Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release

Hi

I submit the Apache CarbonData 1.5.1 (RC2) for your vote.

1.Release Notes:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320


    Some key features and improvements in this release:

   1. Optimized scan performance by avoiding multiple data copies and
   avoided double filtering for spark fileformat and presto by lazy loading
   and page pruning.
   2. Supported customize column compressor
   3. Supported concurrent reading through SDK reader to improve read
   performance.
   4. Supported fallback mechanism when offheap memory is not enough then
   switch to onheap
   5. Supported C++ interface for writing carbon data in CSDK
   6. Supported VectorizedReader for SDK Reader to improve read performance.
   7. Improved Blocklet DataMap pruning in driver using multi-threading.
   8. Make inverted index false by default
   9. Enable Local dictionary by default
   10. Support prefetch for compaction to improve compaction performance.
   11. Many Bug fixes and stabilized Carbondata.


 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
1d1eb7bd625f1af1745c555274dd69298a79ab65)
https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2


3. The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/


4. A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachecarbondata-1036/


5. Release artifacts are signed with the following key:

*https://people.apache.org/keys/committer/ravipesala.asc
<https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@.../9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*


Please vote on releasing this package as Apache CarbonData 1.5.1,  The vote

will be open for the next 72 hours and passes if a majority of

at least three +1 PMC votes are cast.


[ ] +1 Release this package as Apache CarbonData 1.5.1

[ ] 0 I don't feel strongly about it, but I'm okay with the release

[ ] -1 Do not release this package because...


Regards,
Ravindra.

[xubo245]

@jackylk @ravipesala @KanakaKumar @kunal642
https://github.com/apache/carbondata/pull/2940 is a bug, please check it.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Jacky Li]

I think there are other places that are using apache-common-log, like https://github.com/apache/carbondata/blob/382ce430a18ca3d7d0b444777c66591e2c2e705f/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java#L103

Since this is not introduced in this version, I think it is OK to raise a jira now and solve it in next version.
So +1 for the voting.

Regards,
Jacky

> 在 2018年12月1日，下午9:41，xuchuanyin <[hidden email]> 写道：
>
> Hi, please consider this line of code: https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78
>
> It uses apache-common-log directly instead of carbondata log. I’m not sure about the impact of this.
> Please take care of this before voting.
>
> Sent from laptop
>
> From: Ravindra Pesala
> Sent: Saturday, December 1, 2018 08:58
> To: dev
> Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release
>
> Hi
>
> I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
>
> 1.Release Notes:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
>
>
>    Some key features and improvements in this release:
>
>   1. Optimized scan performance by avoiding multiple data copies and
>   avoided double filtering for spark fileformat and presto by lazy loading
>   and page pruning.
>   2. Supported customize column compressor
>   3. Supported concurrent reading through SDK reader to improve read
>   performance.
>   4. Supported fallback mechanism when offheap memory is not enough then
>   switch to onheap
>   5. Supported C++ interface for writing carbon data in CSDK
>   6. Supported VectorizedReader for SDK Reader to improve read performance.
>   7. Improved Blocklet DataMap pruning in driver using multi-threading.
>   8. Make inverted index false by default
>   9. Enable Local dictionary by default
>   10. Support prefetch for compaction to improve compaction performance.
>   11. Many Bug fixes and stabilized Carbondata.
>
>
> 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
> 1d1eb7bd625f1af1745c555274dd69298a79ab65)
> https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
>
>
> 3. The artifacts to be voted on are located here:
> https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
>
>
> 4. A staged Maven repository is available for review at:
> https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
>
>
> 5. Release artifacts are signed with the following key:
>
> *https://people.apache.org/keys/committer/ravipesala.asc
> <https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@.../9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D>*
>
>
> Please vote on releasing this package as Apache CarbonData 1.5.1,  The vote
>
> will be open for the next 72 hours and passes if a majority of
>
> at least three +1 PMC votes are cast.
>
>
> [ ] +1 Release this package as Apache CarbonData 1.5.1
>
> [ ] 0 I don't feel strongly about it, but I'm okay with the release
>
> [ ] -1 Do not release this package because...
>
>
> Regards,
> Ravindra.
>
>
>

[manishgupta88]

+1

Regards
Manish Gupta

On Mon, 3 Dec 2018 at 12:22 PM, Jacky Li <[hidden email]> wrote:

> I think there are other places that are using apache-common-log, like
> https://github.com/apache/carbondata/blob/382ce430a18ca3d7d0b444777c66591e2c2e705f/hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormat.java#L103
>
> Since this is not introduced in this version, I think it is OK to raise a
> jira now and solve it in next version.
> So +1 for the voting.
>
> Regards,
> Jacky
>
>
> > 在 2018年12月1日，下午9:41，xuchuanyin <[hidden email]> 写道：
> >
> > Hi, please consider this line of code:
> https://github.com/apache/carbondata/blob/master/core/src/main/java/org/apache/carbondata/core/datamap/TableDataMap.java#L78
> >
> > It uses apache-common-log directly instead of carbondata log. I’m not
> sure about the impact of this.
> > Please take care of this before voting.
> >
> > Sent from laptop
> >
> > From: Ravindra Pesala
> > Sent: Saturday, December 1, 2018 08:58
> > To: dev
> > Subject: [VOTE] Apache CarbonData 1.5.1(RC2) release
> >
> > Hi
> >
> > I submit the Apache CarbonData 1.5.1 (RC2) for your vote.
> >
> > 1.Release Notes:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12344320
> >
> >
> >    Some key features and improvements in this release:
> >
> >   1. Optimized scan performance by avoiding multiple data copies and
> >   avoided double filtering for spark fileformat and presto by lazy
> loading
> >   and page pruning.
> >   2. Supported customize column compressor
> >   3. Supported concurrent reading through SDK reader to improve read
> >   performance.
> >   4. Supported fallback mechanism when offheap memory is not enough then
> >   switch to onheap
> >   5. Supported C++ interface for writing carbon data in CSDK
> >   6. Supported VectorizedReader for SDK Reader to improve read
> performance.
> >   7. Improved Blocklet DataMap pruning in driver using multi-threading.
> >   8. Make inverted index false by default
> >   9. Enable Local dictionary by default
> >   10. Support prefetch for compaction to improve compaction performance.
> >   11. Many Bug fixes and stabilized Carbondata.
> >
> >
> > 2. The tag to be voted upon : apache-carbondata-1.5.1-rc2 (commit:
> > 1d1eb7bd625f1af1745c555274dd69298a79ab65)
> >
> https://github.com/apache/carbondata/releases/tag/apache-carbondata-1.5.1-rc2
> >
> >
> > 3. The artifacts to be voted on are located here:
> > https://dist.apache.org/repos/dist/dev/carbondata/1.5.1-rc2/
> >
> >
> > 4. A staged Maven repository is available for review at:
> >
> https://repository.apache.org/content/repositories/orgapachecarbondata-1036/
> >
> >
> > 5. Release artifacts are signed with the following key:
> >
> > *https://people.apache.org/keys/committer/ravipesala.asc
> > <
> https://link.getmailspring.com/link/1524823736.local-38e60b2f-d8f4-v1.2.1-7e7447b6@.../9?redirect=https%3A%2F%2Fpeople.apache.org%2Fkeys%2Fcommitter%2Fravipesala.asc&recipient=ZGV2QGNhcmJvbmRhdGEuYXBhY2hlLm9yZw%3D%3D
> >*
> >
> >
> > Please vote on releasing this package as Apache CarbonData 1.5.1,  The
> vote
> >
> > will be open for the next 72 hours and passes if a majority of
> >
> > at least three +1 PMC votes are cast.
> >
> >
> > [ ] +1 Release this package as Apache CarbonData 1.5.1
> >
> > [ ] 0 I don't feel strongly about it, but I'm okay with the release
> >
> > [ ] -1 Do not release this package because...
> >
> >
> > Regards,
> > Ravindra.
> >
> >
> >
>
>

[ravipesala]

Hi,

@Xubo Regarding your PR, the property is used only for internal test purpose
not to expose outside. I don't see any impact on any feature or on the
current release. We have given enough time between RC1 and RC2 releases to
consider and merge all necessary PRs. Please consult the release manager
before release if any of the PR you think is important.

Regarding,
Ravindra.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[kumarvishal09]

+1
Regards
Kumar Vishal

On Mon, 3 Dec 2018 at 12:59, ravipesala <[hidden email]> wrote:

> Hi,
>
> @Xubo Regarding your PR, the property is used only for internal test
> purpose
> not to expose outside. I don't see any impact on any feature or on the
> current release. We have given enough time between RC1 and RC2 releases to
> consider and merge all necessary PRs. Please consult the release manager
> before release if any of the PR you think is important.
>
> Regarding,
> Ravindra.
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

[kanaka]

+1

I think CARBONDATA-3116 is not introduced in 1.5.1 & As Ravindra mentioned,
If currently it is not intended for end users, we can discuss and optimize
configuration in next version

About the apache commons logging in TableDataMap.java#L78, as we verified
our local cluster required  messages still shown in log file. So, we can fix
together with other classes in next version.

Regards,
Kanaka



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[kunalkapoor]

+1

Regards
Kunal Kapoor

On Mon, Dec 3, 2018, 1:18 PM kanaka <[hidden email] wrote:

> +1
>
> I think CARBONDATA-3116 is not introduced in 1.5.1 & As Ravindra mentioned,
> If currently it is not intended for end users, we can discuss and optimize
> configuration in next version
>
> About the apache commons logging in TableDataMap.java#L78, as we verified
> our local cluster required  messages still shown in log file. So, we can
> fix
> together with other classes in next version.
>
> Regards,
> Kanaka
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

[xm_zzc]

+1



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[sraghunandan]

+1

On Mon, 3 Dec 2018, 3:03 pm xm_zzc, <[hidden email]> wrote:

> +1
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

[xubo245]

This bug can be fixed in next version（1.5.2）




--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Liang Chen]

Hi

+1

Regards
Liang



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[bhavya411]

+1

Regards
Bhavya

On Tue, Dec 4, 2018 at 10:24 AM Liang Chen <[hidden email]> wrote:

> Hi
>
> +1
>
> Regards
> Liang
>
>
>
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>

--
*Bhavya Aggarwal*
CTO & Partner
Knoldus Inc. <http://www.knoldus.com/>
[phone]
Canada - USA - India - Singapore
<https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak>
<https://www.facebook.com/KnoldusSoftware/> <https://blog.knoldus.com/>

[ravipesala]

Hi all

PMC vote has passed for Apache Carbondata 1.5.1 release, the result
as below:

+1(binding): 4（Liang Chen, Jacky, Kumar Vishal, Ravindra)

+1(non-binding) : 5

Thanks all for your vote.


Regards,
Ravindra

On Tue, 4 Dec 2018 at 16:57, Bhavya Aggarwal <[hidden email]> wrote:

> +1
>
> Regards
> Bhavya
>
> On Tue, Dec 4, 2018 at 10:24 AM Liang Chen <[hidden email]>
> wrote:
>
> > Hi
> >
> > +1
> >
> > Regards
> > Liang
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>
>
> --
> *Bhavya Aggarwal*
> CTO & Partner
> Knoldus Inc. <http://www.knoldus.com/>
> [phone]
> Canada - USA - India - Singapore
> <https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak>
> <https://www.facebook.com/KnoldusSoftware/> <https://blog.knoldus.com/>
>

--
Thanks & Regards,
Ravi