[jira] [Closed] (CARBONDATA-436) Make blocklet size configuration respect to the actual size (in terms of byte) of the blocklet

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Closed] (CARBONDATA-436) Make blocklet size configuration respect to the actual size (in terms of byte) of the blocklet

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

QiangCai closed CARBONDATA-436.
-------------------------------
    Resolution: Fixed

> Make blocklet size configuration respect to the actual size (in terms of byte) of the blocklet
> ----------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-436
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-436
>             Project: CarbonData
>          Issue Type: Sub-task
>            Reporter: suo tong
>            Assignee: QiangCai
>            Priority: Major
>
> Currently, the blocklet size is based on the row counts within the blocklet. The default value(120000) is small for hdfs io. If we increase the value, which may cause too many Young-GC when we scan many columns, instead, we can extend the configuration with respect to the actual size of the blocklet.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)