[jira] [Created] (CARBONDATA-436) change blocklet size related to the raw size of data

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-436) change blocklet size related to the raw size of data

Akash R Nilugal (Jira)
suo tong created CARBONDATA-436:
-----------------------------------

             Summary: change blocklet size related to the raw size of data
                 Key: CARBONDATA-436
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-436
             Project: CarbonData
          Issue Type: Sub-task
            Reporter: suo tong
            Assignee: QiangCai


Currently, the blocklet size is the row counts in the blocklet. The default value(120000) is small for hdfs io. If we increase the value, which may cause too many Young-GC when we scan many columns. Like parquet, its row group size can be configed, and using hdfs block size as its default value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)