Login  Register

[jira] [Created] (CARBONDATA-436) change blocklet size related to the raw size of data

classic Classic list List threaded Threaded
1 message Options Options
Embed post
Permalink
Reply | Threaded
Open this post in threaded view
| More
Print post
Permalink

[jira] [Created] (CARBONDATA-436) change blocklet size related to the raw size of data

Akash R Nilugal (Jira)
suo tong created CARBONDATA-436:
-----------------------------------

             Summary: change blocklet size related to the raw size of data
                 Key: CARBONDATA-436
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-436
             Project: CarbonData
          Issue Type: Sub-task
            Reporter: suo tong
            Assignee: QiangCai


Currently, the blocklet size is the row counts in the blocklet. The default value(120000) is small for hdfs io. If we increase the value, which may cause too many Young-GC when we scan many columns. Like parquet, its row group size can be configed, and using hdfs block size as its default value.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)