[jira] [Created] (CARBONDATA-1364) Add the blocklet info to index file and make the datamap distributable with job

[Akash R Nilugal (Jira)]

Ravindra Pesala created CARBONDATA-1364:
-------------------------------------------

             Summary: Add the blocklet info to index file and make the datamap distributable with job
                 Key: CARBONDATA-1364
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1364
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ravindra Pesala


Add the blocklet info to index file and make the datamap distributable with job

1. Add the blocklet info to the carbonindex file, so datamap not required to read each carbondata file footer to the blocklet information. This makes the datamap loading faster.

2. Make the data map distributable and add to the spark job. So datamap pruning could happen distributable and pruned blocklet list would be sent to driver.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)