[jira] [Resolved] (CARBONDATA-3186) NPE when all the records in a file is badrecord with action redirect/ignore

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

kumar vishal resolved CARBONDATA-3186.
--------------------------------------
    Resolution: Fixed

> NPE when all the records in a file is badrecord with action redirect/ignore
> ---------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3186
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3186
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Ajantha Bhat
>            Assignee: Ajantha Bhat
>            Priority: Major
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> *problem:* In the no_sort flow, writer will be open as there is no blocking sort step.
> So, when all the record goes as bad record with redirect in converted step.
> writer is closing the empty .carbondata file.
> when this empty carbondata file is queried , we get multiple issues including NPE.
> *solution:* When the file size is 0 bytes. do the following
> a) If one data and one index file -- delete carbondata file and avoid index file creation
> b) If multiple data and one index file (with few data file is full of bad recod) -- delete carbondata files, remove them from blockIndexInfoList, so index file not will not have that info of empty carbon files
> c) In case direct write to store path is enable. need to delete data file from there and avoid writing index file with that carbondata in info.

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)