[jira] [Created] (CARBONDATA-3186) NPE when all the records in a file is badrecord with action redirect/ignore

[Akash R Nilugal (Jira)]

Ajantha Bhat created CARBONDATA-3186:
----------------------------------------

             Summary: NPE when all the records in a file is badrecord with action redirect/ignore
                 Key: CARBONDATA-3186
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3186
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


*problem:* In the no_sort flow, writer will be open as there is no blocking sort step.
So, when all the record goes as bad record with redirect in converted step.
writer is closing the empty .carbondata file.
when this empty carbondata file is queried , we get multiple issues including NPE.

*solution:* When the file size is 0 bytes. do the following
a) If one data and one index file -- delete carbondata file and avoid index file creation
b) If multiple data and one index file (with few data file is full of bad recod) -- delete carbondata files, remove them from blockIndexInfoList, so index file not will not have that info of empty carbon files
c) In case direct write to store path is enable. need to delete data file from there and avoid writing index file with that carbondata in info.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)