[jira] [Created] (CARBONDATA-1515) Fixed NPE in Data loading

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1515) Fixed NPE in Data loading

Akash R Nilugal (Jira)
kumar vishal created CARBONDATA-1515:
----------------------------------------

             Summary: Fixed NPE in Data loading
                 Key: CARBONDATA-1515
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1515
             Project: CarbonData
          Issue Type: Bug
            Reporter: kumar vishal
            Assignee: kumar vishal


Scenario:
Data size: 3.5 billion rows(4.1 tb data)
3 node cluster
Number of core while data loading 12.
No. of loads 100 times
Problem: In DataConverterProcessorStepImpl it is using array list for adding all the local converter, in case of multiple thread scenario it is creating a hole (null value)(as array list if not synchronized). while closing the converter it is it is throwing NPE
Solution: Add local converter in synchronized block






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)