[jira] [Created] (CARBONDATA-1533) Fixed decimal data load fail issue and restricted max characters per column

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1533) Fixed decimal data load fail issue and restricted max characters per column

Akash R Nilugal (Jira)
Manish Gupta created CARBONDATA-1533:
----------------------------------------

             Summary: Fixed decimal data load fail issue and restricted max characters per column
                 Key: CARBONDATA-1533
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1533
             Project: CarbonData
          Issue Type: Bug
            Reporter: Manish Gupta
            Assignee: Manish Gupta
            Priority: Minor


1. Data load fails when both precision and data falls in integer range for decimal data type with exception as below:
17/09/28 16:36:28 ERROR CarbonFactDataHandlerColumnar: pool-20-thread-1 Error in producer
java.lang.RuntimeException: internal error: org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec[src type: DECIMAL, target type: INT, stats(org.apache.carbondata.core.datastore.page.statistics.PrimitivePageStatsCollector@2afaa54e)]
        at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$3.encode(AdaptiveIntegralCodec.java:142)
        at org.apache.carbondata.core.datastore.page.SafeDecimalColumnPage.convertValue(SafeDecimalColumnPage.java:209)
        at org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveIntegralCodec$1.encodeData(AdaptiveIntegralCodec.java:67)
        at org.apache.carbondata.core.datastore.page.encoding.ColumnPageEncoder.encode(ColumnPageEncoder.java:57)
        at org.apache.carbondata.processing.store.TablePage.encodeAndCompressMeasures(TablePage.java:284)
        at org.apache.carbondata.processing.store.TablePage.encode(TablePage.java:269)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.processDataRows(CarbonFactDataHandlerColumnar.java:350)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar.access$500(CarbonFactDataHandlerColumnar.java:62)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:724)
        at org.apache.carbondata.processing.store.CarbonFactDataHandlerColumnar$Producer.call(CarbonFactDataHandlerColumnar.java:701)


2. Negative Array size exception is thrown when max characters per column is greater than Short max value during data load.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)