Apache CarbonData Dev Mailing List archive › Apache CarbonData JIRA issues

[jira] [Comment Edited] (CARBONDATA-666) Select Query fails with NullPoint exception if using 2 or more logical operators

classic Classic list List threaded Threaded
♦
♦
 1 message Options
Akash R Nilugal (Jira)
Reply | Threaded
Open this post in threaded view
♦
♦
|

[jira] [Comment Edited] (CARBONDATA-666) Select Query fails with NullPoint exception if using 2 or more logical operators

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15842468#comment-15842468 ]

Pallavi Singh edited comment on CARBONDATA-666 at 1/27/17 9:57 AM:
-------------------------------------------------------------------

I tried to run the following query with two logical operators and it seems to be working fine:

select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ;

and it gives me the following result set :

+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| cust_id  |    cust_name     |    active_emui_version     |          dob           |          doj           | bigint_column1  | bigint_column2  |     decimal_column1     |     decimal_column2     |    double_column1    |    double_column2     | integer_column1  |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+

 If you still encounter the problem. Please describe the entire scenario with attached csv.


was (Author: pallavisingh_09):
I tried to run the following query with two logical operators and it seems to be working fine:

select * from uniqdata where integer_column1 IN(159,17,4) OR cust_id NOT IN(9158,9016,9003) AND cust_name IN ('CUST_NAME_00003 ','CUST_NAME_00016') ;

and it gives me the following result set :

+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| cust_id  |    cust_name     |    active_emui_version     |          dob           |          doj           | bigint_column1  | bigint_column2  |     decimal_column1     |     decimal_column2     |    double_column1    |    double_column2     | integer_column1  |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9003     | CUST_NAME_00003  | ACTIVE_EMUI_VERSION_00003  | 1970-01-04 01:00:03.0  | 1970-01-04 02:00:03.0  | 123372036857    | -223372036851   | 12345678904.1234000000  | 22345678904.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 4                |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9016     | CUST_NAME_00016  | ACTIVE_EMUI_VERSION_00016  | 1970-01-17 01:00:03.0  | 1970-01-17 02:00:03.0  | 123372036870    | -223372036838   | 12345678917.1234000000  | 22345678917.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 17               |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
| 9158     | CUST_NAME_00158  | ACTIVE_EMUI_VERSION_00158  | 1970-06-08 01:00:03.0  | 1970-06-08 02:00:03.0  | 123372037012    | -223372036696   | 12345679059.1234000000  | 22345679059.1234000000  | 1.12345674897976E10  | -1.12345674897976E10  | 159              |
+----------+------------------+----------------------------+------------------------+------------------------+-----------------+-----------------+-------------------------+-------------------------+----------------------+-----------------------+------------------+--+

 

> Select Query fails with NullPoint exception if using 2 or more logical operators
> --------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-666
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-666
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.0.0-incubating
>         Environment: Spark 1.6
>            Reporter: Ramakrishna
>            Priority: Minor
>
> select * from communication.flow_carbon where cus_ac = '6222621350672465397' and txn_bk IN ('00000000000', '00000000001','00000000002') OR own_bk IN ('00000000124','00000000175','00000000034','00000000231','00000000167','00000000182','00000000206') limit 10;
> Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, linux-79): java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.NullPointerException
> at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:65)
> at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:35)
> at org.apache.carbondata.scan.result.iterator.ChunkRowIterator.<init>(ChunkRowIterator.java:43)
> at org.apache.carbondata.hadoop.CarbonRecordReader.initialize(CarbonRecordReader.java:81)
> at org.apache.carbondata.spark.rdd.CarbonScanRDD.compute(CarbonScanRDD.scala:194)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
> at org.apache.spark.scheduler.Task.run(Task.scala:89)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:227)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException: java.lang.NullPointerException
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator.next(DetailQueryResultIterator.java:52)
> ... 24 more
> Caused by: java.lang.NullPointerException
> at org.apache.carbondata.scan.result.AbstractScannedResult.getDictionaryKeyIntegerArray(AbstractScannedResult.java:186)
> at org.apache.carbondata.scan.result.impl.FilterQueryScannedResult.getDictionaryKeyIntegerArray(FilterQueryScannedResult.java:53)
> at org.apache.carbondata.scan.collector.impl.DictionaryBasedResultCollector.collectData(DictionaryBasedResultCollector.java:111)
> at org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:52)
> at org.apache.carbondata.scan.processor.impl.DataBlockIteratorImpl.next(DataBlockIteratorImpl.java:33)
> at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:78)
> at org.apache.carbondata.scan.result.iterator.DetailQueryResultIterator$1.call(DetailQueryResultIterator.java:72)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Free forum by Nabble Edit this page