[jira] [Created] (CARBONDATA-1454) Block pruning not working when wrong data is given in filter

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1454) Block pruning not working when wrong data is given in filter

Akash R Nilugal (Jira)
Babulal created CARBONDATA-1454:
-----------------------------------

             Summary: Block pruning not working when wrong data is given in filter
                 Key: CARBONDATA-1454
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1454
             Project: CarbonData
          Issue Type: Bug
          Components: spark-integration
    Affects Versions: 1.1.1
            Reporter: Babulal


Load ~13 Million records all with 2013-07-25' date
Q1
select *  from test where  my_date='2013-07-25' ;
This took ~.0.5 sec

Q2
 select * from test where  my_date='' limit 1;

This tool ~30 sec .

Q2 data will not be found in carbon so actually it should be handled in the block pruning . and no job should be fired for it.

Same need to hanlde for timestamp also.

Solution :-
This to be consider as FalseExpression and handle same.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)