[ https://issues.apache.org/jira/browse/CARBONDATA-852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013681#comment-16013681 ] SWATI RAO commented on CARBONDATA-852: -------------------------------------- [~vin7149] spark.sql("DROP TABLE IF EXISTS uniqdata") spark.sql("CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, " + "DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint," + "DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 " + "double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache" + ".carbondata.format' TBLPROPERTIES (\"TABLE_BLOCKSIZE\"= \"256 MB\")") spark.sql("LOAD DATA INPATH '/home/knoldus/Desktop/carbondata/carbondata/examples/spark2/src/main/resources/2000_UniqData.csv' into table " + "uniqdata OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='\"','BAD_RECORDS_ACTION'='FORCE'," + "'FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1," + "BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2," + "INTEGER_COLUMN1')") spark.sql("select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01' ").show spark.sql("select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01' ").show > Less than or equal to operator(<=) does not work properly in Range Filter. > -------------------------------------------------------------------------- > > Key: CARBONDATA-852 > URL: https://issues.apache.org/jira/browse/CARBONDATA-852 > Project: CarbonData > Issue Type: Bug > Components: data-load > Affects Versions: 1.1.0 > Environment: Spark 2-1 > Reporter: Vinod Rohilla > Priority: Minor > Attachments: 2000_UniqData.csv > > > Less than or equal (<=) to operator does not work properly in range filter. > Steps to reproduces: > 1)Create table: > CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB"); > 2)Load Data in a table: > LOAD DATA INPATH 'HDFS_URL/BabuStore/Data/uniqdata/2000_UniqData.csv' into table uniqdata OPTIONS('DELIMITER'=',' , 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1'); > 3: Run the Query. > select dob from uniqdata where dob <= '1972-12-10' and dob >= '1972-12-01'; > 4:Result on beeline: > +------------------------+--+ > | dob | > +------------------------+--+ > | 1972-12-01 01:00:03.0 | > | 1972-12-02 01:00:03.0 | > | 1972-12-03 01:00:03.0 | > | 1972-12-04 01:00:03.0 | > | 1972-12-05 01:00:03.0 | > | 1972-12-06 01:00:03.0 | > | 1972-12-07 01:00:03.0 | > | 1972-12-08 01:00:03.0 | > | 1972-12-09 01:00:03.0 | > +------------------------+--+ > Expected Result: It should include " 1972-12-10 " in the result set. -- This message was sent by Atlassian JIRA (v6.3.15#6346) |
Free forum by Nabble | Edit this page |