[jira] [Updated] (CARBONDATA-2646) While loading data into into a table with 'SORT_COLUMN_BOUNDS' property, 'ERROR' flag is displayed instead of 'WARN' flag.

[Akash R Nilugal (Jira)]

     [ https://issues.apache.org/jira/browse/CARBONDATA-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

wangsen updated CARBONDATA-2646:
--------------------------------
    Description:
!log.png! 【Test step】：
 1. Create a table with 'sort_column' tblproperty.
 2. Load data into that table with the 'SORT_COLUMN_BOUNDS' property.

Test queries:
 drop table if exists sortcolumnboundtable1;
 CREATE TABLE sortcolumnboundtable1 (ID Int, date Timestamp, country String, name String, phonetype String, serialname String, salary Int) STORED BY 'carbondata' tblproperties('sort_columns'='ID,name');
 LOAD DATA INPATH '/user/prasanna/source_for_sort_column_bounds.csv' INTO TABLE sortcolumnboundtable1 OPTIONS('fileheader'='ID,date,country,name,phonetype,serialname,salary','sort_column_bounds'='10,aab1;20,aab1;100,aab1;1000,aab1','timestampformat'='yyyy/MM/dd'); 

【check the log】
  

8/06/25 16:14:32 INFO loading.DataLoadExecutor: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Data Loading is started for table sortcolumnboundtable1 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 INFO memory.UnsafeSortMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] It is not recommended to keep unsafe memory size less than 1024MB, so setting default value to 1024 18/06/25 16:14:32 INFO memory.UnsafeSortMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Sort Memory manager is created with size 1073741824 with org.apache.carbondata.core.memory.UnsafeMemoryAllocator@cd24739 18/06/25 16:14:32 INFO memory.UnsafeMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Working Memory manager is created with size 536870912 with org.apache.carbondata.core.memory.UnsafeMemoryAllocator@cd24739 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp


  

  was:
!log.png! 【Test step】：
 1. Create a table with 'sort_column' tblproperty.
 2. Load data into that table with the 'SORT_COLUMN_BOUNDS' property.

Test queries:
 drop table if exists sortcolumnboundtable1;
 CREATE TABLE sortcolumnboundtable1 (ID Int, date Timestamp, country String, name String, phonetype String, serialname String, salary Int) STORED BY 'carbondata' tblproperties('sort_columns'='ID,name');
 LOAD DATA INPATH '/user/prasanna/source_for_sort_column_bounds.csv' INTO TABLE sortcolumnboundtable1 OPTIONS('fileheader'='ID,date,country,name,phonetype,serialname,salary','sort_column_bounds'='10,aab1;20,aab1;100,aab1;1000,aab1','timestampformat'='yyyy/MM/dd'); 

【check the log】
 
Print log error 
 

> While loading data into into a table with 'SORT_COLUMN_BOUNDS' property, 'ERROR' flag is displayed instead of 'WARN' flag.
> ---------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-2646
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2646
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load
>    Affects Versions: 1.4.0
>            Reporter: wangsen
>            Assignee: wangsen
>            Priority: Minor
>             Fix For: 1.4.1
>
>
> !log.png! 【Test step】：
>  1. Create a table with 'sort_column' tblproperty.
>  2. Load data into that table with the 'SORT_COLUMN_BOUNDS' property.
> Test queries:
>  drop table if exists sortcolumnboundtable1;
>  CREATE TABLE sortcolumnboundtable1 (ID Int, date Timestamp, country String, name String, phonetype String, serialname String, salary Int) STORED BY 'carbondata' tblproperties('sort_columns'='ID,name');
>  LOAD DATA INPATH '/user/prasanna/source_for_sort_column_bounds.csv' INTO TABLE sortcolumnboundtable1 OPTIONS('fileheader'='ID,date,country,name,phonetype,serialname,salary','sort_column_bounds'='10,aab1;20,aab1;100,aab1;1000,aab1','timestampformat'='yyyy/MM/dd'); 
> 【check the log】
>   
> 8/06/25 16:14:32 INFO loading.DataLoadExecutor: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Data Loading is started for table sortcolumnboundtable1 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 INFO memory.UnsafeSortMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] It is not recommended to keep unsafe memory size less than 1024MB, so setting default value to 1024 18/06/25 16:14:32 INFO memory.UnsafeSortMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Sort Memory manager is created with size 1073741824 with org.apache.carbondata.core.memory.UnsafeMemoryAllocator@cd24739 18/06/25 16:14:32 INFO memory.UnsafeMemoryManager: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] Working Memory manager is created with size 536870912 with org.apache.carbondata.core.memory.UnsafeMemoryAllocator@cd24739 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp 18/06/25 16:14:32 ERROR impl.UnsafeParallelReadMergeSorterWithColumnRangeImpl: [Executor task launch worker for task 0][partitionID:sortcolumnboundtable1;queryID:2916995336294991] set temp location: /tmp/carbon2916995416352957_0/Fact/Part0/Segment_0/0/sortrowtmp
>   

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)