Yahui Liu created CARBONDATA-4157:
-------------------------------------
Summary: load data timestamp data didn't consider daylight saving time
Key: CARBONDATA-4157
URL:
https://issues.apache.org/jira/browse/CARBONDATA-4157 Project: CarbonData
Issue Type: Bug
Components: data-load
Affects Versions: 2.1.0
Reporter: Yahui Liu
# prepare one txt file contains 1 time data in daylight saving time, for example "1991-08-12 00:00:00"
# upload the file to one hdfs folder, for example /tmp/test_time
# create carbon table: create table test_time(t timestamp) stored as carbondata;
# create one external txt table with location to the data file folder: create table test_time_txt(t timestamp) location '/tmp/test_time';
# insert the data in txt table into carbon table: insert into test_time select * from test_time_txt; then query carbon table, result is:
# +------------------------+
| t |
+------------------------+
| 1991-08-12 01:00:00.0 |
+------------------------+
# load data directly into carbon table: load data inpath '/tmp/test_time' into table test_time options('fileheader'='t'); then query carbon table, result is:
# +------------------------+
| t |
+------------------------+
| 1991-08-12 00:00:00.0 |
+------------------------+
# same data file, insert into and load data give different result, and because "1991-08-12 00:00:00" is in daylight saving time, so most of the file format give "1991-08-12 01:00:00" as the result.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)