[Discussion] Support Date/Time format for Timestamp columns to be defined at column level

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

[Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Lion.X
Hi, all

In recent days, I am trying to handle issues CARBONDATA-37. We are trying
to support that Date format can be set at column level.

There is a doubt that we should feedback the the same format for Date
column or feedback a uniform format. Absolutely.

For example.

we create a table and define two cols which data type is Date. But the Date
format is different.

col1(Date)       col2(Date)
2016-09-24     2016-09-25 00:00:00

when querying, for two formats below, which should be returned?

 col1(Date)       col2(Date)
2016-09-24     2016-09-25 00:00:00

or

 col1(Date)                         col2(Date)
2016-09-24 00:00:00     2016-09-25 00:00:00

if we set YYYY-MM-DD HH:MM:SS as default format.


Best wishes!
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Vimal Das Kammath
Hi,

The date format at column level should be to support loading data into
carbon from csv files which have multiple columns with different date
format. Currently data loading will fail if the multiple date columns are
in different format.

For the query result, my opinion is that the all the date columns in the
result should be in a single format.

Regards
Vimal


On Sep 24, 2016 2:11 PM, "向志强" <[hidden email]> wrote:

> Hi, all
>
> In recent days, I am trying to handle issues CARBONDATA-37. We are trying
> to support that Date format can be set at column level.
>
> There is a doubt that we should feedback the the same format for Date
> column or feedback a uniform format. Absolutely.
>
> For example.
>
> we create a table and define two cols which data type is Date. But the Date
> format is different.
>
> col1(Date)       col2(Date)
> 2016-09-24     2016-09-25 00:00:00
>
> when querying, for two formats below, which should be returned?
>
>  col1(Date)       col2(Date)
> 2016-09-24     2016-09-25 00:00:00
>
> or
>
>  col1(Date)                         col2(Date)
> 2016-09-24 00:00:00     2016-09-25 00:00:00
>
> if we set YYYY-MM-DD HH:MM:SS as default format.
>
>
> Best wishes!
>
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Venkata Gollamudi
I completely agree with Vimal das.

On Sat, Sep 24, 2016, 10:05 PM Vimal Das Kammath <[hidden email]>
wrote:

> Hi,
>
> The date format at column level should be to support loading data into
> carbon from csv files which have multiple columns with different date
> format. Currently data loading will fail if the multiple date columns are
> in different format.
>
> For the query result, my opinion is that the all the date columns in the
> result should be in a single format.
>
> Regards
> Vimal
>
>
> On Sep 24, 2016 2:11 PM, "向志强" <[hidden email]> wrote:
>
> > Hi, all
> >
> > In recent days, I am trying to handle issues CARBONDATA-37. We are trying
> > to support that Date format can be set at column level.
> >
> > There is a doubt that we should feedback the the same format for Date
> > column or feedback a uniform format. Absolutely.
> >
> > For example.
> >
> > we create a table and define two cols which data type is Date. But the
> Date
> > format is different.
> >
> > col1(Date)       col2(Date)
> > 2016-09-24     2016-09-25 00:00:00
> >
> > when querying, for two formats below, which should be returned?
> >
> >  col1(Date)       col2(Date)
> > 2016-09-24     2016-09-25 00:00:00
> >
> > or
> >
> >  col1(Date)                         col2(Date)
> > 2016-09-24 00:00:00     2016-09-25 00:00:00
> >
> > if we set YYYY-MM-DD HH:MM:SS as default format.
> >
> >
> > Best wishes!
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Jean-Baptiste Onofré
In reply to this post by Vimal Das Kammath
+1

Regards
JB

On 09/24/2016 06:35 PM, Vimal Das Kammath wrote:

> Hi,
>
> The date format at column level should be to support loading data into
> carbon from csv files which have multiple columns with different date
> format. Currently data loading will fail if the multiple date columns are
> in different format.
>
> For the query result, my opinion is that the all the date columns in the
> result should be in a single format.
>
> Regards
> Vimal
>
>
> On Sep 24, 2016 2:11 PM, "向志强" <[hidden email]> wrote:
>
>> Hi, all
>>
>> In recent days, I am trying to handle issues CARBONDATA-37. We are trying
>> to support that Date format can be set at column level.
>>
>> There is a doubt that we should feedback the the same format for Date
>> column or feedback a uniform format. Absolutely.
>>
>> For example.
>>
>> we create a table and define two cols which data type is Date. But the Date
>> format is different.
>>
>> col1(Date)       col2(Date)
>> 2016-09-24     2016-09-25 00:00:00
>>
>> when querying, for two formats below, which should be returned?
>>
>>  col1(Date)       col2(Date)
>> 2016-09-24     2016-09-25 00:00:00
>>
>> or
>>
>>  col1(Date)                         col2(Date)
>> 2016-09-24 00:00:00     2016-09-25 00:00:00
>>
>> if we set YYYY-MM-DD HH:MM:SS as default format.
>>
>>
>> Best wishes!
>>
>

--
Jean-Baptiste Onofré
[hidden email]
http://blog.nanthrax.net
Talend - http://www.talend.com
Reply | Threaded
Open this post in threaded view
|

RE: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Jihong Ma
In reply to this post by Venkata Gollamudi
I agree we should allow specifying timestamp format at column level, and respect that at data loading as well as query time. Is there technical reason which prevent us from doing that? Otherwise, respecting the specification should be the way to go.

col1(Date)       col2(Date)
> > 2016-09-24     2016-09-25 00:00:00

Regards.

Jihong

-----Original Message-----
From: Venkata Gollamudi [mailto:[hidden email]]
Sent: Monday, September 26, 2016 1:05 PM
To: [hidden email]
Subject: Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

I completely agree with Vimal das.

On Sat, Sep 24, 2016, 10:05 PM Vimal Das Kammath <[hidden email]>
wrote:

> Hi,
>
> The date format at column level should be to support loading data into
> carbon from csv files which have multiple columns with different date
> format. Currently data loading will fail if the multiple date columns are
> in different format.
>
> For the query result, my opinion is that the all the date columns in the
> result should be in a single format.
>
> Regards
> Vimal
>
>
> On Sep 24, 2016 2:11 PM, "向志强" <[hidden email]> wrote:
>
> > Hi, all
> >
> > In recent days, I am trying to handle issues CARBONDATA-37. We are trying
> > to support that Date format can be set at column level.
> >
> > There is a doubt that we should feedback the the same format for Date
> > column or feedback a uniform format. Absolutely.
> >
> > For example.
> >
> > we create a table and define two cols which data type is Date. But the
> Date
> > format is different.
> >
> > col1(Date)       col2(Date)
> > 2016-09-24     2016-09-25 00:00:00
> >
> > when querying, for two formats below, which should be returned?
> >
> >  col1(Date)       col2(Date)
> > 2016-09-24     2016-09-25 00:00:00
> >
> > or
> >
> >  col1(Date)                         col2(Date)
> > 2016-09-24 00:00:00     2016-09-25 00:00:00
> >
> > if we set YYYY-MM-DD HH:MM:SS as default format.
> >
> >
> > Best wishes!
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

bill.zhou
In reply to this post by Vimal Das Kammath
+1 I agree Vimal's opinion.
if user want other formatted, he can use function to convert.

Regards
Bill
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns tobe defined at column level

杰
+1 agree to vimal's opinion

---Original---
From: "bill.zhou"<[hidden email]>
Date: 2016/9/29 17:07:04
To: "dev"<[hidden email]>;
Subject: Re: [Discussion] Support Date/Time format for Timestamp columns tobe defined at column level


+1 I agree Vimal's opinion.
if user want other formatted, he can use function to convert.

Regards
Bill



--
View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discussion-Support-Date-Time-format-for-Timestamp-columns-to-be-defined-at-column-level-tp1422p1560.html
Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns tobe defined at column level

kumarvishal09
+1 I agree vimals opinion

On Sep 29, 2016 17:22, "杰" <[hidden email]> wrote:

> +1 agree to vimal's opinion
>
> ---Original---
> From: "bill.zhou"<[hidden email]>
> Date: 2016/9/29 17:07:04
> To: "dev"<[hidden email]>;
> Subject: Re: [Discussion] Support Date/Time format for Timestamp columns
> tobe defined at column level
>
>
> +1 I agree Vimal's opinion.
> if user want other formatted, he can use function to convert.
>
> Regards
> Bill
>
>
>
> --
> View this message in context: http://apache-carbondata-
> mailing-list-archive.1130556.n5.nabble.com/Discussion-
> Support-Date-Time-format-for-Timestamp-columns-to-be-
> defined-at-column-level-tp1422p1560.html
> Sent from the Apache CarbonData Mailing List archive mailing list archive
> at Nabble.com.
kumar vishal
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns tobe defined at column level

Aniket Adnaik
+1 single date/time format.
Regards,
Aniket

On Thu, Sep 29, 2016 at 12:50 PM, Kumar Vishal <[hidden email]>
wrote:

> +1 I agree vimals opinion
>
> On Sep 29, 2016 17:22, "杰" <[hidden email]> wrote:
>
> > +1 agree to vimal's opinion
> >
> > ---Original---
> > From: "bill.zhou"<[hidden email]>
> > Date: 2016/9/29 17:07:04
> > To: "dev"<[hidden email]>;
> > Subject: Re: [Discussion] Support Date/Time format for Timestamp columns
> > tobe defined at column level
> >
> >
> > +1 I agree Vimal's opinion.
> > if user want other formatted, he can use function to convert.
> >
> > Regards
> > Bill
> >
> >
> >
> > --
> > View this message in context: http://apache-carbondata-
> > mailing-list-archive.1130556.n5.nabble.com/Discussion-
> > Support-Date-Time-format-for-Timestamp-columns-to-be-
> > defined-at-column-level-tp1422p1560.html
> > Sent from the Apache CarbonData Mailing List archive mailing list archive
> > at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: [Discussion] Support Date/Time format for Timestamp columns to be defined at column level

Lion.X
In reply to this post by Lion.X
Hi,all
I have done this issue.
Pls check:
PR 219
https://github.com/apache/incubator-carbondata/pull/219

2016-09-24 16:41 GMT+08:00 向志强 <[hidden email]>:

> Hi, all
>
> In recent days, I am trying to handle issues CARBONDATA-37. We are trying
> to support that Date format can be set at column level.
>
> There is a doubt that we should feedback the the same format for Date
> column or feedback a uniform format. Absolutely.
>
> For example.
>
> we create a table and define two cols which data type is Date. But the
> Date format is different.
>
> col1(Date)       col2(Date)
> 2016-09-24     2016-09-25 00:00:00
>
> when querying, for two formats below, which should be returned?
>
>  col1(Date)       col2(Date)
> 2016-09-24     2016-09-25 00:00:00
>
> or
>
>  col1(Date)                         col2(Date)
> 2016-09-24 00:00:00     2016-09-25 00:00:00
>
> if we set YYYY-MM-DD HH:MM:SS as default format.
>
>
> Best wishes!
>