[DISCUSSION] Complex Delimiter support as per Hive format

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[DISCUSSION] Complex Delimiter support as per Hive format

ManishNalla
Hi all,

I am working on Complex Datatype Map and want to propose a change in
delimiters which are currently being used. We are currently supporting '$'
and ':' as the two delimiters but this does not support TimeStamp to be a
type as its format also contains ':' .
So like Hive we can change the delimiters to '\001' and '\002' ASCII
characters for complex types. Please let me know your suggestions.

Regards,
Manish Nalla



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSSION] Complex Delimiter support as per Hive format

manishgupta88
+1

We should modify the delimters as per hive. Also update the documentation as
per the change.

Regards
Manish Gupta



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSSION] Complex Delimiter support as per Hive format

xubo245
In reply to this post by ManishNalla
CSDK also used '\001' and '\002' for Array<string>, I think it's better and
more common for different scenario.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
Reply | Threaded
Open this post in threaded view
|

Re: [DISCUSSION] Complex Delimiter support as per Hive format

xubo245
This post was updated on .
'\001' and '\002' are invisible character, string won't contains these
character usually. But sometimes string will contain $,# and other visible
character



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/