Re: [Issue] Long string columns config for big strings not work

Posted by xuchuanyin on Oct 12, 2018; 7:56am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Issue-Long-string-columns-config-for-big-strings-not-work-tp64876p64943.html

Hi, arron, I go through the code and find the root cause.

While writing dataframe to carbontable, we have to keep the order of the
fields in dataframe the same as that in carbontable. The code lies in
`NewCarbonDataLoadRDD.scala#486`. This is because we judge whether the field
is a longStringColumn based on the fields in create table, if the order is
different from that in dataframe, the value convert will fail.

To workaround currently, I'm afraid you have to take care of that order and
I'll fix it as soon as possible.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/