Re: [Issue] Long string columns config for big strings not work

Posted by xuchuanyin on Oct 11, 2018; 6:10am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Issue-Long-string-columns-config-for-big-strings-not-work-tp64876p64880.html

Yeah, aaron, the problem may lies in the dataframe and long_string_columns.

Can you try the following statement? It is from the test code in
'VarcharDataTypesBasicTestCase', which suggests you to specify the
'long_string_columns' while writing the dataframe.

```scala
  test("write from dataframe with long string datatype") {
    prepareDF()
    // write spark dataframe to carbondata with `long_string_columns`
property
    longStringDF.write
      .format("carbondata")
      .option("tableName", longStringTable)
      .option("single_pass", "false")
      .option("sort_columns", "name")
      .option("long_string_columns", "description, note")
      .mode(SaveMode.Overwrite)
      .save()

    checkQuery()
  }
```



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/