[GitHub] carbondata pull request #2415: [CARBONDATA-2659] Support partition table by ...

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    Build Failed  with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7291/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6058/



---

[qiuchenjian-2]

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    retest this please


---

[qiuchenjian-2]

Github user jackylk commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2415#discussion_r208224446
 
    --- Diff: integration/spark2/src/main/scala/org/apache/spark/sql/CarbonDataFrameWriter.scala ---
    @@ -92,11 +89,38 @@ class CarbonDataFrameWriter(sqlContext: SQLContext, val dataFrame: DataFrame) {
         ).filter(_._2.isDefined)
           .map(property => s"'${property._1}' = '${property._2.get}'").mkString(",")
     
    +    val partition: Seq[String] = if (options.partitionColumns.isDefined) {
    +      if (options.partitionColumns.get.toSet.size != options.partitionColumns.get.length) {
    +        throw new MalformedCarbonCommandException(s"repeated partition column")
    +      }
    +      options.partitionColumns.get.map { column =>
    +        val field = schema.fields.find(_.name.equalsIgnoreCase(column))
    +        if (field.isEmpty) {
    +          throw new MalformedCarbonCommandException(s"invalid partition column: $column")
    +        }
    +        s"$column ${field.get.dataType.typeName}"
    +      }
    +    } else {
    +      Seq()
    +    }
    +
    +    val schemaWithoutPartition = if (options.partitionColumns.isDefined) {
    +      val fields = schema.filterNot(field => options.partitionColumns.get.contains(field.name))
    --- End diff --
   
    fixed


---

[qiuchenjian-2]

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/6200/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7826/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/6551/



---

[qiuchenjian-2]

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2415
 
    LGTM


---

[qiuchenjian-2]

Github user asfgit closed the pull request at:

    https://github.com/apache/carbondata/pull/2415


---