[jira] [Created] (CARBONDATA-3895) Filenotfound exception after global sort compaction

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3895) Filenotfound exception after global sort compaction

Akash R Nilugal (Jira)
Akash R Nilugal created CARBONDATA-3895:
-------------------------------------------

             Summary: Filenotfound exception after global sort compaction
                 Key: CARBONDATA-3895
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3895
             Project: CarbonData
          Issue Type: New Feature
            Reporter: Akash R Nilugal
            Assignee: Akash R Nilugal


Filenotfound exception after global sort compaction


execute this test present in PR

test("test global sort compaction, clean files, update delete") {
    sql("DROP TABLE IF EXISTS carbon_global_sort_update")
    sql(
      """
        | CREATE TABLE carbon_global_sort_update(id INT, name STRING, city STRING, age INT)
        | STORED AS carbondata TBLPROPERTIES('SORT_SCOPE'='GLOBAL_SORT', 'sort_columns' = 'name, city')
      """.stripMargin)
    sql(s"LOAD DATA LOCAL INPATH '$filePath' INTO TABLE carbon_global_sort_update")
    sql(s"LOAD DATA LOCAL INPATH '$filePath' INTO TABLE carbon_global_sort_update")
    sql("alter table carbon_global_sort_update compact 'major'")
    sql("clean files for table carbon_global_sort_update")
    assert(sql("select * from carbon_global_sort_update").count() == 24)
    val updatedRows = sql("update carbon_global_sort_update d set (id) = (id + 3) where d.name = 'd'").collect()
    assert(updatedRows.head.get(0) == 2)
    val deletedRows = sql("delete from carbon_global_sort_update d where d.id = 12").collect()
    assert(deletedRows.head.get(0) == 2)
    assert(sql("select * from carbon_global_sort_update").count() == 22)
  }



--
This message was sent by Atlassian Jira
(v8.3.4#803005)