[jira] [Created] (CARBONDATA-3877) Reduce read tablestatus overhead during inserting into partition table

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3877) Reduce read tablestatus overhead during inserting into partition table

Akash R Nilugal (Jira)
Xingjun Hao created CARBONDATA-3877:
---------------------------------------

             Summary: Reduce read tablestatus overhead during inserting into partition table
                 Key: CARBONDATA-3877
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3877
             Project: CarbonData
          Issue Type: Improvement
          Components: spark-integration
    Affects Versions: 2.0.0
            Reporter: Xingjun Hao
             Fix For: 2.0.2


Currently during inserting into a partition table, there are a lot of tablestauts read operations, but when storing table status file in object store, reading of table status file may fail (receive IOException or JsonSyntaxException) when table status file is being modifying, which leading to High failure rate when concurrent insert into a partition table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)