[jira] [Closed] (CARBONDATA-3877) Reduce read tablestatus overhead during inserting into partition table

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Closed] (CARBONDATA-3877) Reduce read tablestatus overhead during inserting into partition table

Akash R Nilugal (Jira)

     [ https://issues.apache.org/jira/browse/CARBONDATA-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xingjun Hao closed CARBONDATA-3877.
-----------------------------------
    Resolution: Fixed

> Reduce read tablestatus overhead during inserting into partition table
> ----------------------------------------------------------------------
>
>                 Key: CARBONDATA-3877
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3877
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: spark-integration
>    Affects Versions: 2.0.0
>            Reporter: Xingjun Hao
>            Priority: Major
>             Fix For: 2.0.2
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> Currently during inserting into a partition table, there are a lot of tablestauts read operations, but when storing table status file in object store, reading of table status file may fail (receive IOException or JsonSyntaxException) when table status file is being modifying, which leading to High failure rate when concurrent insert into a partition table.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)