[jira] [Commented] (CARBONDATA-4205) MINOR compaction getting triggered by it self while inserting data to a table

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-4205) MINOR compaction getting triggered by it self while inserting data to a table

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17365535#comment-17365535 ]

SHREELEKHYA GAMPA commented on CARBONDATA-4205:
-----------------------------------------------

Hi, can you share the carbon configuration set?

Pls check for carbon.enable.auto.load.merge and carbon.compaction.level.threshold properties. When carbon.enable.auto.load.merge is set to true, compaction will be automatically triggered once data load completes.

 

> MINOR compaction getting triggered by it self while inserting data to a table
> -----------------------------------------------------------------------------
>
>                 Key: CARBONDATA-4205
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4205
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 2.0.1
>         Environment: apache carbondata 2.0.1, hadoop 2.7.2, spark 2.4.5
>            Reporter: suyash yadav
>            Priority: Major
>
> Hi Team we have created a table and also created a timeseries MV on it. Later we tried to insert a some data from other table to this newly created table but we have observed that while inserting ...MINOR compaction on the MV is getting triggered by it self. It doesn't happen for all the insert but whnever we insert 6 to 7th hour data and then 14 to 15 hour data....the MINOR compaction gets triggered. Could you tell us why the MINOR compaction is getting triggered by it self.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)