Cause of Compaction?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Cause of Compaction?

孙而焓
hello,

My application has running for a long time,constantly update and insert table.

I got an strange exception  like following:

ERROR command.ProjectForUpdateCommand$: main Update operation passed. Exception in Horizontal Compaction. Please check logs.org.apache.spark.sql.execution.command.HorizontalCompactionException: Horizontal Update Compaction Failed for [e_carbon.prod_inst_his_c]. Compaction failed. Please check logs for more info. Exception in compaction java.lang.Exception      : Compaction Failure in Merger Rdd.

Can anyone explain what may cuase this exception?



[hidden email]
孙而焓【FFCS研究院】
Reply | Threaded
Open this post in threaded view
|

Re: Cause of Compaction?

rahul_kumar
Hi Sunerhan,

Can you give some more information like :

1. Your table schema
2. Your Update query.
3. And some more logs.

          Thanks and Regards

*   Rahul Kumar     *



On Mon, Oct 9, 2017 at 3:35 PM, [hidden email] <[hidden email]
> wrote:

> hello,
>
> My application has running for a long time,constantly update and insert
> table.
>
> I got an strange exception  like following:
>
> ERROR command.ProjectForUpdateCommand$: main Update operation passed.
> Exception in Horizontal Compaction. Please check logs.org.apache.spark.sql.
> execution.command.HorizontalCompactionException: Horizontal Update
> Compaction Failed for [e_carbon.prod_inst_his_c]. Compaction failed. Please
> check logs for more info. Exception in compaction java.lang.Exception
> : Compaction Failure in Merger Rdd.
>
> Can anyone explain what may cuase this exception?
>
>
>
> [hidden email]
>