[jira] [Commented] (CARBONDATA-3191) preaggregate datamap compact failed leads to tablestatus locked , and then load , main table compact, preagg table load all can not carry on

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-3191) preaggregate datamap compact failed leads to tablestatus locked , and then load , main table compact, preagg table load all can not carry on

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726643#comment-16726643 ]

ocean commented on CARBONDATA-3191:
-----------------------------------

in audit log, I found logs like "2018-12-21 15:38:50 AUDIT audit:93 - \{"time":"December 21, 2018 3:38:50 PM CST","username":"hadoop","opName":"INSERT INTO","opId":"3820231238767720","opStatus":"FAILED","opTime":"311 ms","table":"default.ae_event_carbon_one","extraInfo":{"Exception":"org.apache.spark.sql.catalyst.analysis.NoSuchTableException","Message":"Table or view 'ae_event_carbon_one_dmwithoffset' not found in database 'default';"}}"

> preaggregate datamap compact failed leads to tablestatus locked , and then load , main table compact, preagg table load all can not carry on
> ---------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CARBONDATA-3191
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3191
>             Project: CarbonData
>          Issue Type: Bug
>          Components: other
>    Affects Versions: 1.5.1
>            Reporter: ocean
>            Priority: Major
>         Attachments: image-2018-12-21-18-17-23-261.png
>
>
> steps:
>  # create 2 datamap, and one datamap is group by offset ,offset have about 20000000 distinct values, that datamap named DMwithoffset
>  # execute spark-streaming. datamap DMwithoffset compact failedĀ 
>  # !image-2018-12-21-18-17-23-261.png!
> 4. drop datamap DMwithoffset
> 5. found no main table load, main table compact, datamap preagg, datamap compact again.Only my bussiness job which have nothing to do with carbon is running
> I think maybe tablestatus is locked.
> 6. I think maybe datamap compact failed leads to table locked.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)