[jira] [Created] (CARBONDATA-3763) wrong insert result during insert stage command

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3763) wrong insert result during insert stage command

Akash R Nilugal (Jira)
Ajantha Bhat created CARBONDATA-3763:
----------------------------------------

             Summary: wrong insert result during insert stage command
                 Key: CARBONDATA-3763
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3763
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


problem:

For insertStageCommand, spark is reusing the internalRow as two times we transform from RDD[InternalRow] -> dataframe -> logical Plan -> RDD[InternalRow]. So, same data is inserted on other rows

 

solution: Copy the internalRow after the last transform.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)