[GitHub] [carbondata] kevinjmh opened a new pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] kevinjmh opened a new pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

GitBox

kevinjmh opened a new pull request #3845:
URL: https://github.com/apache/carbondata/pull/3845


    ### Why is this PR needed?
   PR  #3804 free the row page after running in-memory intermeidate merge, but the data will still be used in final sort because that merge only acquire the memory address and row page index instead of moving the rows from here to there.
   
    ### What changes were proposed in this PR?
   Remove code for freeing the row page in case of in-memory intermeidate merge.
   As a special case, add comment for explanation.
       
    ### Does this PR introduce any user interface change?
    - No
    - Yes. (please explain the change and update document)
   
    ### Is any new testcase added?
    - No
    - Yes
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

GitBox

CarbonDataQA1 commented on pull request #3845:
URL: https://github.com/apache/carbondata/pull/3845#issuecomment-658737476


   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1655/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA1 commented on pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

GitBox
In reply to this post by GitBox

CarbonDataQA1 commented on pull request #3845:
URL: https://github.com/apache/carbondata/pull/3845#issuecomment-658737910


   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/3397/
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] QiangCai commented on pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

GitBox
In reply to this post by GitBox

QiangCai commented on pull request #3845:
URL: https://github.com/apache/carbondata/pull/3845#issuecomment-661609054


   LGTM


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] asfgit closed pull request #3845: [CARBONDATA-3871][FOLLOW-UP] Fix memory issue when get data from row page

GitBox
In reply to this post by GitBox

asfgit closed pull request #3845:
URL: https://github.com/apache/carbondata/pull/3845


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]