[GitHub] [carbondata] kunal642 opened a new pull request #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD

[GitBox]

kunal642 opened a new pull request #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712
 
 
    ### Why is this PR needed?
    SI queries are degraded because getPrefferedLocation is
   not overridden in SegmentPruneRDD due to which tasks are fired randomly to any executors
   
    ### What changes were proposed in this PR?
   override getPrefferedLocation so that tasks are fired to correct executors.
       
    ### Does this PR introduce any user interface change?
    - No
    - Yes. (please explain the change and update document)
   
    ### Is any new testcase added?
    - No
    - Yes
   
       
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services

[GitBox]

CarbonDataQA1 commented on issue #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712#issuecomment-614486383
 
 
   Build Success with Spark 2.3.4, Please check CI http://121.244.95.60:12545/job/ApacheCarbonPRBuilder2.3/2750/
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services

[GitBox]

CarbonDataQA1 commented on issue #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712#issuecomment-614502006
 
 
   Build Success with Spark 2.4.5, Please check CI http://121.244.95.60:12545/job/ApacheCarbon_PR_Builder_2.4.5/1037/
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services

[GitBox]

VenuReddy2103 commented on issue #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712#issuecomment-614506874
 
 
   LGTM

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services

[GitBox]

jackylk commented on issue #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712#issuecomment-615539733
 
 
   LGTM

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services

[GitBox]

asfgit closed pull request #3712: [HOTFIX] Fixed task distribution issue in SegmentPruneRDD
URL: https://github.com/apache/carbondata/pull/3712
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services