Login  Register

[GitHub] [carbondata] ShreelekhyaG opened a new pull request #4064: [CARBONDATA-4096] SDK read fails from cluster and sdk read filter query on sort column giving wrong result with IndexServer

Posted by GitBox on Dec 22, 2020; 1:47pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/GitHub-carbondata-ShreelekhyaG-opened-a-new-pull-request-4064-CARBONDATA-4096-SDK-read-fails-from-clr-tp105041.html


ShreelekhyaG opened a new pull request #4064:
URL: https://github.com/apache/carbondata/pull/4064


    ### Why is this PR needed?
    1) Create a table and read from sdk written files fails in cluster with `java.nio.file.NoSuchFileException: hdfs:/hacluster/user/hive/warehouse/carbon.store/default/sdk`.
   2) After fixing the above path issue, filter query on sort column gives the wrong result with IndexServer.
   
    ### What changes were proposed in this PR?
   1) In `getAllDeleteDeltaFiles` , used CarbonFiles.listFiles instead of Files.walk to handle custom file types.
   2) In PruneWithFilter ,  `isResolvedOnSegment`  is used in filterResolver step. Have set table and expression on executor side, so indexserver can use this in filterResolver step.
       
    ### Does this PR introduce any user interface change?
    - No
   
    ### Is any new testcase added?
    - No, verified in the cluster.
   
       
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]