[GitHub] carbondata pull request #2161: Adding Alluxio Supporty

[qiuchenjian-2]

GitHub user chandrasaripaka opened a pull request:

    https://github.com/apache/carbondata/pull/2161

    Adding Alluxio Supporty

    Be sure to do all of the following checklist to help us incorporate
    your contribution quickly and easily:
   
     - [No ] Any interfaces changed?
     
     - [No ] Any backward compatibility impacted?
     
     - [Yes ] Document update required?
   
     - [Partially ] Testing done
            Please provide details on
            - Whether new unit test cases have been added or why no new tests are required?
                 It is the support for alluxio that has been fixed.
            - How it is tested? Please attach test report.
                It is tested with external alluxio.
            - Is it a performance related change? Please attach the performance test report.
            - Any additional information to help reviewers in testing this change.
                Added Alluxio Support , as it is not reflecting the correct FileSystem.
           
     - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
   


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/DataHeaps/carbondata alluxio-support

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/carbondata/pull/2161.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2161
   
----
commit 35ce7550954fbc8d9211352b79876c1ee148b609
Author: pour <chandrasekhar.saripaka@...>
Date:   2018-03-22T08:00:38Z

    Adding Alluxio Supporty

----


---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Can one of the admins verify this patch?


---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Can one of the admins verify this patch?


---

[qiuchenjian-2]

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Can one of the admins verify this patch?


---

[qiuchenjian-2]

Github user chenliang613 commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    add to whitelist


---

[qiuchenjian-2]

Github user chenliang613 commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    @chandrasaripaka   Can you provide more detail about this pull request.


---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Build Failed  with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/4953/



---

[qiuchenjian-2]

Github user ravipesala commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/4410/



---

[qiuchenjian-2]

Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Please add jira number in title


---

[qiuchenjian-2]

Github user chandrasaripaka commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    @chenliang613 This PR is for supporting the Alluxio as a File System for supporting the CarbonFileFormat. Though there was a AlluxioCarbonFile in the past, this was failing with Alluxio. Since Alluxio does not inherit DistributedFileSystem, it has to be a HadoopFileSystem that will be the change, as technically it does not support the appends on the File. Also, adopting to a AlluxioLock, however one can also use the ZookeeperLock, and also navigate.


---

[qiuchenjian-2]

Github user chandrasaripaka commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    @xubo245 CARBONDATA-2218 , which is the jira I raised before.


---

[qiuchenjian-2]

Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    ok, please change it like that: "[CARBONDATA-2303] clean files issue resolved for partition folder"


---

[qiuchenjian-2]

Github user chandrasaripaka commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    @CarbonDataQA May I know if this has to be fixed from my side..as a part of the pull request, Kindly advise. @xubo245 Also, I dont have access to resolve the conflicts and recommit. Please advise.


---

[qiuchenjian-2]

Github user xubo245 commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    refresh your local code:
        git fetch --all
    rebase to latest master branch code:
         git rebase -i origin/master
    fix the conflict and push again


---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3817/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Build Failed  with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/5033/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/3837/



---

[qiuchenjian-2]

Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    Build Failed  with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/5058/



---

[qiuchenjian-2]

Github user chandrasaripaka commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    @CarbonDataQA FileNotFoundException means that the credentials Jenkins is using is probably wrong. Or the user account does not have write access to the repo. org.kohsuke.github.GHFileNotFoundException: {"message":"Not Found","documentation_url":"https://developer.github.com/v3/repos/statuses/#create-a-status"} at


---

[qiuchenjian-2]

Github user chandrasaripaka commented on the issue:

    https://github.com/apache/carbondata/pull/2161
 
    I guess the build passed, but at the time of locating the jar , it failed. Can somebody look into the issue with Spark2.1.0 CI build.


---