[ https://issues.apache.org/jira/browse/CARBONDATA-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15991993#comment-15991993 ] xuzhiliang edited comment on CARBONDATA-999 at 5/3/17 12:45 AM: ---------------------------------------------------------------- hello Bhavya Aggarwal,which version do you use,i also try spark-1.6.2 1.1.0 rc2,but the bucketing still not working。 drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0 drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0 -rw-r--r-- 3 root supergroup 566 2017-05-02 09:58 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493690331936.carbonindex -rw-r--r-- 3 root supergroup 891 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493690331936.carbondata drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Metadata was (Author: xuzhiliang2013): hello Bhavya Aggarwal,which version do you use,i also try spark-1.6.2 rc2,but the bucketing still not working。 drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0 drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0 -rw-r--r-- 3 root supergroup 566 2017-05-02 09:58 /Opt/CarbonStore/default/kd_shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493690331936.carbonindex -rw-r--r-- 3 root supergroup 891 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493690331936.carbondata drwxr-xr-x - root supergroup 0 2017-05-02 09:58 /Opt/CarbonStore/default/shop_test/Metadata > use carbondata bulket feature,but it doesn't seem to work? > ---------------------------------------------------------- > > Key: CARBONDATA-999 > URL: https://issues.apache.org/jira/browse/CARBONDATA-999 > Project: CarbonData > Issue Type: Bug > Components: data-load > Affects Versions: 1.1.0 > Environment: spark 1.6.2,carbondata 1.1.0 rc1 > Reporter: xuzhiliang > Time Spent: 20m > Remaining Estimate: 0h > > 1.CREATE TABLE shop_test(platFormId int,sellerNick string,companyGuid STRING,companyName STRING) STORED BY 'carbondata' TBLPROPERTIES ('BUCKETNUMBER'='2','BUCKETCOLUMNS'='sellerNick') > 2. .when loading data > the sorter is type of ParallelReadMergeSorterImpl,not ParallelReadMergeSorterWithBucketingImpl,why configuration.getBucketingInfo is null?What is wrong with that? Can you fix it? > 3.hadoop dfs -lsr /Opt/CarbonStore/default/shop_test > drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/shop_test/Fact > drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/shop_test/Fact/Part0 > drwxr-xr-x - root supergroup 0 2017-04-27 15:37 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0 > -rw-r--r-- 3 root supergroup 566 2017-04-27 15:37 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0/0_batchno0-0-1493278648826.carbonindex > -rw-r--r-- 3 root supergroup 891 2017-04-27 15:37 /Opt/CarbonStore/default/shop_test/Fact/Part0/Segment_0/part-0-0_batchno0-0-1493278648826.carbondata -- This message was sent by Atlassian JIRA (v6.3.15#6346) |
Free forum by Nabble | Edit this page |