[GitHub] carbondata pull request #2843: [CARBONDATA-3034] Carding parameters,Organize...

classic Classic list List threaded Threaded
18 messages Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2843: [CARBONDATA-3034] Carding parameters,Organize...

qiuchenjian-2
GitHub user ndwangsen opened a pull request:

    https://github.com/apache/carbondata/pull/2843

    [CARBONDATA-3034] Carding parameters,Organized by parameter category.

    This PR is mainly combing parameters, organized by parameter category.
   
    Be sure to do all of the following checklist to help us incorporate
    your contribution quickly and easily:
   
     - [ ] Any interfaces changed?
     NA
     - [ ] Any backward compatibility impacted?
     NA
     - [ ] Document update required?
    NA
     - [ ] Testing done
     Test in local env.
           
     - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
    NA


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/ndwangsen/incubator-carbondata parameter_comb

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/carbondata/pull/2843.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2843
   
----
commit 21dc71ba986ab1c2cbdd2cfaa5418a2d629bc34a
Author: ndwangsen <luffy.wang@...>
Date:   2018-10-23T03:35:17Z

    [CARBONDATA-3034] Carding parameters,Organized by parameter category.

----


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1151/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/945/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9209/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1167/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9225/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/960/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1172/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2843: [CARBONDATA-3034] Carding parameters,Organize...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user jackylk commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2843#discussion_r227624952
 
    --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java ---
    @@ -23,86 +23,26 @@
     import org.apache.carbondata.core.util.CarbonProperty;
     
     public final class CarbonCommonConstants {
    -  /**
    -   * surrogate value of null
    -   */
    -  public static final int DICT_VALUE_NULL = 1;
    -  /**
    -   * surrogate value of null for direct dictionary
    -   */
    -  public static final int DIRECT_DICT_VALUE_NULL = 1;
    -  /**
    -   * integer size in bytes
    -   */
    -  public static final int INT_SIZE_IN_BYTE = 4;
    -  /**
    -   * short size in bytes
    -   */
    -  public static final int SHORT_SIZE_IN_BYTE = 2;
    -  /**
    -   * DOUBLE size in bytes
    -   */
    -  public static final int DOUBLE_SIZE_IN_BYTE = 8;
    -  /**
    -   * LONG size in bytes
    -   */
    -  public static final int LONG_SIZE_IN_BYTE = 8;
    -  /**
    -   * byte to KB conversion factor
    -   */
    -  public static final int BYTE_TO_KB_CONVERSION_FACTOR = 1024;
    -  /**
    -   * BYTE_ENCODING
    -   */
    -  public static final String BYTE_ENCODING = "ISO-8859-1";
    -  /**
    -   * measure meta data file name
    -   */
    -  public static final String MEASURE_METADATA_FILE_NAME = "/msrMetaData_";
    -
    -  /**
    -   * set the segment ids to query from the table
    -   */
    -  public static final String CARBON_INPUT_SEGMENTS = "carbon.input.segments.";
    -
    -  /**
    -   * key prefix for set command. 'carbon.datamap.visible.dbName.tableName.dmName = false' means
    -   * that the query on 'dbName.table' will not use the datamap 'dmName'
    -   */
    -  @InterfaceStability.Unstable
    -  public static final String CARBON_DATAMAP_VISIBLE = "carbon.datamap.visible.";
    -
    -  /**
    -   * Fetch and validate the segments.
    -   * Used for aggregate table load as segment validation is not required.
    -   */
    -  public static final String VALIDATE_CARBON_INPUT_SEGMENTS = "validate.carbon.input.segments.";
     
    +  private CarbonCommonConstants() {
    +  }
       /**
    --- End diff --
   
    To make this description more easier to find, suggest to use:
    ```
     //////////////////////////////////////////////////////////////////////////////////////////
     // System level property start here
     //////////////////////////////////////////////////////////////////////////////////////////
     // System level property is the global property for CarbonData
     // application, these properties are stored in a singleton instance
     // so that all processing logic in CarbonData uses the same
     // property value
    ```
   
    And you can write the description for Table level property and others


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2843: [CARBONDATA-3034] Carding parameters,Organize...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user ndwangsen commented on a diff in the pull request:

    https://github.com/apache/carbondata/pull/2843#discussion_r227626868
 
    --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java ---
    @@ -23,86 +23,26 @@
     import org.apache.carbondata.core.util.CarbonProperty;
     
     public final class CarbonCommonConstants {
    -  /**
    -   * surrogate value of null
    -   */
    -  public static final int DICT_VALUE_NULL = 1;
    -  /**
    -   * surrogate value of null for direct dictionary
    -   */
    -  public static final int DIRECT_DICT_VALUE_NULL = 1;
    -  /**
    -   * integer size in bytes
    -   */
    -  public static final int INT_SIZE_IN_BYTE = 4;
    -  /**
    -   * short size in bytes
    -   */
    -  public static final int SHORT_SIZE_IN_BYTE = 2;
    -  /**
    -   * DOUBLE size in bytes
    -   */
    -  public static final int DOUBLE_SIZE_IN_BYTE = 8;
    -  /**
    -   * LONG size in bytes
    -   */
    -  public static final int LONG_SIZE_IN_BYTE = 8;
    -  /**
    -   * byte to KB conversion factor
    -   */
    -  public static final int BYTE_TO_KB_CONVERSION_FACTOR = 1024;
    -  /**
    -   * BYTE_ENCODING
    -   */
    -  public static final String BYTE_ENCODING = "ISO-8859-1";
    -  /**
    -   * measure meta data file name
    -   */
    -  public static final String MEASURE_METADATA_FILE_NAME = "/msrMetaData_";
    -
    -  /**
    -   * set the segment ids to query from the table
    -   */
    -  public static final String CARBON_INPUT_SEGMENTS = "carbon.input.segments.";
    -
    -  /**
    -   * key prefix for set command. 'carbon.datamap.visible.dbName.tableName.dmName = false' means
    -   * that the query on 'dbName.table' will not use the datamap 'dmName'
    -   */
    -  @InterfaceStability.Unstable
    -  public static final String CARBON_DATAMAP_VISIBLE = "carbon.datamap.visible.";
    -
    -  /**
    -   * Fetch and validate the segments.
    -   * Used for aggregate table load as segment validation is not required.
    -   */
    -  public static final String VALIDATE_CARBON_INPUT_SEGMENTS = "validate.carbon.input.segments.";
     
    +  private CarbonCommonConstants() {
    +  }
       /**
    --- End diff --
   
    ok,i modify it


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/986/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1199/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9252/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/987/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1200/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user CarbonDataQA commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9253/



---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata issue #2843: [CARBONDATA-3034] Carding parameters,Organized by pa...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user jackylk commented on the issue:

    https://github.com/apache/carbondata/pull/2843
 
    LGTM


---
Reply | Threaded
Open this post in threaded view
|

[GitHub] carbondata pull request #2843: [CARBONDATA-3034] Carding parameters,Organize...

qiuchenjian-2
In reply to this post by qiuchenjian-2
Github user asfgit closed the pull request at:

    https://github.com/apache/carbondata/pull/2843


---