[jira] [Commented] (CARBONDATA-306) block size info should be show in Desc Formatted and executor log

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-306) block size info should be show in Desc Formatted and executor log

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574086#comment-15574086 ]

ASF GitHub Bot commented on CARBONDATA-306:
-------------------------------------------

Github user Jay357089 commented on a diff in the pull request:

    https://github.com/apache/incubator-carbondata/pull/230#discussion_r83354112
 
    --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java ---
    @@ -252,6 +252,15 @@ private static long getMaxOfBlockAndFileSize(long blockSize, long fileSize) {
         if (remainder > 0) {
           maxSize = maxSize + HDFS_CHECKSUM_LENGTH - remainder;
         }
    +    long setBlockSizeInMb = blockSize / CarbonCommonConstants.BYTE_TO_KB_CONVERSION_FACTOR /
    +            CarbonCommonConstants.BYTE_TO_KB_CONVERSION_FACTOR;
    +    // actual file size may be less than 1KB or 1MB, need to classify.
    +    String readableFileSize = ByteUtil.convertByteToReadable(fileSize);
    +    long maxSizeInMb = maxSize / CarbonCommonConstants.BYTE_TO_KB_CONVERSION_FACTOR /
    +            CarbonCommonConstants.BYTE_TO_KB_CONVERSION_FACTOR;
    +    LOGGER.info("The configured block size is " + setBlockSizeInMb + " MB, " +
    --- End diff --
   
    done. CI passed. http://136.243.101.176:8080/job/ApacheCarbonManualPRBuilder/427/


> block size info should be show in Desc Formatted and executor log
> -----------------------------------------------------------------
>
>                 Key: CARBONDATA-306
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-306
>             Project: CarbonData
>          Issue Type: Improvement
>            Reporter: Jay
>            Priority: Minor
>
> when run desc formatted command, the table block size should be show, as well as in executor log when run load command



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)