[DISCUSSION]implement delta encoding for numeric type column in SORT_COLUMNS

Posted by David CaiQiang on
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-implement-delta-encoding-for-numeric-type-column-in-SORT-COLUMNS-tp10124.html

Hi all,

    Now we plan to implement delta encoding for the numeric type column in SORT_COLUMNS.
   
    1. use delta encoding to encode the numeric type data

    2. write present metadata to the page header, to record the null value.

    3. improve the compression on no-dictionary string column.
        use RLE to compress the array of the lengths in LV encoding.

    Any thoughts, comments and questions ?

Best Regards
David QiangCai