Re: About ColumnGroup feature
Posted by
ravipesala on
Jun 10, 2017; 3:54am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/About-ColumnGroup-feature-tp14436p14445.html
Hi,
+1 for A (removal of Column group feature.)
Column group is anyway was not tuned well and it needs lot of effort to get
the good performance. And it is also unused feature in community as far as
I know. It becomes bottle neck to add new features on carbon data. So it is
better to remove the unused features to keep the system clean.
Regards,
Ravindra.
On 10 June 2017 at 06:35, Jacky Li <
[hidden email]> wrote:
> Hi Community,
>
> In JIRA 1014, we are adding Unsafe ColumnPage in data load process to
> reduce GC, and adding EncodingStrategy for Encoding Overriding features to
> make open up encoding interface for both usability and extensibility.
>
> When implementing these new features, I found ColumnGroup feature creates
> unnecessary burden on data loading code and makes developer interfaces more
> complex to use. For example, since ColumnGroup can appear in any field in
> the table, even in SORT_COLUMNS, it forces developer to understand
> ColumnGroup concept and handle it in its encoding implementation.
>
> As far as I know, there is not much discussion on ColumnGroup in the mail
> list and I think it is high possibility that no one is using it. So I am
> proposing to remove this feature and it can enable carbon to make Encoding
> interface cleaner for developers.
>
> Please vote:
> A. Remove it
> B. Not remove it, and provide reason
>
>
> Thanks,
> Jacky Li
>
>
--
Thanks & Regards,
Ravi