Re: [DISCUSSION] Support heterogeneous format segments in carbondata

Posted by chetdb on
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-heterogeneous-format-segments-in-carbondata-tp84252p84281.html

Hi Ravi,

1. What are the data formats that shall be supported to add segment. ?
2. Will the alter table be supported after loading multiple segments each having different data format.
3. If user wants to execute select query from certain segments only using set segments feature will he/she able to do so now after this feature implementation?
4. Will the index files be created for the segments created from external formats. If yes will the merge index feature be supported.?

Regards
Chetan

On 2019/09/10 14:41:22, Ravindra Pesala <[hidden email]> wrote:

> Hi All,
>
>  This discussion is regarding support of other formats in carbon. Already
> existing customers use other formats like parquet, orc etc., but if they
> want to migrate to carbon there is no proper solution at hand. So this
> feature allows all the old data to add as a segment to carbondata .  And
> during query, it reads old data in its respective format and all new
> segments will be read in carbon.
>
> I have created the design document and attached to the jira. Please review
> it.
> https://issues.apache.org/jira/browse/CARBONDATA-3516
>
>
> --
> Thanks & Regards,
> Ravindra
>