Re: [DISCUSSION] Support heterogeneous format segments in carbondata

Posted by on
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-heterogeneous-format-segments-in-carbondata-tp84252p84936.html

Hi

+1
One question is , is add segment and load data to main table supported? If yes, how the segment locking thing is handled? as we are going to add an entry inside table status with a segment id for added segment.

Regards,
Akash

On 2019/09/10 14:41:22, Ravindra Pesala <[hidden email]> wrote:

> Hi All,
>
>  This discussion is regarding support of other formats in carbon. Already
> existing customers use other formats like parquet, orc etc., but if they
> want to migrate to carbon there is no proper solution at hand. So this
> feature allows all the old data to add as a segment to carbondata .  And
> during query, it reads old data in its respective format and all new
> segments will be read in carbon.
>
> I have created the design document and attached to the jira. Please review
> it.
> https://issues.apache.org/jira/browse/CARBONDATA-3516
>
>
> --
> Thanks & Regards,
> Ravindra
>