Login  Register

Re: Implement delete and update feature in carbondata SDK.

Posted by akashrn5 on Jun 25, 2020; 2:06pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Implement-delete-and-update-feature-in-carbondata-SDK-tp96684p96799.html

+1
As Ravindra said, we should do it at outputFormat level, so that the same
implementation will be used to improve the simpler update performance in
the future.
So design should be like SDK will call update and delete of Outputformat to
do the operations.

Regards,
Akash

On Tue, Jun 23, 2020 at 5:17 PM Ravindra Pesala <[hidden email]>
wrote:

> +1
> But it should be part of CarbonOutputFormat, not just SDK.  we are planning
> to implement even for simpler updates from spark. SDK should call
> outputformat to update/delete the records.
> Please @[hidden email] <[hidden email]>  comment on it, we
> already had a discussion on it.
>
> Regards,
> Ravindra.
>
> On Tue, 23 Jun 2020 at 02:15, Karan-c980 <[hidden email]>
> wrote:
>
> > This feature will support the carbondata SDK to delete and update data
> from
> > carbondata files.
> >
> > Details of solution and implementation are mentioned in the document
> > attached to JIRA.
> > https://issues.apache.org/jira/browse/CARBONDATA-3865
> >
> > Thanks
> > Karanpreet Singh
> >
> >
> >
> > --
> > Sent from:
> > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
> >
>
>
> --
> Thanks & Regards,
> Ravi
>