Re: S3 support

Posted by kunalkapoor on Jun 25, 2018; 5:01am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/S3-support-tp52541p53023.html

Hi David,
Thanks for the suggestions.

1. Memory lock cannot support multiple drivers. Documentation will be
updated with this limitation.
2. I agree that in case of failure reverting the changes is necessary. Will
take care of this point.
3. You are right refresh using table name would not work. I think we can
introduce refresh using path for this scenario.

Thanks
Kunal Kapoor

On Fri, Jun 22, 2018 at 12:08 PM David CaiQiang <[hidden email]>
wrote:

> Hi Kunal,
>  I have some questions.
>
> *Problem(Locking):*
>   Does the memory lock support that the multiple drivers concurrently load
> data to the same table? maybe it should note this limitation.
>
> *Problem(Write with append mode):*
>   1. atomicity
>   After the overwrite operation failed, maybe the old file is destroyed. It
> should be able to recover the old file.
>
> *Problem(Alter rename):*
>     If the table folder is different with the table name, maybe "refresh
> table" command should be enhanced.
>
>
>
> -----
> Best Regards
> David Cai
> --
> Sent from:
> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
>