Re: Abstracting CarbonData's Index Interface

Posted by Qingqing Zhou on Oct 04, 2016; 5:14pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-Abstracting-CarbonData-s-Index-Interface-tp1587p1619.html

On Mon, Oct 3, 2016 at 9:14 PM, Jacky Li <[hidden email]> wrote:
> If data is append only, I think read and load of index is enough. I
> think you are right, we should have a clean Index API, currently I am
> thinking of read and load API only:

I am not super fan for external index at this stage. Comparing to
"database" style supporting of external index involving complex/high
performance transaction requirements, we can alleviate a bit. But still,
even for loading, basic transaction requirement like atomic is still
needed. For now, we can focus more on internal index interface, so carbon
kernel developers can introduce new index easier.

Regards,
Qingqing