CarbonStore Java & REST API proposal

Posted by Jacky Li on Jul 04, 2018; 11:13am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/CarbonStore-Java-REST-API-proposal-tp54196.html


 

Motivation

Currently, CarbonData is mainly used through integration with big data compute framework like Spark, Presto, etc. This is useful for complex data analytics workflow like using SQL or Spark’s DataFrame/DataSet API. However, there are also other simpler analytic scenarios that can leverage CarbonData, like filtering a single table, or just scanning a given folder contains carbondata files.

 

We believe application performance can benefit from CarbonData’s acceleration technique like Indexing and Materialized View. To enable such scenario, we would like to provide CarbonStore Java API so that any Java application can use it in its process. And we would also like to provide REST API for application that prefer microservice architecture.



Since google doc is not available for some of us. I have put the full proposal in JIRA CARBONDATA-2688 (https://issues.apache.org/jira/browse/CARBONDATA-2688)

Please feel free to provide feedback. Any feedback is welcomed.


Regards,
Jacky