Login  Register

[DISCUSSION] Presto+Carbon transactional and Non-transactional Write Support

Posted by akashnilugal@gmail.com on Jul 14, 2020; 12:37pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Presto-Carbon-transactional-and-Non-transactional-Write-Support-tp97423.html

Hi Community,

As we know the CarbonDataisan indexed columnar data format for fast
analytics on big data platforms. So
we have already integrated with the query engines like spark and even
presto. Currently with presto we
only support the querying of carbon data files. But we don’t yet support
the writing of carbon data files
through presto engine.

Currentlypresto is integrated with carbondata for reading the carbondata
files via presto.
For this, we should be having the store already ready which may be written
carbon in spark and the table
should be hive metastore. So using carbondata connector we are able to read
the carbondata files. But we
cannot create a table or load the data to the table in presto. So it will
somewhat hectic job to read the
carbon files, by writing first with other engines.

So here I will be trying to support the transactional load support in
presto integration for carbon.

I have attached the design document in the Jira, please refer and any
suggestions or input is most welcome.

https://issues.apache.org/jira/browse/CARBONDATA-3831


Regards,
Akash R.