Re: [DISCUSS] Support transactional table in SDK

Posted by ravipesala on Dec 07, 2018; 3:05pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSS-Support-transactional-table-in-SDK-tp69878p69915.html

Hi Jacky,

Its a good idea to support writing transactional table from SDK. But we need
to add following limitations as well
 1. It can work on file systems which can take append lock like HDFS.
 2. Compaction, delete segment cannot be done on online segments till it is
converted to the transactional segment.
 3. SDK writer should be responsible to add complete carbondata file to
online segment once the writing is done, it should not add any half cooked
data.
 
And also as we are trying to updating the tablestatus from other modules
like SDK , we better consider the segment interface first. Please go through
the jira
https://issues.apache.org/jira/projects/CARBONDATA/issues/CARBONDATA-2827


Regards,
Ravindra





--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/