Index file cache will not work when the table has invalid segment.

Posted by carbondata-newuser on Jul 11, 2018; 3:51am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Index-file-cache-will-not-work-when-the-table-has-invalid-segment-tp55379.html

Carbon version is 1.4 rc2.
create table(
col1 string,
col2 int,
col2 string,
date string
)

*First step:*
insert into table carbonTest select col1,col2,col3,"20180707" from
hiveTable2 where date="20180707";
The col3 is a hive map type, so this insert will be failed.
And it will create invalid segment. (I'm not sure it is because of this).
*second step:*
insert into carbonTest select col1,col2,"","20180707" from hiveTable2;

Then any query to this table will access the index files time and time
again.



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/