Can we create pre-aggregation for non-carbon format tables?

Posted by 冉明轩 on Aug 06, 2018; 9:18am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Can-we-create-pre-aggregation-for-non-carbon-format-tables-tp59015.html

Hello guys,


Recently I came up with an idea: can we create pre-aggregation for non-carbon format tables?


For example, someone is suffering from disk space shortage or for some other reason he must use other file format other than carbondata.
In these cases he may also want quick query on some statistic queries like "count" and "sum".
If in these cases carbon can support him in the way of redirecting query to the pre-agg table just like what it is done for its own data, he can also enjoy the fast performance of carbon.


This kind of pre-agg can be triggered by a metadata update happened in hive so both managed-table and external-table can take benefit from it.


Ran