[Discussion]: option to disable multi-layered index scan and use full table scan
Posted by Aniket Adnaik on Sep 27, 2016; 10:49pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/Discussion-option-to-disable-multi-layered-index-scan-and-use-full-table-scan-tp1526.html
Carbondata can provide some way to disable usage of multi-layered index and provide full table scan.
This may help in following cases;
1. Small tables occupying only few number of blocks are probably better of using full table scan.
2. Queries with large number of projections with no filter may benefit from using full table scan.
3. Testing different scenarios and comparing with multiple HDFS file formats that do not provide multi layer index will be easier.
Also, Carbondata scan internally should be smart enough to detect this based on query, data size, etc.
Any comments?