[GitHub] [carbondata] jackylk commented on a change in pull request #3436: [CARBONDATA-3548]Geospatial Support: Modified to create and load the table with a nonschema dimension sort column. And added InPolygon UDF

[GitBox]

jackylk commented on a change in pull request #3436: [CARBONDATA-3548]Geospatial Support: Modified to create and load the table with a nonschema dimension sort column. And added InPolygon UDF
URL: https://github.com/apache/carbondata/pull/3436#discussion_r349934104
 
 

 ##########
 File path: integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
 ##########
 @@ -322,6 +323,11 @@ private[sql] class CarbonLateDecodeStrategy extends SparkStrategy {
     // In case of more dictionary columns spark code gen needs generate lot of code and that slows
     // down the query, so we limit the direct fill in case of more dictionary columns.
     val hasMoreDictionaryCols = hasMoreDictionaryColumnsOnProjection(projectSet, table)
+
+    /* Spark cannot filter the rows from the pages in case of polygon query. So, we do the row
+    level filter at carbon and return the rows directly */
+    val hasInPolygonFilter = candidatePredicates.exists(exp => exp.isInstanceOf[ScalaUDF]
 
 Review comment:
   format the condition

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services