[GitHub] [carbondata] kunal642 commented on a change in pull request #3208: [CARBONDATA-3337]Display orignal query in Indexserver Job

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] kunal642 commented on a change in pull request #3208: [CARBONDATA-3337]Display orignal query in Indexserver Job

GitBox
kunal642 commented on a change in pull request #3208: [CARBONDATA-3337]Display orignal query in Indexserver Job
URL: https://github.com/apache/carbondata/pull/3208#discussion_r281975102
 
 

 ##########
 File path: integration/spark2/src/main/scala/org/apache/carbondata/indexserver/DataMapJobs.scala
 ##########
 @@ -42,7 +43,18 @@ class DistributedDataMapJob extends AbstractDataMapJob {
       LOGGER.debug(s"Size of message sent to Index Server: $messageSize")
     }
     val (resonse, time) = logTime {
-      IndexServer.getClient.getSplits(dataMapFormat).toList.asJava
+      val spark = SparkSQLUtil.getSparkSession
+      var taskGroupId = spark.sparkContext.getLocalProperty("spark.jobGroup.id")
+      var taskGroupDesc = spark.sparkContext.getLocalProperty("spark.job.description")
+      taskGroupId = taskGroupId match {
 
 Review comment:
   change to
   
   val taskGroupDesc = spark.sparkContext.getLocalProperty("spark.job.description") match ...
   
   same for taskGroupId

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[hidden email]


With regards,
Apache Git Services