ravipesala commented on a change in pull request #3177: [CARBONDATA-3337][CARBONDATA-3306] Distributed index server
URL:
https://github.com/apache/carbondata/pull/3177#discussion_r279667598
##########
File path: integration/spark2/src/main/scala/org/apache/carbondata/indexserver/DistributedPruneRDD.scala
##########
@@ -94,12 +90,13 @@ class DataMapPruneRDD(
!finished
}
- override def next(): ExtendedBlocklet = {
+ override def next(): (String, ExtendedBlocklet) = {
if (!hasNext) {
throw new java.util.NoSuchElementException("End of stream")
}
havePair = false
- val value = reader.getCurrentValue
+ val executorIP = SparkEnv.get.blockManager.blockManagerId.host
+ val value = (executorIP + "_" + cacheSize.toString, reader.getCurrentValue)
Review comment:
please make sure that you do lastindexof while retrieving the ip and size
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[hidden email]
With regards,
Apache Git Services