Login  Register

[GitHub] [carbondata] vikramahuja1001 commented on a change in pull request #4072: [CARBONDATA-4110] Support clean files dry run operation and show statistics after clean files operation

Posted by GitBox on Feb 19, 2021; 7:53am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/GitHub-carbondata-vikramahuja1001-opened-a-new-pull-request-4072-WIP-Clean-files-phase2-tp105322p106356.html


vikramahuja1001 commented on a change in pull request #4072:
URL: https://github.com/apache/carbondata/pull/4072#discussion_r578990010



##########
File path: core/src/main/java/org/apache/carbondata/core/util/CleanFilesUtil.java
##########
@@ -71,14 +71,19 @@ public static void cleanStaleSegments(CarbonTable carbonTable)
             // Deleting the stale Segment folders and the segment file.
             try {
               CarbonUtil.deleteFoldersAndFiles(segmentPath);
+              LOGGER.info("Deleted the segment folder :" + segmentPath.getAbsolutePath() + " after"
+                  + " moving it to the trash folder");
               // delete the segment file as well
               FileFactory.deleteFile(CarbonTablePath.getSegmentFilePath(carbonTable.getTablePath(),
                   staleSegmentFile));
+              LOGGER.info("Deleted stale segment file after moving it to the trash folder :"
+                  + staleSegmentFile);

Review comment:
       done, actually the segment file will not be moved to trash, it will just be delete straightaway, Handled the same

##########
File path: core/src/main/java/org/apache/carbondata/core/util/CleanFilesUtil.java
##########
@@ -71,14 +71,19 @@ public static void cleanStaleSegments(CarbonTable carbonTable)
             // Deleting the stale Segment folders and the segment file.
             try {
               CarbonUtil.deleteFoldersAndFiles(segmentPath);
+              LOGGER.info("Deleted the segment folder :" + segmentPath.getAbsolutePath() + " after"
+                  + " moving it to the trash folder");
               // delete the segment file as well
               FileFactory.deleteFile(CarbonTablePath.getSegmentFilePath(carbonTable.getTablePath(),
                   staleSegmentFile));
+              LOGGER.info("Deleted stale segment file after moving it to the trash folder :"
+                  + staleSegmentFile);
               for (String duplicateStaleSegmentFile : redundantSegmentFile) {
                 if (DataFileUtil.getSegmentNoFromSegmentFile(duplicateStaleSegmentFile)
                     .equals(segmentNumber)) {
                   FileFactory.deleteFile(CarbonTablePath.getSegmentFilePath(carbonTable
                       .getTablePath(), duplicateStaleSegmentFile));
+                  LOGGER.info("Deleted redundant segment file :" + duplicateStaleSegmentFile);

Review comment:
       done




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]