[jira] [Commented] (CARBONDATA-288) In hdfs bad record logger is failing in writting the bad records

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-288) In hdfs bad record logger is failing in writting the bad records

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574854#comment-15574854 ]

ASF GitHub Bot commented on CARBONDATA-288:
-------------------------------------------

Github user mohammadshahidkhan commented on a diff in the pull request:

    https://github.com/apache/incubator-carbondata/pull/218#discussion_r83391617
 
    --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/BadRecordslogger.java ---
    @@ -69,9 +68,13 @@
       private BufferedWriter bufferedCSVWriter;
       private DataOutputStream outCSVStream;
       /**
    -   *
    +   * bad record log file path
    +   */
    +  private String logFilePath;
    +  /**
    +   * csv file path
        */
    -  private CarbonFile logFile;
    +  private String csvFilePath;
    --- End diff --
   
    log file will contains bad record row with the detailed reason of the failure
    csv will have only the bad record row.


> In hdfs bad record logger is failing in writting the bad records
> ----------------------------------------------------------------
>
>                 Key: CARBONDATA-288
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-288
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 0.2.0-incubating
>            Reporter: Mohammad Shahid Khan
>            Assignee: Mohammad Shahid Khan
>            Priority: Minor
>             Fix For: 0.2.0-incubating
>
>
> For HDFS file system
> CarbonFile logFile = FileFactory.getCarbonFile(filePath, FileType.HDFS);
> if filePath does not exits then
> Calling CarbonFile.getPath() throws NullPointerException.
> Solution:
> If file does not exist then before accessing the file must be created first



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)