[jira] [Commented] (CARBONDATA-296) 1.Add CSVInputFormat to read csv files.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-296) 1.Add CSVInputFormat to read csv files.

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571101#comment-15571101 ]

ASF GitHub Bot commented on CARBONDATA-296:
-------------------------------------------

GitHub user QiangCai opened a pull request:

    https://github.com/apache/incubator-carbondata/pull/233

    [CARBONDATA-296]1.Add CSVInputFormat to read csv files.

    **1 Add CSVInputFormat to read csv files**
    MRv1:
    hadoop/src/main/java/org/apache/carbondata/hadoop/mapred/CSVInputFormat.java
    MRv2:
    hadoop/src/main/java/org/apache/carbondata/hadoop/mapreduce/CSVInputFormat.java
   
    **2 Use univocity parser to parse csv files.**
   
    **3 Customize StringArrayWritable to wrap String array values of each line in csv files.**
   
    **4 Add BoundedInputStream to limit input stream**

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/QiangCai/incubator-carbondata dataloadinginput

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-carbondata/pull/233.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #233
   
----
commit cfb177bbca12cbe72a5947d7fdec1bc906d8aa7e
Author: QiangCai <[hidden email]>
Date:   2016-10-12T09:53:05Z

    csvinputformat

----


> 1.Add CSVInputFormat to read csv files.
> ---------------------------------------
>
>                 Key: CARBONDATA-296
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-296
>             Project: CarbonData
>          Issue Type: Sub-task
>            Reporter: Ravindra Pesala
>            Assignee: QiangCai
>             Fix For: 0.2.0-incubating
>
>
> Add CSVInputFormat to read csv files, it should use Univocity parser to read csv files to get optimal performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)