[
https://issues.apache.org/jira/browse/CARBONDATA-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15555705#comment-15555705 ]
ASF GitHub Bot commented on CARBONDATA-2:
-----------------------------------------
GitHub user ravipesala opened a pull request:
https://github.com/apache/incubator-carbondata/pull/215 [WIP][CARBONDATA-2] Remove kettle from carbodata
New flow is added in processing module to load data with out kettle. New code is added to the package `org.apache.carbondata.processing.newflow` , old code (kettle framework) will be removed once all performance comparisons are met.
This is work in progress PR and not in working condition. All interfaces and related code is added but need to be tested.
Main interfaces for loading the data.
`org.apache.carbondata.processing.newflow.DataLoadProcessorStep`
`org.apache.carbondata.processing.newflow.dictionarygenerator.ColumnDictionaryGenerator`
`org.apache.carbondata.processing.newflow.encoding.RowEncoder`
`org.apache.carbondata.processing.newflow.parser.GenericParser`
You can merge this pull request into a Git repository by running:
$ git pull
https://github.com/ravipesala/incubator-carbondata remove-kettle
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-carbondata/pull/215.patchTo close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #215
----
commit 376933cefe5f2f241af460829373d7e9b381322d
Author: ravipesala <
[hidden email]>
Date: 2016-06-05T17:08:22Z
WIP interfaces created
commit abc6f489cfb84e5697adff3494b34873dc70a434
Author: ravipesala <
[hidden email]>
Date: 2016-09-08T19:14:39Z
Added interfaces for data loading
commit 0922915035b1c016f1b82556025d34846ee598c4
Author: ravipesala <
[hidden email]>
Date: 2016-09-20T10:28:54Z
[WIP]Added interfaces for data loading
commit 1f1500adbb7097bc69eaa2238da0939933c298b3
Author: ravipesala <
[hidden email]>
Date: 2016-10-04T14:34:58Z
Updated package and added sort step
commit 5625bf9433488d5acd4b37e30dbc8751dc8a0e1e
Author: ravipesala <
[hidden email]>
Date: 2016-10-07T09:04:28Z
Added writer step
commit 99fd9f7f117b8221a0fced62678da35239a7d2a0
Author: ravipesala <
[hidden email]>
Date: 2016-10-07T17:14:23Z
Added comments
----
> Remove kettle for loading data
> ------------------------------
>
> Key: CARBONDATA-2
> URL:
https://issues.apache.org/jira/browse/CARBONDATA-2> Project: CarbonData
> Issue Type: Improvement
> Reporter: ChenLiang
> Priority: Critical
> Fix For: 0.2.0-incubating
>
>
> Remove kettle for loading data module
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Locked
