[jira] [Created] (CARBONDATA-1175) Streaming Ingest: Write path data conversion/transformation

Posted by Akash R Nilugal (Jira) on Jun 14, 2017; 7:12pm
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/jira-Created-CARBONDATA-1175-Streaming-Ingest-Write-path-data-conversion-transformation-tp15074.html

Aniket Adnaik created CARBONDATA-1175:
-----------------------------------------

             Summary: Streaming Ingest: Write path data conversion/transformation
                 Key: CARBONDATA-1175
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1175
             Project: CarbonData
          Issue Type: Sub-task
    Affects Versions: 1.2.0
            Reporter: Aniket Adnaik
             Fix For: 1.2.0


Streaming Ingest: Write path Data conversion/Transformation
- input data is a byte stream in catalyst InternalRow format (row major), which needs to be converted to column format
- column converter and corresponding iterators needs to be created before invoking carbon layer load path
- various carbon properties needs to be set, for example SORT_SCOPE (to skip sorting), blocket size, skip global dictionary creation etc



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)