[jira] [Commented] (CARBONDATA-1572) Support Streaming Ingest

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (CARBONDATA-1572) Support Streaming Ingest

Akash R Nilugal (Jira)

    [ https://issues.apache.org/jira/browse/CARBONDATA-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16205057#comment-16205057 ]

xuchuanyin commented on CARBONDATA-1572:
----------------------------------------

[~QiangCai]
I have two questions about the design:

1.Handoff process will convert rows in Streaming-Segment into Batch-Segment ,does it means the records will be deleted from the Streaming-segment and inserted into the batch-segment? So what will happen when a long query is running and the handoff process is done, i.e., Query deleted records from streaming segment and ignore inserted records from batch segment.

2. Will we implement the streaming-segment like HBase, or just put the segment on HDFS? I perfer the first.

> Support Streaming Ingest
> ------------------------
>
>                 Key: CARBONDATA-1572
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1572
>             Project: CarbonData
>          Issue Type: New Feature
>            Reporter: QiangCai
>         Attachments: CarbonData Streaming Ingest.pdf
>
>
> CarbonData should support streaming ingest.
> [^CarbonData Streaming Ingest.pdf]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)