[jira] [Created] (CARBONDATA-1030) Support reading specified segment or carbondata file

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-1030) Support reading specified segment or carbondata file

Akash R Nilugal (Jira)
Jin Zhou created CARBONDATA-1030:
------------------------------------

             Summary: Support reading specified segment or carbondata file
                 Key: CARBONDATA-1030
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1030
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Jin Zhou
            Priority: Minor


We can query whole table in SQL way currently, but reading specified segments or data files is useful in some scenarios such as incremental data processing.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1030) Support reading specified segment or carbondata file

Liang Chen
Administrator
This post was updated on .
Hi

+1 for this feature.
How about the SQL script as below :
carbon.sql("select * from carbontable in segmentid(0,3,5,7) where filter
conditions").show()

Regards
Liang
Reply | Threaded
Open this post in threaded view
|

Re: [jira] [Created] (CARBONDATA-1030) Support reading specified segment or carbondata file

Jin Zhou
@Liang Chen
Thx for your reply. I think your proposal is a good way for reading specified segments.

Maybe the SQL below can be used to reading specified carbon files:
carbon.sql("select * from carbontable in carbonfile('filepath1','filepath2') where filter
conditions").show()