[jira] [Created] (CARBONDATA-1030) Support reading specified segment or carbondata file

[Akash R Nilugal (Jira)]

Jin Zhou created CARBONDATA-1030:
------------------------------------

             Summary: Support reading specified segment or carbondata file
                 Key: CARBONDATA-1030
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1030
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Jin Zhou
            Priority: Minor


We can query whole table in SQL way currently, but reading specified segments or data files is useful in some scenarios such as incremental data processing.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[Liang Chen]

Hi

+1 for this feature.
How about the SQL script as below :
carbon.sql("select * from carbontable in segmentid(0,3,5,7) where filter
conditions").show()

Regards
Liang

[Jin Zhou]

@Liang Chen
Thx for your reply. I think your proposal is a good way for reading specified segments.

Maybe the SQL below can be used to reading specified carbon files:
carbon.sql("select * from carbontable in carbonfile('filepath1','filepath2') where filter
conditions").show()