[jira] [Created] (CARBONDATA-3158) support presto-carbon to read sdk cabron files

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-3158) support presto-carbon to read sdk cabron files

Akash R Nilugal (Jira)
Ajantha Bhat created CARBONDATA-3158:
----------------------------------------

             Summary: support presto-carbon to read sdk cabron files
                 Key: CARBONDATA-3158
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3158
             Project: CarbonData
          Issue Type: Improvement
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


Currently, carbon SDK files output (files without metadata folder and its
contents) are read by spark using an external table with carbon session.
But presto carbon integration doesn't support that. It can currently read
only the transactional table output files.

Hence we can enhance presto to read SDK output files. This will increase
the use cases for presto-carbon integration.

The above scenario can be achieved by inferring schema if metadata folder
not exists and
setting read committed scope to LatestFilesReadCommittedScope, if
non-transctional table output files are present.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)