[jira] [Created] (CARBONDATA-3701) Apache CarbonData should provides python interface to support deep learning framework MXNet to ready and write data from/to CarbonData

[Akash R Nilugal (Jira)]

Bo Xu created CARBONDATA-3701:
---------------------------------

             Summary: Apache CarbonData should provides python interface to support deep learning framework MXNet to ready and write data from/to CarbonData
                 Key: CARBONDATA-3701
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-3701
             Project: CarbonData
          Issue Type: Sub-task
            Reporter: Bo Xu
            Assignee: Bo Xu


Nowadays AI model training is getting more and more popular. Currently many AI framework uses raw data files or row format data files for model training, it could not provide projection, filtering, and fast scan capability like in columnar store. So, if CarbonData supports AI framework, it can speed up model training by increase IO throughput, and provide more flexible training set selection ability to AI developers

AI compute engine integration:

MXNet integration: New python API in pycarbon to support MXNet to read data from CarbonData files for training model



--
This message was sent by Atlassian Jira
(v8.3.4#803005)