RE: [DISCUSSION] Support DataLoad using Json for CarbonSession

Posted by ravipesala on Dec 07, 2018; 6:23am
URL: http://apache-carbondata-dev-mailing-list-archive.168.s1.nabble.com/DISCUSSION-Support-DataLoad-using-Json-for-CarbonSession-tp69810p69881.html

+1 for JSON loading from CarbonSession LOAD command.

@xuchuanyin  There is a reason why we are not completely depending on Spark
datasource for loading data. We have specific feature called badrecord
handling, if we load data directly from spark I don't think we can get the
bad records present in JSON files. As sparks just gives as null if any thing
wrong in that file so we may not know badrecords in it.

Regards,
Ravindra



--
Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/