xuchuanyin created CARBONDATA-3031:
--------------------------------------
Summary: Find wrong description in the document for 'carbon.number.of.cores.while.loading'
Key: CARBONDATA-3031
URL:
https://issues.apache.org/jira/browse/CARBONDATA-3031 Project: CarbonData
Issue Type: Improvement
Reporter: xuchuanyin
Assignee: xuchuanyin
The document says that the default value of ‘carbon.number.of.cores.while.loading’ is 2. But actually during data loading, carbondata use the the value of 'spark.executor.cores', which means that the description in document is incorrect.
But this doesn't mean that the default value of 'carbon.number.of.cores.while.loading' is useless -- in compaction and sdk, carbondata still use this default value.
In a word, we need to fix the implementation as well as the document, maybe some refactoring is needed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)