GitHub user ajantha-bhat opened a pull request:
https://github.com/apache/carbondata/pull/2289 [CARBONDATA-2435] Remove SDK dependency on spark jars.
[CARBONDATA-2435] Remove SDK dependency on spark jars.
Problem and cause : when sdk writer is used in standalone cluster
without spark jars,
exception is thrown during reverse dictionary cache initialize time.
Solution: carbon SDK doesn't support dictionary encoding, This spark
dependency is only for dictionary encoding.
Move the spark dependency code inside dictionary encoding if block.
So that SDK flow will not have to access spark class.
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted?NA
- [ ] Document update required?NA
- [ ] Testing done. NA
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. NA
You can merge this pull request into a Git repository by running:
$ git pull
https://github.com/ajantha-bhat/carbondata master_new
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/carbondata/pull/2289.patchTo close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2289
----
commit 14d95921795aaac4dff9cfe46ffd118e3fdf7388
Author: ajantha-bhat <ajanthabhat@...>
Date: 2018-05-09T12:37:56Z
[CARBONDATA-2435] Remove SDK dependency on spark jars.
Problem and cause : when sdk writer is used in standalone cluster
without spark jars,
exception is thrown during reverse dictionary cache initialize time.
Solution: carbon SDK doesn't support dictionary encoding, This spark
dependency is only for dictionary encoding.
so, move the spark dependency code inside dictionary encoding if block.
So, that SDK flow will not have to access spark class.
----
---
Locked
