ajantha-bhat opened a new pull request #3362: Fix insert failure with customFileProvider
URL:
https://github.com/apache/carbondata/pull/3362
problem:
Below exception is thrown when the custom file system is used with first time insert randomly.
IllegalArgumentException("Path belongs to unsupported file system") from FileFactory.getFileType()
cause:
DefaultFileTypeProvider.initializeCustomFileProvider is called concurrently during insert. Hence one thread got the provider and other thread didn't get as flag is set to true.
so other thread failed as it tried with default provider.
solution:
synchronize the initialization of custom file provider.
Be sure to do all of the following checklist to help us incorporate
your contribution quickly and easily:
- [ ] Any interfaces changed? NA
- [ ] Any backward compatibility impacted? NA
- [ ] Document update required? NA
- [ ] Testing done. done
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. NA
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[hidden email]
With regards,
Apache Git Services