Apache CarbonData Dev Mailing List archive › Apache CarbonData JIRA issues

[GitHub] carbondata pull request #2396: [WIP] Complex data type enhancements

Classic

List

Threaded

103 messages Options

1234 ... 6

qiuchenjian-2

[GitHub] carbondata pull request #2396: [WIP] Complex data type enhancements

GitHub user Indhumathi27 opened a pull request:

https://github.com/apache/carbondata/pull/2396

[WIP] Complex data type enhancements

Complex data type enhancements.
(1) Projection push down:
(a) Projection push down is handled only for STRUCT data type.
(b) Even if the STRUCT contains an ARRAY type as child then projection push down is not applicable.
(c) When the STRUCT column is given in projection list, then the projection list can be rewritten in an optimized way considering all the complex columns required.

- [ ] Any interfaces changed?

- [ ] Any backward compatibility impacted?

- [ ] Document update required?

- [x] Testing done
Test cases added

- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Indhumathi27/carbondata indu_projection

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/2396.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2396

----
commit d949acd57b364b1ad225a70d929fad37877d8b5f
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-15T09:14:14Z

Projection for complex datatype

commit 2573fa5ba9c46df17ba60aefef73c66333c36324
Author: sounakr <sounakr@...>
Date: 2018-06-17T17:55:41Z

Complex Column Projection Push Down Changes

commit 03cee27a185a1da4348e46a7f6201e9fdbd5b523
Author: sounakr <sounakr@...>
Date: 2018-06-17T17:55:41Z

Complex Column Projection Push Down Changes

commit 1341b6574333ac07858dabfee61335783e0b0935
Author: sounakr <sounakr@...>
Date: 2018-06-18T10:53:00Z

Rectify String Type

commit c106f580f1f416793e433e7b2f09496fb00fe921
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

commit d95598b4afd0bf65286efbf4fcb4bf000eebbde2
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

commit c4c5dc48c4bafd626dee4f503446f46fc8999792
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

commit 3ce7a02372aef08bcf3e6e94835efad9604d52af
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

commit cadb1235262063ac1b42fda0b03c542081ebc131
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

commit 9457fea059bbcb3fccdadab338cf510d86780a5b
Author: sounakr <sounakr@...>
Date: 2018-06-20T10:39:28Z

Multiple Columns Combination PushDown

commit 222a1edc2046325e2d1c784497426885bd721c94
Author: Indhumathi27 <indhumathim27@...>
Date: 2018-06-19T17:22:06Z

Complex Projection

----

---

qiuchenjian-2