[GitHub] [carbondata] shenjiayu17 opened a new pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

classic Classic list List threaded Threaded
127 messages Options
1 ... 4567
Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] ajantha-bhat commented on pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox

ajantha-bhat commented on pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012#issuecomment-766773432


   LGTM (reviewed high level). Merging this.
   
   @shenjiayu17 : Thanks for your contributions.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] asfgit closed pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

asfgit closed pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] shenjiayu17 commented on pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

shenjiayu17 commented on pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012#issuecomment-766780197


   Here is the Testing Reporting Summary with this PR, whick is provided by SmartCare Team.
   1. region-level query performance improved by 40%.
   2. polygon-level query performance improved by 2~20 times.
   3. number of task reduced by 70%, take up less resources.
   
   |     |    | Without Spatial Index(s)|  |
   | :------: |:-------:|:-----:| :-----: |
   |  **Scene**  |  **Scale**    | **AVG of SQL execution cost** | **result(count)** |
   | region list | 3000 regions | 4.333 | 166930 |
   |             | 5000 regions | 4.333 | 252768 |
   | polygon     | 5 vertexes   | 4.667 | 8306 |
   |             | 985 vertexes | 56.567| 3833 |
   |     |       | **With Spatial Index(s)**|  |
   |  **Scene**  |  **Scale**    | **AVG of SQL execution cost** | **result(count)** |
   | region list | 3000 regions | 3.000 | 166930 |
   |             | 5000 regions | 3.000 | 252768 |
   | polygon     | 5 vertexes   | 2.733 | 8306 |
   |             | 985 vertexes | 2.700 | 3833 |
   |polygon list | 1000 polygons (OR) | 4.333 | 22545 |
   |             | 10000 polygons (OR) | 14.000 | 59647 |
   |polyline list| Polyline: 5km <br> buffer: 1000m | 5.667 | 2495993 |
   |             | Polyline: 50km <br> buffer: 1000m | 8.000 | 4279006 |
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] CarbonDataQA2 commented on pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

CarbonDataQA2 commented on pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012#issuecomment-766552732






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] ajantha-bhat commented on pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

ajantha-bhat commented on pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012#issuecomment-766595711






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] shenjiayu17 commented on pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

shenjiayu17 commented on pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012#issuecomment-766780197


   Here is the Testing Reporting Summary with this PR, whick is provided by SmartCare Team.
   1. region-level query performance improved by 40%.
   2. polygon-level query performance improved by 2~20 times.
   3. number of task reduced by 70%, take up less resources.
   
   |     |    | Without Spatial Index(s)|  |
   | :------: |:-------:|:-----:| :-----: |
   |  **Scene**  |  **Scale**    | **AVG of SQL execution cost** | **result(count)** |
   | region list | 3000 regions | 4.333 | 166930 |
   |             | 5000 regions | 4.333 | 252768 |
   | polygon     | 5 vertexes   | 4.667 | 8306 |
   |             | 985 vertexes | 56.567| 3833 |
   |     |       | **With Spatial Index(s)**|  |
   |  **Scene**  |  **Scale**    | **AVG of SQL execution cost** | **result(count)** |
   | region list | 3000 regions | 3.000 | 166930 |
   |             | 5000 regions | 3.000 | 252768 |
   | polygon     | 5 vertexes   | 2.733 | 8306 |
   |             | 985 vertexes | 2.700 | 3833 |
   |polygon list | 1000 polygons (OR) | 4.333 | 22545 |
   |             | 10000 polygons (OR) | 14.000 | 59647 |
   |polyline list| Polyline: 5km <br> buffer: 1000m | 5.667 | 2495993 |
   |             | Polyline: 50km <br> buffer: 1000m | 8.000 | 4279006 |
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


Reply | Threaded
Open this post in threaded view
|

[GitHub] [carbondata] asfgit closed pull request #4012: [CARBONDATA-4051] Geo spatial index algorithm improvement and UDFs enhancement

GitBox
In reply to this post by GitBox

asfgit closed pull request #4012:
URL: https://github.com/apache/carbondata/pull/4012


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[hidden email]


1 ... 4567