[jira] [Created] (CARBONDATA-2203) record detailed metrics information during carbon processing

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Created] (CARBONDATA-2203) record detailed metrics information during carbon processing

Akash R Nilugal (Jira)
xuchuanyin created CARBONDATA-2203:
--------------------------------------

             Summary: record detailed metrics information during carbon processing
                 Key: CARBONDATA-2203
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2203
             Project: CarbonData
          Issue Type: Improvement
            Reporter: xuchuanyin
            Assignee: xuchuanyin


We need to record more detailed information during carbondata processing (query & load).

These information can be used:
 # for figuring out the possible performance problems in carbondata
 # for tuning
 # as input for some adaptive strategy

Here are some examples:

For data query:
 # Time costs for sql parse/optimize/plan
 # Time to load&read metadata
 # Time to schedule
 # Time to execute
 # ...

For data loading:
 # Time to schedule
 # Time to execute
 # Disk spill amount
 # ...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)