Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add metrics to count joins and window functions #13032

Merged
merged 2 commits into from
Jun 5, 2024

Conversation

gortiz
Copy link
Contributor

@gortiz gortiz commented Apr 30, 2024

This PR adds 4 new metrics:

  1. queriesWithJoins (global): How many queries with joins have been executed. For each query with at least one join, this meter is increased exactly once.
  2. joinCount (global): How many joins have been executed. For each query with at least one join, this meter is increased as many times as joins in the query.
  3. queriesWithWindow (global): How many queries with window functions have been executed. For each query with at least one window function, this meter is increased exactly once.
  4. windowCount (global): How many window functions have been executed. For each query with at least one window function, this meter is increased as many times as window functions in the query.

@codecov-commenter
Copy link

codecov-commenter commented Apr 30, 2024

Codecov Report

Attention: Patch coverage is 40.00000% with 57 lines in your changes missing coverage. Please review.

Project coverage is 62.03%. Comparing base (59551e4) to head (0b2b3d9).
Report is 554 commits behind head on master.

Files Patch % Lines
...he/pinot/spi/metrics/NoopPinotMetricsRegistry.java 2.32% 42 Missing ⚠️
...t/spi/annotations/metrics/PinotMetricsFactory.java 22.22% 7 Missing ⚠️
...org/apache/pinot/common/metrics/MinionMetrics.java 0.00% 3 Missing ⚠️
...org/apache/pinot/spi/metrics/PinotMetricUtils.java 62.50% 1 Missing and 2 partials ⚠️
...apache/pinot/common/metrics/ControllerMetrics.java 66.66% 1 Missing ⚠️
...uery/planner/logical/PinotLogicalQueryPlanner.java 92.85% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #13032      +/-   ##
============================================
+ Coverage     61.75%   62.03%   +0.28%     
+ Complexity      207      198       -9     
============================================
  Files          2436     2540     +104     
  Lines        133233   139591    +6358     
  Branches      20636    21597     +961     
============================================
+ Hits          82274    86601    +4327     
- Misses        44911    46500    +1589     
- Partials       6048     6490     +442     
Flag Coverage Δ
custom-integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration <0.01% <0.00%> (-0.01%) ⬇️
integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration2 0.00% <0.00%> (ø)
java-11 61.97% <40.00%> (+0.26%) ⬆️
java-21 61.93% <40.00%> (+0.30%) ⬆️
skip-bytebuffers-false 62.00% <40.00%> (+0.26%) ⬆️
skip-bytebuffers-true 61.90% <40.00%> (+34.17%) ⬆️
temurin 62.03% <40.00%> (+0.28%) ⬆️
unittests 62.03% <40.00%> (+0.28%) ⬆️
unittests1 46.56% <40.00%> (-0.33%) ⬇️
unittests2 27.76% <0.00%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please take a look at the failed tests

@gortiz gortiz force-pushed the join-metrics branch 2 times, most recently from a2ca1c9 to 10c38b3 Compare June 5, 2024 07:31
@gortiz gortiz merged commit bdef83b into apache:master Jun 5, 2024
20 checks passed
@gortiz gortiz deleted the join-metrics branch June 5, 2024 09:20
gortiz added a commit to gortiz/pinot that referenced this pull request Jun 14, 2024
This PR adds 4 new metrics:

* queriesWithJoins (global): How many queries with joins have been executed. For each query with at least one join, this meter is increased exactly once.
* joinCount (global): How many joins have been executed. For each query with at least one join, this meter is increased as many times as joins in the query.
* queriesWithWindow (global): How many queries with window functions have been executed. For each query with at least one window function, this meter is increased exactly once.
* windowCount (global): How many window functions have been executed. For each query with at least one window function, this meter is increased as many times as window functions in the query.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
metrics multi-stage Related to the multi-stage query engine observability
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants