Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix time stats in SegmentIndexCreationDriverImpl #13429

Merged

Conversation

yashmayya
Copy link
Collaborator

  • The record read start / stop times in SegmentIndexCreationDriverImpl were in nanoseconds whereas the index stop time was in milliseconds. The total indexing time was being calculated by subtracting the two stats which obviously leads to a garbage result since they're in different units.
  • The total stats collection time was being logged but not computed.
  • This patch fixes both the above issues along with some other minor cleanups.

Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch!

@codecov-commenter
Copy link

codecov-commenter commented Jun 24, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 62.03%. Comparing base (59551e4) to head (456d4d0).
Report is 675 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master   #13429      +/-   ##
============================================
+ Coverage     61.75%   62.03%   +0.28%     
+ Complexity      207      198       -9     
============================================
  Files          2436     2557     +121     
  Lines        133233   141190    +7957     
  Branches      20636    21913    +1277     
============================================
+ Hits          82274    87586    +5312     
- Misses        44911    46942    +2031     
- Partials       6048     6662     +614     
Flag Coverage Δ
custom-integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration <0.01% <0.00%> (-0.01%) ⬇️
integration1 <0.01% <0.00%> (-0.01%) ⬇️
integration2 0.00% <0.00%> (ø)
java-11 35.38% <0.00%> (-26.33%) ⬇️
java-21 61.92% <100.00%> (+0.29%) ⬆️
skip-bytebuffers-false 61.98% <100.00%> (+0.23%) ⬆️
skip-bytebuffers-true 61.87% <100.00%> (+34.14%) ⬆️
temurin 62.03% <100.00%> (+0.28%) ⬆️
unittests 62.02% <100.00%> (+0.28%) ⬆️
unittests1 46.71% <0.00%> (-0.19%) ⬇️
unittests2 27.53% <100.00%> (-0.20%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Jackie-Jiang Jackie-Jiang merged commit fe3411d into apache:master Jun 24, 2024
20 checks passed
suyashpatel98 pushed a commit to suyashpatel98/pinot that referenced this pull request Jul 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants