Adding a cluster config to enable instance pool and replica group configuration in table config

[soumitra-st]

Added an insteance level configuration enforce.pool.based.assignment to enable instance pool and replica group configuration check in table config.

If a Pinot cluster is configured with server pools to restart the cluster faster, then enabling enforce.pool.based.assignment config will enforce all tables are using Pool-Based Instance Assignment and Replica-Group Segment Assignment .

feature

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 77.41935% with 7 lines in your changes missing coverage. Please review.

Project coverage is 62.12%. Comparing base (59551e4) to head (58ef324).
Report is 593 commits behind head on master.

Files	Patch %	Lines
...he/pinot/segment/local/utils/TableConfigUtils.java	69.56%	4 Missing and 3 partials ⚠️

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #13131      +/-   ##
============================================
+ Coverage     61.75%   62.12%   +0.37%     
+ Complexity      207      198       -9     
============================================
  Files          2436     2547     +111     
  Lines        133233   139947    +6714     
  Branches      20636    21722    +1086     
============================================
+ Hits          82274    86940    +4666     
- Misses        44911    46421    +1510     
- Partials       6048     6586     +538     

Flag	Coverage Δ
custom-integration1	<0.01% <0.00%> (-0.01%)	⬇️
integration	<0.01% <0.00%> (-0.01%)	⬇️
integration1	<0.01% <0.00%> (-0.01%)	⬇️
integration2	0.00% <0.00%> (ø)
java-11	62.08% <77.41%> (+0.37%)	⬆️
java-21	61.99% <77.41%> (+0.36%)	⬆️
skip-bytebuffers-false	62.10% <77.41%> (+0.35%)	⬆️
skip-bytebuffers-true	61.96% <77.41%> (+34.23%)	⬆️
temurin	62.12% <77.41%> (+0.37%)	⬆️
unittests	62.11% <77.41%> (+0.37%)	⬆️
unittests1	46.70% <0.00%> (-0.19%)	⬇️
unittests2	27.71% <77.41%> (-0.02%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Jackie-Jiang]

Let's not keep adding booleans for each check type because it is hard to maintain. Suggest making them static, and set them up when starting the controller. validate() only takes tableConfig, schema and optional typesToSkip

[soumitra-st]

TableConfigUtils has static utility methods only. IMO, we should not store state as static variables in that class.

[Jackie-Jiang]

These are always instance level/cluster level config, so it should be good to have them as static (basically model it as a singleton validator). We may add 2 static methods setDisableGroovy() and setEnforcePoolBasedAssignment(), and set them up in the ControllerStarter.

[Jackie-Jiang]

Good job! Please also update the pinot doc about the new config