Tags: gr-oss-devops/armada
Tags
Enforce supplying queue + jobset on Cancel + Reprioritise endpoints (a… …rmadaproject#3560) We want to enforce these, so we don't need to look the values up in Redis when they aren't supplied The motivation here is to so we can remove redis Signed-off-by: JamesMurkin <[email protected]>
Fix the performance of LimitSequenceByteSize (armadaproject#3548) * Fix the performance of LimitSequenceByteSize I changed this function recently (armadaproject#3483) as it was previously incorrectly not limiting the byte sequence in all cases Unfortunately this change caused the complexity of the function to go from O(n) -> O(n^2), where n is the number of sequence.Events This PR changes the complexity back to O(n) while still keeping the correct limit check We now estimate the byte overhead added by the Event slice using the constant `sequenceEventListSizeBytes` - which is a very conservative estimate - This does mean the function is now less useful for very small limits, but that isn't a problem for us in practice. Typically we limit to 4Mb, so 100 byte overhead is insignificant This change means the time to process an EventSequence with 170k events (approximately our worst case when using a 4Mb limit) from 3m10s -> 22.5ms (on my AWS machine) The motivation for this change was that large events going through our system were causing significant pauses in process - This impacted the scheduler and ingesters, causing widespread dispruption on large events (cancel/repioritize) Signed-off-by: JamesMurkin <[email protected]> * Fix comment Signed-off-by: JamesMurkin <[email protected]> * Rename constant + better comment Signed-off-by: JamesMurkin <[email protected]> --------- Signed-off-by: JamesMurkin <[email protected]>
Default GangNodeUniformityLabelAnnotation at the correct level. (arma… …daproject#120) (armadaproject#3529) Co-authored-by: Christopher Martin <[email protected]>
Better Query Api Paths (armadaproject#3527) * change rest api methods Signed-off-by: Chris Martin <[email protected]> * Update docs-readme.md --------- Signed-off-by: Chris Martin <[email protected]> Co-authored-by: Chris Martin <[email protected]>
Add label to pod to show if it is preemptible or not (armadaproject#3517 ) This is useful to external tooling, so it knows which pods it can/can't preempt Signed-off-by: JamesMurkin <[email protected]> Co-authored-by: Chris Martin <[email protected]>
Filter out null values when grouping by annotation (armadaproject#3521) * Add a regression test Signed-off-by: Noah Held <[email protected]> * Fix the bug Signed-off-by: Noah Held <[email protected]> * Formatting Signed-off-by: Noah Held <[email protected]> --------- Signed-off-by: Noah Held <[email protected]>
Filter out null values when grouping by annotation (armadaproject#3521) * Add a regression test Signed-off-by: Noah Held <[email protected]> * Fix the bug Signed-off-by: Noah Held <[email protected]> * Formatting Signed-off-by: Noah Held <[email protected]> --------- Signed-off-by: Noah Held <[email protected]>
PreviousNext