Skip to content

Conversation

forsaken628
Copy link
Collaborator

@forsaken628 forsaken628 commented Sep 29, 2025

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

  1. Introduced BackpressureSpiller to limit memory usage during spill, use enable_backpressure_spiller to control, off by default
  2. Introduced new spill format to support single-file persistent writes
  3. Rewrote window spill using BackpressureSpiller

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Documentation Update
  • Refactoring
  • Performance Improvement
  • Other (please describe):

This change is Reviewable

@github-actions github-actions bot added the pr-feature this PR introduces a new feature to the codebase label Sep 29, 2025
@forsaken628 forsaken628 changed the title feat(query): Spiller feat(query): introduce BackpressureSpiller Oct 15, 2025
@forsaken628 forsaken628 marked this pull request as ready for review October 15, 2025 01:43
@forsaken628 forsaken628 merged commit 1371711 into databendlabs:main Oct 15, 2025
177 of 179 checks passed
@forsaken628 forsaken628 deleted the spiller branch October 15, 2025 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-feature this PR introduces a new feature to the codebase

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants