Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Various performance and memory optimizations #558

Draft
wants to merge 16 commits into
base: master
Choose a base branch
from

Conversation

jpsamaroo
Copy link
Member

@jpsamaroo jpsamaroo commented Jul 22, 2024

This PR implements a variety of performance tweaks and memory usage optimizations to improve the overall performance of Dagger under various conditions, particularly when dealing with many small tasks.

Todo:

  • Ensure that all reusable objects are cleared on error
  • Implement full test suite for reusable utilities

Sch: Don't return values in Tasks
Sch: Switch from state.cache to thunk.cache_ref
tests: Improve test_throws_unwrap error comparisons
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Memory leak when copying data from one worker to another
1 participant