Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature request] Will cake be able to train model in the future? #25

Open
fish4terrisa-MSDSM opened this issue Aug 11, 2024 · 0 comments

Comments

@fish4terrisa-MSDSM
Copy link

Cake is very useful for me , as it can make full use of all my devices and share the memory(which allows me to run larger models)
However, it seems that cake currently cannot be use to train LoRA models...
Will we add this feature in the future? That's even more useful(Training uses much more resources)
As cake depends on candle, there exists candle-lora which allows people to use candle to train models.

(And, to save as much memory as possible, wilk cake add support for gguf and 4bit models(QLoRA)? )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant