支持qwen吗

[Storm0921]

No description provided.

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Title: Support qwenuo

[Storm0921]

https://github.com/hpcaitech/ColossalAI/blob/main/applications/ColossalChat/examples/README.md

1.如果支持qwen的话应该怎么使用呢？使用ColossalChat去sft，rm，ppo？好像没看到支持pt？
2.Colossal-LLaMA这块是仅支持llama系列的pt和sft嘛？qwen这种和llama结构基本一致的不能套用进来？
3.coati里看上去很多脚本，能拿来做训练吗？是干啥用的

[wangbluo]

Hi, Colossal-LLama is not for qwen model, as they have different prompts.
You can use ColossalChat to do sft，rm，ppo but pt.
If your gpu resources is limit, we recommend you to use lora strategies.
Coati is for sft, and rlhf.