是否能提供微调脚本？

[songpb]

你好，是否能想glm4一样提供微调demo？我直接使用glm4的脚本报错，不知道是否是transformers版本的问题，我的transformers是4.44.0，也试过4.43、4.42和4.40分别报不同错误

[gitYuZui]

求提供

[songpb]

使用ms-swift可以微调 Zheng Zezheng ***@***.***> 于2024年8月22日周四 14:48写道：

…

求提供 — Reply to this email directly, view it on GitHub <#62 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEWBHRH7W2IEC3PERWV56CDZSWCUFAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBTHEYDSOBUHE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[XTUxiongda]

使用ms-swift可以微调 Zheng Zezheng @.> 于2024年8月22日周四 14:48写道：
…
求提供 — Reply to this email directly, view it on GitHub <#62 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEWBHRH7W2IEC3PERWV56CDZSWCUFAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBTHEYDSOBUHE . You are receiving this because you authored the thread.Message ID: @.>

代码大模型这种如何微调，求交流

[songpb]

数据集格式用ms-swift的格式即可，内容组织可以参考 https://huggingface.co/datasets/codefuse-ai/CodeExercise-Python-27k XTUxiongda ***@***.***> 于2024年8月26日周一 13:29写道：

…

使用ms-swift可以微调 Zheng Zezheng *@*. *> 于2024年8月22日周四 14:48写道： … <#m_-2379040664451659635_> 求提供 — Reply to this email directly, view it on GitHub <#62 (comment) <#62 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEWBHRH7W2IEC3PERWV56CDZSWCUFAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBTHEYDSOBUHE <https://github.com/notifications/unsubscribe-auth/AEWBHRH7W2IEC3PERWV56CDZSWCUFAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBTHEYDSOBUHE> . You are receiving this because you authored the thread.Message ID: @.*> 代码大模型这种如何微调，求交流 — Reply to this email directly, view it on GitHub <#62 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEWBHRAKYSBH4QMNYR3F34LZTK4NBAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBZGM2DSOBYGE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[chenjinxinlove]

用LLaMA-Factory可以pt或者sft

[123yxh]

求提供微调数据集

[carveybunt]

使用ms-swift可以微调 Zheng Zezheng @.> 于2024年8月22日周四 14:48写道：
…
求提供 — Reply to this email directly, view it on GitHub <#62 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEWBHRH7W2IEC3PERWV56CDZSWCUFAVCNFSM6AAAAABMTYV5UKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBTHEYDSOBUHE . You are receiving this because you authored the thread.Message ID: _@**.**_>

代码大模型这种如何微调，求交流

我也想学，不知道您找到门路了吗？