What Data Is Needed for Supervised Fine-Tuning (SFT)?
- 更新:2023-08-24 13:56:53
- 首发:2023-08-23 23:21:29
- SFT
- 3245
The article primarily discusses the types and quality of data required for Supervised Fine-Tuning (SFT). It covers the following aspects:
- Objectives of Supervised Fine-Tuning : Enhancing performance in specific tasks, domain adaptability, and the interpretability and controllability of the model, with an overarching goal to boost system robustness.
- Core Considerations : These include the diversity of data, avoiding treating SFT merely as data supplementation, appropriately incorporating few-shot learning and COT data, emphasizing data quality over quantity in SFT, and recognizing that increasing data volume without diversity brings diminished returns.
- Data Quality Requirements : These considerations touch on the length restrictions for questions and answers, the accuracy of answers, the selection of data based on industry requirements, the diversity of necessary NLP abilities, and the caution against too much vertical domain data.
- Specific Examples : The article provides both good and poor dataset examples to illustrate how to choose and evaluate data.
- Q&A Section : This part explains why including the ability to write code in SFT is essential, emphasizing its importance in improving reasoning and structured output abilities.
In summary, the article offers comprehensive guidance on how to conduct supervised fine-tuning, underlining the importance of data diversity and quality, and presents implementation strategies and examples to support these points.
老师你好,我希望能用一个openwrt路由器实现IPv4和IPv6的桥接,请问我该如何实现?我尝试了直接新增dhcpv6的接口,但是效果不甚理想(无法成功获取公网的ipv6,但是直连上级路由的其他设备是可以获取公网的ipv6地)
![%E5%B1%8F%E5%B9%95%E6%88%AA%E5%9B%BE20241205230845.png](https://cdn.wyr.me/visitor-files/2024-12-05/1733411344287屏幕截图 2024-12-05 230845.png)你好
,为什么我这里是0039 813C 0600 0075 16xx xx xx,只有前6组是相同的,博客中要前8位相同,这个不同能不能照着修改呢?我系统版本是Win1124H2
大神你好,win11专业版24h2最新版26100.2033,文件如何修改?谢谢
win11专业版24h2最新版26100.2033,Windows Feature Experience Pack 1000.26100.23.0。C:\Windows\System32\termsrv.dll系统自带的这个文件,39 81 3C 06 00 00 0F 85 XX XX XX XX 替换为 B8 00 01 00 00 89 81 38 06 00 00 90。仍然无法远程连接。原来是win11 21h2系统,是可以远程链接的。共享1个主机,2个显示器,2套键鼠,各自独立操作 各自不同的账号,不同的桌面环境。
博主,win11专业版24h2最新版,C:\Windows\System32\termsrv.dll系统自带的这个文件,找不到应该修改哪个字段。我的微信:一三五73二五九五00,谢谢