The algorithm is based on paper "FedMKT: Federated Mutual Knowledge Transfer for Large and SmallLanguage Models", We integrate its code into the FATE-LLM framework.
If you publish work that uses FedMKT, please cite FedMKT as follows:
@inproceedings{fan2025fedmkt,
title={Fedmkt: Federated mutual knowledge transfer for large and small language models},
author={Fan, Tao and Ma, Guoqiang and Kang, Yan and Gu, Hanlin and Song, Yuanfeng and Fan, Lixin and Chen, Kai and Yang, Qiang},
booktitle={Proceedings of the 31st International Conference on Computational Linguistics},
pages={243--255},
year={2025}
}