The algorithm is based on paper "FedMKT: Federated Mutual Knowledge Transfer for Large and SmallLanguage Models", We integrate its code into the FATE-LLM framework.
If you publish work that uses FedMKT, please cite FedMKT as follows:
@article{fan2024fedmkt,
title={FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models},
author={Fan, Tao and Ma, Guoqiang and Kang, Yan and Gu, Hanlin and Fan, Lixin and Yang, Qiang},
journal={arXiv preprint arXiv:2406.02224},
year={2024}
}