https://arxiv.org/abs/2208.10844
CLOWER: A Pre-trained Language Model with Contrastive Learning over Word and Character Representations (Borun Chen, Hongyin Tang, Jingang Wang, Qifan Wang, Hai-Tao Zheng, Wei Wu, Liqian Yu)
word-character 사이의 contrast이긴 한데 윤식님이 하시던 작업이 생각나서 가져와봤습니다. 그런데 윤식님이 휴가시군요.