Sahoo, S., Arriola, M., Schiff, Y., Gokaslan, A., Marroquin, E., Chiu, J., ... & Kuleshov, V. (2024). Simple and effective masked diffusion language models. Advances in Neural Information Processing Systems, 37, 130136-130184.https://s-sahoo.com/mdlm/ MDLM Blog postSimple and Effective Masked Diffusion Language Modelss-sahoo.com 한동안 글을 작성하지 않다가 폭풍처럼 Diffusion Language Model (DLM)을 살펴 보고 있는데요.수많은..

Ishaan Gulrajani and Tatsunori B. Hashimoto. 2023. Likelihood-based diffusion language models. In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS '23). Curran Associates Inc., Red Hook, NY, USA, Article 730, 16693–16715.https://proceedings.neurips.cc/paper_files/paper/2023/file/35b5c175e139bff5f22a5361270fce87-Paper-Conference.pdf 전통적인 LLM, 즉 auto-..