Skip to main content

and
  1. No Access

    Chapter and Conference Paper

    Kformer: Knowledge Injection in Transformer Feed-Forward Layers

    Recent days have witnessed a diverse set of knowledge injection models for pre-trained language models (PTMs); however, most previous studies neglect the PTMs’ own ability with quantities of implicit knowledge...

    Yunzhi Yao, Shaohan Huang, Li Dong, Furu Wei in Natural Language Processing and Chinese Co… (2022)

  2. No Access

    Chapter and Conference Paper

    Neural Melody Composition from Lyrics

    In this paper, we study a novel task that learns to compose music from natural language. Given the lyrics as input, we propose a melody composition model that generates lyrics-conditional melody as well as th...

    Hangbo Bao, Shaohan Huang, Furu Wei, Lei Cui in Natural Language Processing and Chinese Co… (2019)