Contextualized Word Embeddings Background
Word embedding 沒辦法表達一字多意的問題~
Word Embedding Ploysemy Issue
- Words are polysemy
- An apple a day, keeps the doctor away.
- Samrtphone companies including apple, …
- However, their embeddings are NOT ploysemy
- Issue
- Multi-senses (ploysemy)
- Multi-aspects (semantics, syntax)
RNN LM (Language Model)
TagLM - “Pre-ELMo”
TagLM Model Detail
TagLM on Name Entity Recognition
CoVe (Contextualized Word Vectors)
- 借用 MT (machine translation) 資訊
AI CUP 2019新聞立場檢索競賽課程(蔡宗翰、李宏毅)
