I’m super interested in the world of NLP (natural language processing), so the news that performance increased dramatically with ELMo piqued my interest. 💡
The biggest benefit in my eyes is that this method doesn’t require labeled data, which means the world of written word is our oyster. 🐚
Yeah, yeah, word embeddings don’t require labeled data either. ELMo can also learn word meanings at a higher level, which I think means it will have far more impact and a wider range of applications. 📶
ELMo, for example, improves on word embeddings by incorporating more context, looking at language on a scale of sentences rather than words.
Our cuddly, red muppet still picks up the biases we embed in our writings though. So plenty more work to be done. 🛠