Word2vec Attention, … Abstract primary criticism towards language mod-els (LMs) is their inscrutability.