For instance, assume the input word is “cat” – the Word2Vec tries to predict the context (“the”, “sat”) from this supplied input word. In this case, the code is mostly based on the TensorFlow Word2Vec tutorial here with some personal changes.