I am taking inspiration from your notebook to test similar models on reviews left on an Italian ecommerce website. Both the embedding matrix and word vectorization lead to high memory usage.
Was wondering what did you train this model on.
Might consider to spin up a vm on GCP and take it that way.