How can I make word embedding using Bert?
Author: saeideh-shCreated Jan 11, 2019Updated May 10, 2024
Hi,
I want to make feature vectors from my documents using Bert. I would like to make a vector for each word in my texts, make the average vectors of my words for each document and add it as one of the features to my classifier. I have read extract_features.py script, but I couldn't get how I can use Bert and make the word embedding and extract features from my text docs. Would you please help me understand what the step by step process is for making this vector representation? Do I need to customize Bert, if yes would you please point me to the files that need to be changed?
Many thanks!
Source: google-research/bert