Re:TensorFlow Code for Google Research's BERT: Pre-Training ...
by jean- on Wednesday October 31, 2018 @09:28PM
(#18350766)
Absolutely. If your only input is the subject line, then you're dealing with a single-sentence classification task. You'd need to take the "class label" vector from the top layer of BERT (labelled "C" in Fig 2b of the paper) and then feed that to your own classifier.
For the experiments in paper they actually fine-tuned BERT on the downstream task, but I reckon you'd get acceptable performance by just keeping it fixed and using its outputs as features for a shallow classifier.
Re:TensorFlow Code for Google Research's BERT: Pre-Training ...
by brokensegue on Wednesday October 31, 2018 @09:08PM
(#18350654)
sure
Would BERT help me by first enabling me to transform the input subject lines into vectors in a high dimensional vector space which could then be the inputs into a relatively shallow network that does the classification?