These days, at least in non-research contexts, people seem to mostly use spacy-transformers for that, already contains all the necessary glue code between huggingface transformers (including BERT) and spacy.

https://explosion.ai/blog/spacy-transformers / https://spacy.io/universe/project/spacy-transformers