Checkout Argilla for annotation. You can use vectors to speed up the annotations and you can also start with zero-shot feedback to improve the training as you go

https://www.argilla.io/