ColBER: Contextualized Late Interaction over BERT. That is just the name. It can be fine-tuned for retrieval using any encoder-only model like the ones you mention.
Yes thanks and anyone looking to swapout ColBERTv2 should look at example.2 "for any BERT/RoBERTa-like model" and then test against use cases to your heart's desire or at least until you run out of time to optimize lol!
jimmySixDOF|2 years ago