Change Embeddings Model

You can create a docker-compose override file and change the model used for embeddings.

For example to change to another model from Text Embeddings Inference

create a docker-compose-embeddings.yml file. Such as

services:
  embeddings-api:
    image: ghcr.io/huggingface/text-embeddings-inference:cpu-0.6
    platform: linux/amd64
    command: --model-id BAAI/bge-small-en-v1.5

And change the command entry to the model you want to use.

Running it all

docker-compose -f docker-compose.yml -f docker-compose-embeddings.yml up