aboutsummaryrefslogtreecommitdiff
path: root/README.md
blob: 8f80cb2296c95be3d53c010084ec81c23da5fe7a (plain) (blame)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
# embed.c

`embed.c` implements inference for Perplexity
[pplx-embed](https://huggingface.co/collections/perplexity-ai/pplx-embed)
dense/contextual text embedding models plus the recently added MaxSim
late-interaction model.

Supported platforms are CUDA/cuBLAS on Linux/NVIDIA, Apple Silicon MLX, and
CPU/BLAS.

## Building

**Prerequisites**:

- On Linux, install `libcjson-dev`, `libcjson1`, and `libopenblas-dev`.
- On macOS, install `cjson`, `mlx` and `mlx-c` via Homebrew.

**Makefile targets**:

- Run `make gpu` to auto-select the GPU backend (MLX on macOS, CUDA on Linux).
- Run `make cpu` to build the CPU backend only (BLAS: Accelerate on macOS,
  OpenBLAS on Linux).