Perplexity AI Releases pplx-embed-v2-late: A 0.6B Edge Model and a 9B Model Scoring 92.4% on MADQA

Perplexity has released pplx-embed-v2-late, a pair of ColBERT-style multimodal embedding models. They come in 2 sizes: 0.6B for fast, cheap queries and 9B for maximum quality. Both models retrieve text, images and rendered PDF pages, and they share one embedding space.
Is it deployable? Yes, if you host it yourself. Both models are on Hugging Face under the MIT license. A hosted Perplexity API endpoint is planned but not live.
TL;DR
The best

The 0.6B model uses about 340M active parameters for images and stays close to 8B rivals.
A 9B index can be searched with 0.6B queries, recovering about half the 9B quality gap on text at 0.6B query cost.
Its 128-dim token vectors are 16x to 32x narrower than rivals at 2,048 to 4,096 dims.
MIT license, with commercial use allowed.

The worst

It stores 1 vector per token, so index size grows with document length.
It is not #1 on ViDoRe v3 image retrieval; Tencent’s EVIE scores higher.
A single input cannot mix text and images.
All scores are self-reported, and the technical report is not out yet.

Model Size and What It Runs On

Metrics
pplx-embed-v2-late-0.6b
pplx-embed-v2-late-9b

Total parameters
594M
9B (Hugging Face lists 8B)

Active parameters
~240M text, 340M image
7.4B

Base model
Qwen3.5-0.8B, pruned to 12 text layers
Qwen3.5

Output
128 dims per token
128 dims per token

Weights in memory (bf16, our estimate)
~1.2 GB
~16 to 18 GB

Intended machine
Laptop, edge device or small GPU
Datacenter or high-memory GPU

Perplexity’s suggested role
Live query encoder, 100% local
Building the document index

Perplexity designed the 0.6B model as a lightweight query encoder that can also run on edge devices. Both model cards show CUDA GPU usage. They need sentence-transformers >= 6.0.0 and transformers >= 5.4.0. The memory figures are our estimate at 2 bytes per parameter, for weights only. The published checkpoints are stored in F32, which doubles the download size.
How Well It Performs: Best and Worst Scores
All numbers below are from Perplexity’s announcement:

Benchmark
0.6B
9B
Where it stands

MADQA (agentic PDF QA, accuracy)
90.1%
92.4% (best)
Beats Mixedbread’s retriever (88.9%); trails Mixedbread Agentic Search (93.4%)

Domain-specific text (72 tasks, nDCG@10)
78.0%
81.3%
9B leads all tested models by 1.6pp; 0.6B is 0.3pp behind gemini-embedding-2

Q2D-Web (Recall@1000)
73.6%
74.8%
Both beat the previous best of 69.3%

ViDoRe v3 image (nDCG@10)
62.3%
65.2%
0.6B is within 1.2pp of nemotron-colembed-v2-8b; EVIE leads

ViDoRe v3 Markdown (nDCG@10)
61.2% (worst)
64.7%
Both beat every external model tested

BrowseComp+ (accuracy)
Not given
64.0% (lowest)
Still 4.9pp above the next ColBERT model

The strongest result: 92.4% on MADQA, set by the 9B model. The biggest margin is on BrowseComp+, at 8.7pp over the best dense model.
The weakest result: 61.2% on ViDoRe v3 Markdown, from the 0.6B model. It is still the 2nd-best score on that benchmark. Image search is the real gap: Gemini Embedding 2 beats the 9B model on MIRACL-Vision and by 2pp on PPLX-Q2I.
Mixing sizes: a 9B index queried by the 0.6B model scored 63.5% on ViDoRe v3 image retrieval. That beats 62.3% with 0.6B on both sides, at the same query cost.
How It Works
Dense models compress a document into 1 vector. pplx-embed-v2-late instead keeps a 128-dim vector for every token. It scores with MaxSim: each query token finds its best document token, and those maxima are summed. Pages are encoded as images, so no OCR step is needed. Perplexity distilled both models from an 18B teacher using LEAF-style token-level training. That training is what creates the shared space.
Best Use Cases

The best fit is visual document search over PDFs, slides and scanned reports.
Low-latency search: index in the cloud with 9B, then query on-device with 0.6B.
Agentic RAG over large PDF or web collections.

Interactive Explainer

How It Compares

Feature
pplx-embed-v2-late
NVIDIA nemotron-colembed-vl-8b-v2
TopK topk-embed-v1
Google Gemini Embedding 2

Size
0.6B, 9B
~8.8B
0.8B, 2B open
Not disclosed

Vector width
128 per token
4,096 per token
2,048 per token (small)
128 to 3,072, 1 vector

Inputs
Text, images, page renders
Text queries, page images
Text, page images
Text, image, video, audio, PDF

Runs on
Your GPU; 0.6B on edge
NVIDIA A100/H100, Linux
CUDA GPU (Ampere+)
Google API

Shared space across sizes
Yes
Not stated
Not stated
Not applicable

License
MIT
CC-BY-NC-4.0
Apache 2.0 (small)
Proprietary

Key Takeaways

The 0.6B model fits edge devices; the 9B model is built for index-time quality.
Best score: 92.4% on MADQA. Weakest: 61.2% on ViDoRe v3 Markdown.
0.6B queries over a 9B index beat 0.6B on both sides.
Storage growth and self-reported scores are the main caveats.

Check out the Model weights on HF and Technical details. All credit goes to the researcher of this project. Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter. Wait! are you on telegram? now you can join us on telegram as well.
[Sponsored] The web is the one API most agents are missing. Databases, calendars and repos have APIs. The open web mostly doesn’t. The TinyFish MCP server gives any MCP client four tools: TinySearch, TinyFetch (full pages as markdown, JavaScript included), TinyBrowser for logins and forms, and TinyAgent for multi-step jobs. Search and Fetch are free.
The post Perplexity AI Releases pplx-embed-v2-late: A 0.6B Edge Model and a 9B Model Scoring 92.4% on MADQA appeared first on MarkTechPost.