I have seen many a model card claim Spark compatibility, but without any proof or instructions. There are vibe-patched images of vLLM that kinda works with NVFP4 models, but I have not seen any support from NVIDIA. Does not seem to be a priority for some reason.

Thanks, I've been mulling over buying some of these so I appreciate the heads up.

After thrashing on it for a day, I could not get it going on DGX Spark with FP4 quantization. I find this irksome, since Nvidia created the NVFP4 specifically for Blackwell. The Nvidia cookbooks for this model are all for H100. I tried vLLM, Ollama and various patches. As of right now on DGX: you can feasibly do FP4 on dense models. But FP4 + MoE is a largely a dead-end.