Quantized model inference
Around 200B parameters
According to NVIDIA's published guidance, DGX Spark can serve as a reference platform for quantized inference at this scale. Actual resource requirements depend on the model format, quantization level and inference framework.
Use this as a guide when evaluating an experiment, not as a guarantee that every 200B model will run with the same configuration.