ds4

核心特点

• •Metal, the primary target, on Macs with 96 GB or more. Smaller machines
• •ROCm on Strix Halo systems such as the Framework Desktop.
• •You can also use pipeline paralellism to glue together multiple systems to sum their RAM and run larger models.
• •Capable open-weight models now fit on high-end personal machines.
• •DeepSeek V4 Flash and PRO, GLM 5.2, tolerate aggressive routed-expert quantization.
• •Compressed KV caches and fast local SSDs make long contexts practical.
• •The idea of an inference system specialized for a few models.
• •Models and vision: Flash, PRO, GLM, and matching encoders.
• •SSD streaming: run larger than RAM and size the cache.
• •Inference across machines: two-Mac TP/RDMA and layer pipelines.