The framework integrates high-performance operators and an optimized inference engine, supporting distributed inference, speculative decoding, and structured output, while being compatible with NVIDIA and Huawei Ascend platforms. DeepSeek also open-sourced the production-grade token encoding and decoding component, deepseek-recipe.