DeepSeek Open Source Week Day Two: Open Source EP Communication Library
25/02/2025
GMT Eight
DeepSeek officially announced the open sourcing of DeepEP today, the first open source EP communication library for training and inference with MoE models. Its features include efficient, optimized communication for all nodes; support for NVLink and RDMA both within and between nodes; high throughput kernels for training and inference pre-filling; low latency kernels for inference decoding; native FP8 scheduling support; flexible GPU resource control for achieving computation-communication overlap.
On February 24th, DeepSeek launched "Open Source Week" and open sourced the first code library, FlashMLA. Prior to this, on February 21st, DeepSeek posted on social media that they had formed a small team to explore AGI (Artificial General Intelligence) and would be open sourcing 5 code libraries to transparently share research progress.