Kevin Di's Highlights on 'Nvidia Blackwell Perf TCO Analysis - B100 vs B200 vs GB200NVL72'

Mooncake (1): 在月之暗面做月饼，Kimi 以 KVCache 为中心的分离式推理架构

zhuanlan.zhihu.com/p/705754254

Jul 12, 2024

‌‌⁡‬⁤‍⁤⁡⁤‍⁤⁡‍‌⁢‬⁣‌⁡⁢⁢⁤⁢⁢‌‬⁢‌⁣‍‌⁢⁡⁢⁡⁤‍‍AI Inference — 从前沿技术到商业化实操观察 (社区版） - 飞书云文档

miracleplus.feishu.cn/docx/Lqe1dgVTho0vEVxZqLZcFpmgnkb

Jul 10, 2024

From bare metal to a 70B model: infrastructure set-up and scripts

imbue.com/research/70b-infrastructure/

Jul 3, 2024

星融元针对LLM大模型承载网发布星智AI网络解决方案

asterfusion.com/a20240205-ai-llm-solution/

Jun 13, 2024

云原生机器学习平台技术综述（编排调度篇）-来也科技

laiye.com/news/post/2627.html

May 20, 2024

DeepSpeed/blogs/deepspeed-fastgen/2024-01-19 at master · microsoft/DeepSpeed

github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-fastgen/chinese

May 20, 2024

Nvidia Blackwell Perf TCO Analysis - B100 vs B200 vs GB200NVL72

www.semianalysis.com/p/nvidia-blackwell-perf-tco-analysis

May 11, 2024

在生产环境中的OpenStack上运行Kubernetes集群 - 墨天轮

www.modb.pro/db/47575

May 9, 2024

OpenStack与K8s的关系 OpenStack与Kubernetes（K8s）的区别

www.usa-idc.com/news/idc/2023071414.shtml

May 9, 2024

Intel Introduces Gaudi 3 AI Accelerator: Going Bigger and Aiming Higher In AI Market

www.anandtech.com/show/21342/intel-introduces-gaudi-3-accelerator-going-bigger-and-aiming-higher

Apr 10, 2024

英伟达GB200架构解析：互联架构和未来演进-电子工程专辑

www.eet-china.com/mp/a301182.html

Apr 8, 2024

暴力美学的优雅化——NVidia的Rack Scale

zhuanlan.zhihu.com/p/689424234

Apr 8, 2024

英伟达AI芯片路线图分析与解读

wallstreetcn.com/articles/3712058

Apr 7, 2024

GPT-4 “炼丹”指南：MoE、参数量、训练成本和推理的秘密

www.aixinzhijie.com/article/6825966

Apr 2, 2024

英伟达 A100知识分享 GPU 板组单机价值量 1.2 万

www.jaeaiot.com/news/detail/32.html

Feb 22, 2024

SemiAnalysis | Dylan Patel | Substack

www.semianalysis.com/p/groq-inference-tokenomics-speed-but?utm_source=post-email-title&publication_id=329241&post_id=141888751&utm_campaign=email-post-title&isFreemail=true&r=b0aiz&utm_medium=email