Optimizing Deep Learning Models with Memory-Limited Layers

Zig: The Future Replacement for C

"Choosing and Comparing Network Architectures for Smart Computing Centers: Optimizing End-to-End Communication Latency"

"Revisiting the Performance of BR100 by Duobi Tech and the Long-Awaited Intel APX"

The Synergy of Language Modeling Techniques and Memory Architectural Advancements

The Future of AI Chips: Insights from Google TPU v4

太卷了！关于大模型和AIGC的36条笔记和真话，以及NLP（十八）：LLM 的推理优化技术纵览

The HBM Race: Advancements in High-Bandwidth Memory Technology and the Future of AI Accelerator Designs

"TPUv5e: The New Benchmark in Cost-Efficient Inference and Training for <200B Parameter Models" + "别再「浪费」GPU了，FlashAttention重磅升级，实现长文本推理速度8倍提升"

Exploring AI Accelerator Design: From Market Analysis to Architectural Considerations

"The History of Open-Source LLMs: Early Days (Part One)" explores the development of open-source LLMs and their significance in the field of natural language processing. One such example is the ROOTS corpus, a dataset created specifically for training BLOOM. This corpus consists of 498 HuggingFace datasets, containing a massive 1.6 terabytes of text. Remarkably, it covers 46 natural languages and 13 programming languages, making it a versatile resource for language modeling.

The Intersection of AI Accelerator Design and PyTorch 2.0: Exploring Market Potential and Technical Challenges

The Battle of Chip Giants: Hotchips Showcases Innovations in Computing Power and Memory Optimization

The Future of AI Chips: Insights from Google TPU v4 and Decoding the US Chip Blockade against China

"Insights into Inference Techniques for Language Models"

The Illustrated GPT-2: Visualizing Transformer Language Models and Best Practices for Building and Deploying Recommender Systems

Exploring the Intersection of AI and GPU Communication Technologies

The Battle of GPU Architectures: Exploring the H100 and the Rise of HBM