DEV Community

Deep Learning

This tag is for discussing, sharing articles, and asking questions primarily on deep learning - a subfield of machine learning.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How Open-Source LLMs Differ: Comparing 130+ Model Architectures

How Open-Source LLMs Differ: Comparing 130+ Model Architectures

5
Comments
7 min read
Copying without attention: Fourier readout of a fixed-size wave memory

Copying without attention: Fourier readout of a fixed-size wave memory

Comments
22 min read
Why Do AI Models Need High-Dimensional Embeddings?

Why Do AI Models Need High-Dimensional Embeddings?

3
Comments
2 min read
Beyond Static Layers: The Architecture of Mixture-of-Depths (MoD)

Beyond Static Layers: The Architecture of Mixture-of-Depths (MoD)

Comments
2 min read
SinkState: Scaling Hybrid LLMs with On-the-Fly SVD and Adaptive Low-Rank States

SinkState: Scaling Hybrid LLMs with On-the-Fly SVD and Adaptive Low-Rank States

Comments
5 min read
Building Road Infrastructure Digital Twins with Computer Vision & Deep Learning

Building Road Infrastructure Digital Twins with Computer Vision & Deep Learning

Comments
3 min read
My depth model was obsessed with the sky. Here's how I made it care about cars.

My depth model was obsessed with the sky. Here's how I made it care about cars.

1
Comments
5 min read
FlashAttention: Why Tiling Attention Makes Transformers Fast Without Changing the Result

FlashAttention: Why Tiling Attention Makes Transformers Fast Without Changing the Result

Comments
11 min read
Reverse-Engineering the Black Box: The Science of Mechanistic Interpretability

Reverse-Engineering the Black Box: The Science of Mechanistic Interpretability

Comments
3 min read
Praxis-1: How Runway Turned a Video Foundation Model Into a Robot Brain

Praxis-1: How Runway Turned a Video Foundation Model Into a Robot Brain

Comments
5 min read
From Lab to Code #4: Exploring Neural Network Efficiency with Python and PyTorch

From Lab to Code #4: Exploring Neural Network Efficiency with Python and PyTorch

Comments
12 min read
Batch normalization, visually: the reset that keeps deep networks steady

Batch normalization, visually: the reset that keeps deep networks steady

Comments
5 min read
From Attention to 3-Bit Caches: How LLMs Learned to Remember Less (MHA, GQA, MLA, MoE, Quantisation Explained)

From Attention to 3-Bit Caches: How LLMs Learned to Remember Less (MHA, GQA, MLA, MoE, Quantisation Explained)

7
Comments 1
22 min read
The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

Comments
3 min read
Deep Learning vs Machine Learning: Which Does Your Project Actually Need?

Deep Learning vs Machine Learning: Which Does Your Project Actually Need?

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.