DEV Community

Henri Wang profile picture

Henri Wang

404 bio not found

Joined Joined on 
What is KoLeo regularizer doing in DINOv2？
henri_wang_d48b1e9bc1ea79 profile

What is KoLeo regularizer doing in DINOv2？

Comments
2 min read
Since i know how DINO loss works, i want to know how iBOT does its job.
henri_wang_d48b1e9bc1ea79 profile

Since i know how DINO loss works, i want to know how iBOT does its job.

Comments
5 min read
How is [CLS] token assumed to carry global information during training?
henri_wang_d48b1e9bc1ea79 profile

How is [CLS] token assumed to carry global information during training?

Comments
3 min read
Does DINO loss compare the [CLS] tokens from both teacher and student?
henri_wang_d48b1e9bc1ea79 profile

Does DINO loss compare the [CLS] tokens from both teacher and student?

#machinelearning #deeplearning #computervision
Comments
1 min read
why similar smooth gradient in all images indicate strong covariance? and how strong covariance is related to high variance?
henri_wang_d48b1e9bc1ea79 profile

why similar smooth gradient in all images indicate strong covariance? and how strong covariance is related to high variance?

Comments
5 min read
Why Top PCA Components in Images Carry Semantic Meaning
henri_wang_d48b1e9bc1ea79 profile

Why Top PCA Components in Images Carry Semantic Meaning

Comments
2 min read
why larger eigenval indicates more variance?
henri_wang_d48b1e9bc1ea79 profile

why larger eigenval indicates more variance?

Comments
3 min read
expand the cov matrix multiplication pixelwise to have a better intuition
henri_wang_d48b1e9bc1ea79 profile

expand the cov matrix multiplication pixelwise to have a better intuition

Comments
1 min read
how can I compute PCA between different images, tell me its mathematics.
henri_wang_d48b1e9bc1ea79 profile

how can I compute PCA between different images, tell me its mathematics.

Comments
3 min read
in DINO, how does [CLS] token get to gather global information, unlike other patches, though under same attention mechanism?
henri_wang_d48b1e9bc1ea79 profile

in DINO, how does [CLS] token get to gather global information, unlike other patches, though under same attention mechanism?

Comments
2 min read
in DINO, how does knowledge distillation such as teacher vs. student help learn the general visual features of the images?
henri_wang_d48b1e9bc1ea79 profile

in DINO, how does knowledge distillation such as teacher vs. student help learn the general visual features of the images?

Comments
2 min read
in which aspects does DINOv2 improve DINO?
henri_wang_d48b1e9bc1ea79 profile

in which aspects does DINOv2 improve DINO?

Comments
2 min read
what is the mathematical realization of attention maps from multiple heads?
henri_wang_d48b1e9bc1ea79 profile

what is the mathematical realization of attention maps from multiple heads?

Comments
3 min read
two forms of positional embedding return
henri_wang_d48b1e9bc1ea79 profile

two forms of positional embedding return

Comments
2 min read
Customize dataset so that Dataloader can apply...
henri_wang_d48b1e9bc1ea79 profile

Customize dataset so that Dataloader can apply...

Comments
2 min read
loading...