Table 5. Local attention. hBehaveMAE benefits from local attention in its lower blocks. F1 scores are obtained from best block (green: 1st; blue: 3rd).
From: Elucidating the Hierarchical Nature of Behavior with Masked Autoencoders
Att./block | Moveme | Action | Activity |
|---|---|---|---|
Loc-Loc-Loc |
|
|
|
Loc-Loc-Glob |
|
|
|
Loc-Glob-Glob |
|
|
|
Glob-Glob-Glob |
|
|
|
