SHI-Labs/NATTEN

Issues

• RuntimeError: Expected bias.shape[0] == heads.

  #141 opened 4 days ago by justin4ai
  7

• Natten 0.17.0 on MBP M1 Silicon

  #140 opened 8 days ago by MrSutsuj
  1

• Auto-tuner Backwards when not using backwards

  #137 opened 9 days ago by stevenwalton
  2

• Question: What are some recommended better alternatives for RBP ?

  #139 opened 9 days ago by fzimmermann89
  1

• Set different window sizes and dilations for different tokens

  #136 opened 10 days ago by ChenyiZhang007
  1

• Natten package installation error with H100

  #135 opened 13 days ago by justin4ai
  3

• install error from source?

  #134 opened 15 days ago by TongkunGuan
  6

• low version (<=0.14.6) not support large kernel size?

  #133 opened 15 days ago by TongkunGuan
  1

• Support torch.compile

  #89 opened 5 months ago by alihassanijr
  7

• fused extra kv?

  #132 opened 23 days ago by Xynonners
  1

• Arbitrary masks

  #124 opened a month ago by Birch-san
  19

• Failed to install natten on Python 3.9（Windows）

  #127 opened a month ago by QiumanZeng
  4

• Inverted register attention

  #131 opened a month ago by Xynonners
  2

• Deprecation warnings not ignore-able?

  #130 opened 25 days ago by drscotthawley
  5

• Inquiry about NATTEN Compatibility with New Google Colab Version

  #73 opened 6 months ago by Miiitiii
  5

• TypeError: unsupported operand type(s) for |: '_GenericAlias' and '_GenericAlias'

  #128 opened a month ago by JiyeongCha
  3

• Registers, self-cross attention

  #82 opened 3 months ago by Birch-san
  24

• MPS support

  #102 opened 4 months ago by ronensession
  2

• RuntimeError: Input axes must be less than or equal to the product of kernel size and dilation.

  #122 opened a month ago by allen89268
  1

• Issues with the docker installation

  #108 opened 2 months ago by KhrulkovV
  10

• macOS install issue: ModuleNotFoundError: No module named 'torch'

  #90 opened 5 months ago by jgrahamcracker
  21

• Grouped Query Attention without repeat()

  #92 opened 5 months ago by Birch-san
  15

• Performance compared to local-attention + masking

  #120 opened 2 months ago by Chillee
  9

• Separate arguments for query and key

  #61 opened 6 months ago by Daniel63656
  11

• Torch atomicAdd in RPB backward FP16 kernel can fail

  #97 opened 3 months ago by alihassanijr
  3

• What casting do we need to do to make `natten2dav` accept the same inputs we gave it in previous versions?

  #93 opened 3 months ago by Birch-san
  5

• installing bug

  #98 opened 3 months ago by ULTA-Web
  4

• Memory bottleneck of NATTEN

  #69 opened 3 months ago by confucianism72
  3

• Failed to install natten on Python 3.12

  #104 opened 4 months ago by wencan
  3

• Your installed Caffe2 version uses CUDA but I cannot find the CUDA

  #103 opened 4 months ago by wencan
  2

• ModuleNotFoundError: No module named 'torch._C'

  #99 opened 4 months ago by drscotthawley
  7

• XLA support

  #101 opened 4 months ago by nom
  1

• NeighborhoodAttention3D

  #65 opened 5 months ago by glq-1992
  8

• FVCore flop counter ignores additional KV

  #95 opened 4 months ago by alihassanijr
  0

• Using NeighborhoodAttention2D In YOLO

  #84 opened 5 months ago by KulikDM
  2

• Linux installation error: Python launch failed.

  #88 opened 5 months ago by Eddie-yz
  2

• Forward mode autodiff support

  #68 opened 5 months ago by crowsonkb
  13

• The kernel size of 2d NATTEN

  #77 opened 5 months ago by RayTan183
  9

• Ubuntu 22.04, Nvidia 4090 Problem to setup

  #75 opened 5 months ago by unicoco7
  6

• Building from sources

  #64 opened 6 months ago by Daniel63656
  8

• build error

  #78 opened 5 months ago by dengxl0520
  2

• How to install the Natten 3D ?

  #79 opened 5 months ago by RayTan183
  1

• Nested tensors

  #72 opened 6 months ago by Birch-san
  6

• AttributeError

  #70 opened 6 months ago by Z-2148
  5

• see #70 AttributeError

  #71 opened 6 months ago by Z-2148
  1

• How to do full attention on one dimension, while neighbor Attention on another 2 dimensions?

  #67 opened 7 months ago by confucianism72
  8

• SSL Certificate expired

  #66 opened 7 months ago by Daniel63656
  8

• Pure pytorch version

  #60 opened 7 months ago by KexianShen
  1

• Can't use kernel sizes bigger than 13

  #63 opened 7 months ago by Daniel63656
  0

• Using attention as prediction

  #62 opened 7 months ago by Daniel63656
  0