lucidrains/enformer-pytorch
Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch
PythonMIT
Issues
- 1
OOM after consecutive forward passes
#47 opened by Andrei-Aksionov - 23
Training process
#28 opened by maksimallist - 0
- 2
AssertionError: if using tf gamma, only sequence length of 1536 allowed for now
#40 opened by jerome-f - 6
metric for enformer
#9 opened by Rachel66666 - 4
Correlation Coefficient Calculation
#36 opened by adamcatto - 3
example data files
#7 opened by yingyuan830 - 1
minor question on extract sequence embeddings
#39 opened by Azai-yx - 0
Is there a recommended approach to extract embeddings for the starting and ending regions?
#43 opened by santule - 5
Computing Contribution Scores
#13 opened by Prakash2403 - 0
- 0
How to retreive the sequence of genes?
#38 opened by HelloWorldLTY - 0
- 1
- 14
Hard coded input sequence length to the transformer blocks with using use_tf_gamma = True
#32 opened by zhhhhahahaha - 2
Gradient checkpoint
#33 opened by fransilvionGenomica - 6
Rounding errors in the positional encodings
#31 opened by johahi - 4
Would using FlashAttention(2) help?
#30 opened by jmschrei - 0
Fail to read .bed file
#29 opened by kchl5 - 1
GenomeIntervalDataset problems
#26 opened by tcztzy - 3
- 2
CUDA out of memory in unexpected cases
#24 opened by havu73 - 3
rounding errors fixed?
#17 opened by mepster - 27
- 5
Distribution of embedding values
#18 opened by sofroniewn - 3
- 1
- 3
Error in fine-tuning
#20 opened by joonan30 - 2
Minor typo in data.py
#19 opened by icdh99 - 4
Using EleutherAI/enformer-official-rough PyTorch implementation to just get human output head
#15 opened by aaronwtr - 2
Minor potential typo in `FastaInterval` class
#14 opened by sofroniewn - 0
Models in training splits
#12 opened by luciabarb - 1
enformer TF pretrained weights
#11 opened by naumanjaved - 1
AttentionPool bug?
#10 opened by cmlakhan - 1
error loading enformer package
#8 opened by cmlakhan - 2
Why do we need Residual here while we have residual connection inside conv block
#6 opened by inspirit - 2
How to load the pre-trained Enfromer model?
#3 opened by yzJiang9