research papers regarding AI.
- https://arxiv.org/ftp/arxiv/papers/2304/2304.01433.pdf tpuv4
- https://arxiv.org/pdf/1912.08968.pdf slimfly
- https://www.researchgate.net/publication/337861594_Efficient_MPI-AllReduce_for_large-scale_deep_learning_on_GPU-clusters efficient ampi all reduce
- http://cva.stanford.edu/publications/2007/ISCA_FBFLY.pdf flattened butterfly
- https://arxiv.org/pdf/2209.01346.pdf hamming mesh
- https://my.eng.utah.edu/~cs6810/HyperX-SC09.pdf hyperx topology
- https://dl.acm.org/doi/10.1145/3295500.3356140 hyperx vs fat tree at scale
- https://arxiv.org/pdf/2307.12169.pdf rail optimized network
- https://arxiv.org/pdf/2202.03356.pdf direct connect topologies
- https://www.nature.com/articles/s41566-023-01244-7
- https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10124987
- route packets not wires - https://liacs.leidenuniv.nl/~stefanovtp/courses/StudentenSeminarium/Papers/DT/RPNW.pdf
- https://arxiv.org/pdf/2305.10601.pdf tree of thought
- https://arxiv.org/abs/2302.04761 toolformer
- https://arxiv.org/pdf/2201.05596.pdf advancing MOE inference
- https://arxiv.org/pdf/2211.15841.pdf megablocks advancing moe experts
- https://arxiv.org/abs/2303.11366 Reflexion paper
- https://arxiv.org/pdf/2308.00852.pdf
- https://arxiv.org/pdf/2006.16668.pdf gshard all to all moe
- https://arxiv.org/abs/2101.03961 switch transformers
- https://royalsocietypublishing.org/doi/pdf/10.1098/rstb.2019.0319
- https://www.researchgate.net/publication/312058510_Network_Analyses_and_Nervous_System_Disorders interesting relating to network mapping on brain
- https://www.researchgate.net/publication/45929238_Prediction/
- https://www.jneurosci.org/content/jneuro/36/48/12083.full.pdf segregation of brain and networking in context to cognition