{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang

"Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics" by Wuyang Chen, Xinyu Gong, Yunchao Wei, Humphrey Shi, Zhicheng Yan, Yi Yang, and Zhangyang Wang

Neural Tangent Kernel (NTK) module for the scikit-learn library

[IEEE S&P 2024] Exploring the Orthogonality and Linearity of Backdoor Attacks

Convolutions and more as einsum for PyTorch

A Python implementation of the Neural Tangent Kernel (jacot et al, 2018)

Infinite-width neural networks from a practical point of view

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

Empirical analysis of the Laplace and neural tangent kernel reproducing kernel Hilbert space (RKHS)

A collection of papers & notes in deep learning and database.

My assignments of the Natural Language Processing Specialization provided by DeepLearning.AI

NTK 2024 demos and additional information

Code used for the paper "Valuation of Variable Annuity Portfolios using Finite and Infinite Width Neural Networks".