{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang

[Oakland 2024] Exploring the Orthogonality and Linearity of Backdoor Attacks

"Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics" by Wuyang Chen, Xinyu Gong, Yunchao Wei, Humphrey Shi, Zhicheng Yan, Yi Yang, and Zhangyang Wang

Neural Tangent Kernel (NTK) module for the scikit-learn library

Convolutions and more as einsum for PyTorch

A Python implementation of the Neural Tangent Kernel (jacot et al, 2018)

[Neurips 2022] "Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis" by Wuyang Chen*, Wei Huang*, Xinyu Gong, Boris Hanin, Zhangyang Wang

NTK Ultra-Compression est un logiciel de compression de fichiers qui vise à réduire au maximum la taille des fichiers indépendamment du temps.

Infinite-width neural networks from a practical point of view

Empirical analysis of the Laplace and neural tangent kernel reproducing kernel Hilbert space (RKHS)

A collection of papers & notes in deep learning and database.

Code used for the paper "Valuation of Variable Annuity Portfolios using Finite and Infinite Width Neural Networks".

A JAX+EQUINOX implementation of NTK and NNGP calculations as https://github.com/google/neural-tangents was archived while still buggy

Quantum Banking System combines cutting-edge AI technology with modern banking features to provide an unparalleled financial management experience.

NTK 2024 demos and additional information

DineSense is an AI-powered sentiment analysis web app that predicts whether restaurant reviews are positive or negative using NLP and machine learning.

My assignments of the Natural Language Processing Specialization provided by DeepLearning.AI

RoPE Playground – Rotary Positional Embeddings in PyTorch