GitHunt
EL

elliotwaite/softmax-logit-paths

Plots how the logit values that are passed into the softmax function change over time as the model is trained.

Softmax Logit Paths Visualised

Use main.py to visualize how the logit values that are passed into the softmax function change over time as the model is trained with SGD (stochastic gradient descent) or the Adam optimizer.

This code if from my YouTube video:

Softmax Function Explained In Depth with 3D Visuals

https://youtu.be/ytbYRIN0N4g

Languages

Python100.0%

Contributors

MIT License
Created August 23, 2020
Updated July 18, 2025
elliotwaite/softmax-logit-paths | GitHunt