Mode Connectivity
by Javier Ideami
Title
Mode Connectivity
Artist
Javier Ideami
Medium
Digital Art - Digital
Description
Mode Connectivity. Optima of complex loss functions connected by simple curves over which training and test accuracy are nearly constant. Visualization data generated through a collaboration between Pavel Izmailov (@Pavel_Izmailov), Timur Garipov (@tim_garipov) and Javier Ideami (@ideami). Based on the NeurIPS 2018 paper by Timur Garipov, Pavel Izmailov, Dmitrii Podoprikhin, Dmitry Vetrov, Andrew Gordon Wilson: https://arxiv.org/abs/1802.10026 | Creative visualization and artwork produced by Javier Ideami.
Real data, resnet-20 no-skip, cifar10, sgd-mom, bs=128wd=3e-4, mom=0.9, bn, train mod, 90k pts. log scaled (orig loss nums)
This piece has been created through a multi day process composed of different stages that begin with the training of deep learning neural networks and proceeds through a number of phases until arriving to the final artwork.
Final artwork created by Javier Ideami.
For more about the Loss Landscape project visit https://losslandscape.com
Uploaded
November 5th, 2019
Statistics
Viewed 490 Times - Last Visitor from New York, NY on 04/23/2024 at 12:32 PM
Embed
Share
Sales Sheet
Comments
There are no comments for Mode Connectivity. Click here to post the first comment.