Icarus
by Javier Ideami
Title
Icarus
Artist
Javier Ideami
Medium
Digital Art - Digital
Description
Top view of the middle stages of a training process that connects two minima. Mode Connectivity. Optima of complex loss functions connected by simple curves over which training and test accuracy are nearly constant. Visualization data generated through a collaboration between Pavel Izmailov (@Pavel_Izmailov), Timur Garipov (@tim_garipov) and Javier Ideami (@ideami). Based on the NeurIPS 2018 paper by Timur Garipov, Pavel Izmailov, Dmitrii Podoprikhin, Dmitry Vetrov, Andrew Gordon Wilson: https://arxiv.org/abs/1802.10026 | Creative visualization and artwork produced by Javier Ideami.
Real data, resnet-20 no-skip, cifar10, sgd-mom, bs=128, wd=3e-4, mom=0.9, bn, train mod, 90k pts. log scaled (orig loss nums).
This piece has been created through a multi day process composed of different stages that begin with the training of deep learning neural networks and proceeds through a number of phases until arriving to the final artwork.
Final artwork created by Javier Ideami.
For more about the Loss Landscape project visit losslandscape.com
Uploaded
November 9th, 2019
Statistics
Viewed 423 Times - Last Visitor from Wilmington, DE on 04/18/2024 at 5:31 PM
Embed
Share
Sales Sheet
Comments
There are no comments for Icarus. Click here to post the first comment.