Convexifying Neural Networks

Validation loss of SGD-trained networks compared with the convex-program optimum

Implemented the exact convex reformulation of two-layer ReLU network training, whose solution yields a globally optimal network, and compared it against networks trained with SGD.

All research