Mastodon

Model Generalization

Model Generalization: A Sharpness Aware Optimization Perspective

This project investigates the effects of Sharpness-Aware Minimization (SAM) and Adaptive Sharpness-Aware Minimization (ASAM) on model generalization. Our experiments demonstrate that sharpness-aware optimization techniques notably enhance generalization abilities. Notably, ASAM shows promise in improving performance on un-normalized data.