The mechanism by which light is emitted from plasmonic metals such as gold and silver has been contentious, particularly at photon energies below direct interband transitions. Using nanoscale plasmonic cavities, blue-pumped light emission is found to directly track dark-field scattering on individual nanoconstructs. By exploiting slow atomic-scale restructuring of the nanocavity facets to spectrally tune the dominant gap plasmons, this correlation can be measured from 600 to 900 nm in gold, silver, and mixed constructs ranging from spherical to cube nanoparticles-on-mirror. We show that prompt electronic Raman scattering is responsible and confirm that “photoluminescence”, which implies phase and energy relaxation, is not the right description. Our model suggests how to maximize light emission from metals.