Nonlinear electrical response permits a unique window into effects of band structure geometry. It can be calculated either starting from a Boltzmann approach for small frequencies, or using Kubo's formula for resonances at finite frequency. However, a precise connection between both approaches has not been established. Focusing on the second order nonlinear response, here we show how the semiclassical limit can be recovered from perturbation theory in the velocity gauge, provided that finite quasiparticle lifetimes are taken into account. We find that matrix elements related to the band geometry combine in this limit to produce the semiclassical nonlinear conductivity. We demonstrate the power of the new formalism by deriving a quantum contribution to the nonlinear conductivity which is of order τ−1 in the relaxation time τ, which is principally inaccessible within the Boltzmann approach. We outline which steps can be generalized to higher orders in the applied perturbation, and comment about potential experimental signatures of our results.