The convergence of finite element methods for elliptic and parabolic partial differential equations is well-established if source terms are sufficiently smooth. Noting that finite element computation is easily implemented even when the source terms are measure-valued—for instance, modeling point sources by Dirac delta distributions—we prove new convergence order results in two and three dimensions both for elliptic and for parabolic equations with measures as source terms. These analytical results are confirmed by numerical tests using COMSOL Multiphysics.