We examine the single-item lot-sizing problem with Wagner-Whitin costs over an n period horizon, i.e. Pt + ht ≥ Pt+l for t = 1, ... , n - 1, where Pt, ht are the unit production and storage costs in period t respectively, so it always pays to produce as late as possible. We describe integral polyhedra whose solution as linear programs solve the uncapacitated problem (ULS), the uncapacitated problem with backlogging (BLS), the uncapacitated problem with start-up costs (ULSS) and the constant capacity problem (eLS), respectively. The polyhedra, extended formulations and separation algorithms are much simpler than in the general cost case. In particular for models (ULS) and (ULSS) the polyhedra in the original space have only O(n2 ) facets as opposed to O(2n) in the general case. For (eLS) and (BLS) no explicit polyhedral descriptions are known for the general case in the original space. Here we exhibit polyhedra with O(2n) facets having an O(n2 Iogn) separation algorithm for (eLS) and O(n3 ) for (BLS), as well as extended formulations with O(n2 ) constraints in both cases, O(n2 ) variables for (eLS) and O(n) variables for (BLS).