Soil degradation is a major threat to Southern Africa's agricultural production. Crops show generally weak responses to mineral fertilizers on degraded soils. A three-year study was conducted between 2009 and 2012 on smallholder farms in eastern Zimbabwe to explore entry points for rehabilitating degraded croplands using principles of integrated soil fertility management (ISFM) supported through farmers' local knowledge of soils. Participatory research approaches were first used to investigate farmers' understanding of soil degradation and the commonly used local diagnostic indicators. Farmers' determinants of degraded soils centered on crop performance, indicator weed species and soil physical attributes, and matched laboratory parameters. Overall, physical and chemical properties of the degraded soils were significantly lower than reported values for productive sandy soils in Zimbabwe. Evaluated on ten degraded field sites of corresponding catenary positions and similar slope, the main ISFM options involved nitrogen-fixing herbaceous legumes planted in the first year, with subsequent addition of cattle manure in the second year. In the third year, the influence of the ISFM options on maize productivity and changes in soil biological activity were then evaluated. Phosphorus was applied every year under each sequence. The controls were natural fallow and continuous maize.