Chatsworth CC site is nice. It's in what was a walled garden and you can walk out of the gate from the site into the grounds of Chatsworth estate. The gardens of the house are lovely, and there is some excellent cafes and a restaurant in the stables. Nearby you have Bakewell, Buxton and Matlock and all the attractions of the Peak District, including several very nice National Trust properties.

It's closed for refurbishment until 30th June though.
Clumber Park is also a very nice CC site. Lovely peaceful location, spacious pitches, nice helpful wardens, good facilities. But I am not sure what there is to do in the locality (we went on bike rides but that might not be what you had in mind

)