Jaffrey, NH is a jewel of a community: quiet and uncrowded, but with great sightseeing, hiking, swimming and water activities all around. The clean air, hilly trails with unexpected vistas, wild berries (and animals too) all have made this property a restorative place for me.
When I need more civilization, the restaurants in town are good, and both Keene and Peterborough, among other communities, are charming villages for shopping, antiquing, and excellent dining. There are many opportunities to explore other interests -- golf, horseback riding, farm tours, fruit picking, glass blowing, hiking (for an easier hike than Monadnock, try Gap Mountain), ice cream (Kimballs is great), theater (check out Peterborough Players), and on and on.