Gum Tree Lodge Hostel in Kimberley Excellent. Very friendly managers. There is a good value restaurant that is handy. It's 5 km from town but that's ok if you have a car. It's quite an experience to stay in a former convict station (nice colonial-style compound) of the De Beers mine.
Augrabies Falls Backpackers in Augrabies Falls Really excellent. remote, rustic, and cool after the desert heat.
Hostelz.com is the only hostel guide with complete information and reviews on all youth hostels and backpackers worldwide.