Intermediate mass black holes as targets for dark matter searches