Hard to insure drivers include people with poor driving records and often people who are young or have little driving experience, where statistics show that these people have high probability of being involved in future accidents.
Another category of hard to insure drivers are people with very high-powered and/or expensive autos (there are some insurance companies who specialize in this market, particularly for people with good driving records.)