Yes, by adding a custom field to the taxonomy with the type image. Locations by default include this image field, other taxonomies do not.
Tag: taxonomies
Can I use categories associated with another post type, such as blog posts, for my directory?
This is not currently possible.