I have a feeling I will come back with more after you have answered a couple of the inquiries again. For now:

seconding the suggestion of Pulp - Different Class or the newest retrospective (Hits)
PJ Harvey - Stories from the City, Stories from the Sea (not necessarily her best, but her most immediately accessible, and pretty much required for anyone with a Patti Smith icon)
Belle and Sebastian - either If You're Feeling Sinister or Fold Your Hands Child, You Walk Like A Peasant
Elliott Smith - XO