Those who are different - are they doing this deliberately to rebel against the norm or is it cultural expectations that make them different? What reaction is there to their differences from those around them?
Within your world setting, are there different cultures, faiths etc and if so how do these get along (well or not at all?!)? Explore the differences. Explore how they would affect how your characters act and react.
Hope you find some story ideas in answering those!