Shape and dimensions are my main concern. Most factory grips do okay. Wood, Stag, even plastic, are fine as long as they fit me.
Although I tolerate them, rosewood or laminated grips are an eyesore to me. Walnut is my preference, as well as some exotic woods, such as ebony. I also do quite okay with faux ivory when I'm doing plastic.