1.) New categories of gems that add new abilities or modify your character in some unique way. I personally think these gems should be drops, but there are a lot of ways you could handle this, I suppose.
2.) more gem slots, and in more gear. I think it's too small as is, and I feel like if you open this up more, you could seriously expand on the customization if you integrate idea 1.