I don't think it's your palette that's weird. I think that venison that was treated properly from the time it was killed has no harsh or "gamey" taste. That's my experience with venison.
Depends on what that deer has been eating. Deer around my old home town taste harsh...they eat primarily sagebrush...those from the mountains are much better tasting.