[jcattle]

Yes, the mass and you distance to it counts. And one of the biggest influences on that mass in absolute terms is earths very dense inner and outer cores.

Due to the "equatorial bulge" (actual term) you are further away from that heavy center, than at the equator. And due to the inverse square law, you lose intensity of that gravitational force very quickly, the further you are away.

Hence: the smallest gravitational force you get is on a mountain in the Andes near the equator.