It’s the angle of your finger. If it tilts outward away from you, try angling your finger inward from you, if it tilts inward do the opposite.
If it’s confusing, do a trapeze, then move one hand forward and the other backward, the yoyo will tilt. Now remember which way tilt where, it’s the same for grinds.