Try placing your finger on the trigger shoe in different spots from tip to the first joint, usually you will push or pull the p.o.i. depending on the position. Find the happy spot.
Another thing could be rifle cant, have someone stand behind you to see if the rifle is level. Raising or lowering your trigger hand elbow can change the cant and move p.o.i. GG