You didn't say at what distance you are shooting. Distance will have a major effect of POI.
I shoot most of my SD guns at 30-50' figuring that is most likely the distance they will be needed. Personally I like my guns to have a POA just below the POI as it allows me to see the intended target better. All my "target guns" have their sights set to allow me to see the entire black of a standard bullseye target as opposed to covering half of it with the front sight.
Assuming you are shooting at say 30', why worry about having the sights align perfectly POA=POI?
BTW increasing the wt. of the bullet usually results in a higher POI at 50'.