Was a very small allen set screw.
Have an early K9 with "old" style sights.
How is the rear sight removed?
There appears to be a set screw in the center of the rear sight, but no tools I have will fit.
Sight on Kahr's webpage seem to no longer be of this design.