If you say something unpleasant to someone's face, you say it to them directly, when you are together.

If you've got something to say, say it to my face. 你要是有什么要说的，就当着我的面说。