If something counts/goes/works against you, it gives you a disadvantage.

Lack of experience will generally count against you in an interview. 一般而言，缺乏工作经验会成为面试的不利因素。

Some of the referee's decisions went against us in that game.

He believes that several of the organization's procedures worked against him.

When applying for jobs, she eventually realized that her experience in other fields was working against her.

School staff knew that high truancy rates would count against them.

See also: against (OPPOSING)