I think a mathematician would suggest it should be 'you and only you pass me'. Without that, the passer could be part of a group who passes the passee and the place of the passer (& passee) is not determinable, even though 'you pass me' remains true.