Someone turning their head and looking at you might represent the idea of that person focusing attention on you in real life
A person turning and looking away might represent the idea of them taking focus off of you, such as leaving you alone or ignoring, abandoning, or disapproving of you.
Pay attention to the context and to the intent of the person who is turning.