Creepy reactions when I tell people in my lucid dreams that I'm dreaming

Every so often I have lucid dreams. A few times I have told a person in my dream that this was all-well- only a dream. I've done this a handful of times and it's always had the same outcome: the person stops talking abruptly, stares at me and then I wake up. Pretty spooky