Self-doubt is a bane to many people.
I can categorize myself in numerous ways, but would I be right? You don't have to be a fanatic to like something. You like to game right? You don't have to be a professional gamer to play or comment on them.
Ever think about beating the crap out of someone who annoys? Have you thought about killing someone close to you? Have you had perverted thoughts about someone? I have, but I never follow through with them. These thoughts are natural. We have emotions and fears and we have negative thoughts, but that's why we have self control.
They are people who share your interests and even if the people you are talking to don't, they may be curious about it. A friend doesn't need to share all your interests. One of my best friends in elementary loved soccer while it didn't really interest me that much, but that doesn't mean we wouldn't have conversations about soccer from time to time.