Does anyone else ever unfriend people they just friended?

Sometimes someone I've been speaking with for a minute or so will send me a friend request, and sometimes I'll accept because I feel too awkward to say no (and don't have any real reason to). However, I really don't like friending people I've only just met, especially if it's clear we have nothing in common.

Oftentimes, these people make me feel kind of uncomfortable, and they usually ask a lot of questions about you.

ANYWAYS, so I sometimes friend people and then unfriend them later when they've already forgotten about me. The problem is, I'm always scared I'll run into them and they'll get mad at me or something, which is unlikely but not impossible. People friend and unfriend all the time on this game, and most people aren't even online half the time.
Does anyone else do this or is it just me? It makes me feel kind of bad anytime I do... BUT, being friends with people that make me uncomfortable feels even worse :'D