Do bandana's always have gang affiliation, or can you wear them just because you like the look.?

I live in the lower part of nj, and i have a lot of bandanas, but never wear them because i'm afraid people will get the wrong impress and start poppin off at me. Do you think this would be a problem or can i just wear em because i like how they look?