Are Swastikas Ever Not Offensive?

Now imagine you're visiting South Asia and see a group of natives strolling around in swastikas. How should you react - and what should you do? There are two main routes.