Here is a good rule of thumb to follow:
you should never feel bad about your (in)actions, unless you have done
something that is wrong (aka immoral). just because your actions make
someone feel bad, is no reason to feel bad (unless you are in breach of
the previous sentence).
that being said, there is no need to spread the light except to those
who really do want to brighten up. those who don’t are welcome to feel
bad for their sins either from you or someone else or in one of their
future lives (whatever form that may take).