From where I'm sitting I don't see any particular group expressing "offense". What I see are ACLU types speaking "in behalf" of non-Christians who they claim are offended.
This is America. If someone in particular is offended we usually know who it is and they don't hide behind the skirts of the ACLU.
I just think people use Christmas as a means to advance political agendas.