I would probably take two things into account:
Is there opportunity to influence closer to the Lord. If yes, then it may be worth staying with that as your primary goal. If no, then you really have to consider the next point.
How is your own conscience about the matter? 1 Cor ch 8 and ch 10 both talk about a man's conscience, and 1 Tim 4:2 talks about the danger of a seared conscience. If your own conscience is causing you trouble over it......
Those two things - is there possibility to bring them closer to the Lord, and are you in danger of searing your conscience?
Only you really know these answers.