In the end the only thing that matters is just God and your relationship with him, not everyone around you and what they think is acceptable. You said "My conscience seems to deaden me or prick me", that and the Word (Philippians 4) should be enough of an answer.
I personal don't have any...