4.5 weeks post hysterectomy (LAVH) - intimacy before clearance

So I am almost 5 weeks post op, a few nights ago my husband and I couldn't resist any longer. Penetration of the vagina happened, but not for long because I began to panic, not because it hurt but I was scared we would Hurt my healing process. I have not experienced any pain or bleeding since my surgery so I felt great. I didn't have any pain at all when he penetrated. It's now Tuesday and I notice I have a slight brown discharge, no odorous. No pain still, should I be concerned? My 6 weeks post op appointment is March 24th.