Military leave

I had a military course for two weeks and gave them my orders but management still gave me 6.0 absence points. Do I fight them or does the points fall off eventually