Is paternity leave deducted from normal holiday entitlement?

I took one week paternity leave at work, now my employer seems to think that this time off, has been deducted from my normal holiday entitlement...Is this correct?