Advise UK employement

I have received a job offer for a civil service position and advised to hand in my notice to my current employer, but I will not receive a contract until I start my new job. Are the employer legally obliged to hire me with just an offer letter and no contract.