Insurance and minor accident

I was at a roundabout in the left hand lane as i was going straight over.. there was a break in the traffic so i proceeded with my journey doing roughly 15mph.. i passed the first exit and was coming to the 2nd exit when a white car came speeding beside me on the inside lane (roundabout side) then cut straight over the front of me to take the exit i was just about to pass. As a result his back end caught my front drivers side and pulled my front grill out.. we stopped and exchanged details. He said i had pulled out on him which made him have to go in the other lane to avoid me.. even though he was no where to be seen when i pulled out and i was already half way to my exit! Any way i rang my insurance and told them what happened
And passed the details over.. a few days later i received a phone call from his insurance asking me what had happened. I explained it all to him and he said he would get back to me.. a very short time later he phoned me back and said that my story was more viable and that he wanted to get my car booked in for repair and organise a hire car and they were going to pay for it all.. it all went ahead and my car was sorted. So i thought that was an end to it all. But a week later i received a claim pack through from the other drivers solicitor and they were claim for negligence against me. He put in for whiplash, nightmares while driving etc etc.. i couldnt believe it! My insurance contacted me again and asked me to mark on a picture of the roundabout where we collided etc etc.. i did all that.. finally got an email back saying that his claim was still going to proceed against my policy as any court would decide that as he was already on the roundabout i should have waited till he cleared my junction before i pulled out! He wasnt there when i pulled out! My insurance say that his insurance only paid for my car to be fixed out of goodwill.. i have 6 years no claims bonus. Ive never had an accident or hit anything. This has me worried sick.