I feel fat although the doctor says im not?

I'm 163 cm and my weight fluctuates between 48 kilos (morning) and 50(evening) during the day, my doctor says if i loose more weight i could become unhealthy (i have lost 14 kgs, i went from 64 to 50 ) but i'm terrified of gaining weight!! What should I do ?