'Settlers don't know when the knock on the door will come and they have to leave'