Refugees flee camp after clashes with villagers