Islanders who had to leave their distant Indian Ocean home for a U.S. military base half a century ago protested outside the U.K. Parliament on Monday.

Critics claim that the government is giving up control over a British territory.

This agreement has left displaced residents unsure about their ability to return home. They argue that a recent agreement has determined the future of their homeland without their involvement.

The British government announced last week its decision to cede the Chagos Islands to Mauritius, with the condition that the American naval and bomber base remains on Diego Garcia.

Britain expelled nearly 2,000 people from the islands in the 1960s and 1970s to make way for the U.S. military’s Diego Garcia base, which has supported military actions from Vietnam through Iraq and Afghanistan.