In the situation you describe there is no problem of changing the place of the meal because no specific place was designated. The Alter Rebbe writes (60:64) “As travelers are accustomed to eat while they travel and they sit and say the after blessing where they finished eating, since this was their initial intention – not to eat where they made the HaMotzi blessing on the bread and started eating.”