May peace be with you.
Verse 5:96 refers to a 'state of ihram’ (hurumun). Today this state is entered into before one enters the sacred precincts for pilgrimage.
In times of antiquity, people undoubtedly travelled from far afield on foot, beasts of burden, ships etc. Some of them may have initiated their journey’s in a 'state of ihram’. So this directive covered not only Makkah but a state of a pilgrim regardless of whether they were in Makkah or not.
Therefore with respect, I would not find your implied contention relevant to the verse you have quoted.
Regards,
Joseph.