Salamun Alaikum
'La mIsaasa' (la mIsaas) literally means 'no touching'. So this implies that there will no mutual touching of one another or 'I will not touch nor will I be touched'. [1] It is a two way process (i.e. don’t touch me and I won’t touch you). This can also be argued for ‘La mAsaas’ [2]
However, if the implication was to only imply 'me' [one way], then the pronoun''-NI' would be grammatically expected after the verb.
So I am not sure why the 'exclusive' 'Me/I' is read into the Quran by some. Therefore, I agree with you that such a ‘reading’ is not definitive by the grammar construct.
I attach an excerpt from Edward Lane's lexicon in support of my understanding.
I hope that helps, God willing.
Joseph.