I don't see how 'excuse me, I just have to go stand facing this wall while I look at this thing' is actually any more polite than 'I just have to look at this thing on my phone'.
William Gibson had the right idea in 'virtual light' - you wear a pair of clear spectacles (that look just like normal specs) that induce signals in the optic nerve causing it to appear to your brain as if you can see things floating in midair - effectively operate as HUD that only you can see. That's worth doing and worth having. In fact, even a pair of translucent LCD specs would be better than this. I'm not quite sure in real terms how this is an improvement over any of the technologies we already have to be honest.
Jon