Even in fiction they accept this. In Star Trek (NG I think), the crew met a species whose language was allegorical - all members of the species had a known common history and communicated concepts and emotions exclusively by referring to events in that history. The crew did not have access to that history and thus the drama of the episode was that this was the first species they'd met where their translation technology had failed them.