Why is real estate a "game of telephone"?

[Brent Bialik]

We're in the process of buying a new private residence and, as in the past, I feel this kind of...like...hush hush disconnect about the whole process. Everything has to go through the realtors, the home owners kinda aren't supposed to be in the house we're looking at while we're looking at it, negotiations are more detached than a broken driveshaft, etc.

Why is that?

Why is it this way?

Sure, I can see realtors being useful and all, but why can't I, the buyer, sit down at a table with the homeowner, the seller, and negotiate? Realtors/agents/lawyers can all be there too, but this seems like such a faux pas.

Am I wrong? If not, is there a reason behind this?...because I hate it. 

Thank you!!