I'm a bit torn on this one Josh. This is similar to the question asked by wholesalers about how to estimate repairs. I got a wholesale lead a couple weeks ago where the repair estimate was $15k. I walked the place, and would be putting about $100k into it to get the sales price they claimed $15k would pull. His problem was that he took his estimate from the owners. The home probably could have been made complete for $15k, but still would have been completely outdated, with no curb appeal.
Where do you draw the line with this stuff? I agree that agents should have some knowledge of the properties they sell. They should know if the plumbing doesn't work, the electric doesn't work, the walls are missing, or the roof is shot. I believe the NAR requires that an agent disclose these defects even if their seller requests them not to.
The problem then is that all of these could be in decent shape, and the home still require a lot of work. The layout could be ****, the cabinets could be hideous, etc. Should the agents have to tell the buyer that everything is outdated and worn out? Even then, every buyer will have their own idea of what needs to be done. I've seen cabinets painted that I would tear out, or carpets cleaned that I would replace. I may even replace windows that don't leak or a roof that has an ugly color.
In my mind, the agent should know if the mechanicals work, as well as the roof/windows/etc. I do not think they are responsible for a complete list of work that needs to be done to a property. Any investor who is relying on someone elses scope-of-work is asking for trouble.