Another downside is that a visitor needs to know a lot about the internals of each shape. Some of that information might want to be private, but needs to be exposed so that the visitor can do it's thing.