I suppose what the organisers could potentially do in this situation is erect a 12 foot high fence against the outside wall of the property in question, but would this then need planning permission? as it would or could obscure the property owners view, and therefore deny the property owner enjoyment of the property?

As you say this is potentially dangerous ground to be treading in relation to the future of the event.