Mate's Illustrated Penarth, published in 1903, included in its description of Windsor Gardens:

There is a fine band stand, or shelter, and occasionally al fresco concerts are given, and sometimes of an evening the Gardens are gaily illuminated.

The bandstand still exists in its original form, though postcard views show it to be surrounded by mature shrubs which have since been removed. This part of the Gardens is now much more open than in its early years.