I did some nice walk along the board walk that starts at Luna Park and turning right at the end leads you to a nice little secret garden. I even saw a Kookaburra in the park.
Above the garden you had a great view on the Sydney skyline and the Harbour Bridge.