Any owner or person erecting or demolishing any building shall remove any surplus material and matter arising from such erection or demolition from the site and from any other land or public street or public place affected by such material or matter during or after the completion of such erection or demolition, failing which the local authority may, by written notice, order the owner of such building to have such surplus material and matter removed within a period specified in such notice.