A pile of bricks and rubble is all that's left of a former Darlington social club after the building was torn down.