We’ve watched the graffiti, growing weeds, dying landscaping and deterioration of the historic structure for years,” a neighbor said.