Officials from the San Francisco Department of Building Inspection on Monday morning observed that the new "X" on top of the building formerly known as Twitter's headquarters was being dismantled, according to Patrick Hannan, the department's spokesman.

The news comes after the company was issued a notice of violation (NOV) Friday for work without a permit for the new sign, which flashes at night, that adorns the building.

"Over the weekend, the Department of Building Inspection and City Planning received 24 complaints about the unpermitted structure, including concerns about its structural safety and illumination. This morning, building inspectors observed the structure being dismantled. A building permit is required to remove the structure but, due to safety concerns, the permit can be secured after the structure is taken down," Hannan said in an email to CNN.

"The property owner will be assessed fees for the unpermitted installation of the illuminated structure. The fees will be for building permits for the installation and removal of the structure, and to cover the cost of the Department of Building Inspection and the Planning Department's investigation," he added.

CNN has reached out to the company formerly known as Twitter for comment.

- CNN's Ramishah Maruf contributed to this report