Cirrus Logic Inc.’s plan to relocate next year as many as 250 of its workers from a Sixth Street office tower popular with tech companies would leave vacant some highly sought downtown office space.

Cirrus Logic (Nasdaq: CRUS), a fast-growing Austin semiconductor maker, plans to move the workers from two floors of 300 W. Sixth St. into five floors of the Shoal Creek Walk tower under construction at West Sixth and Bowie streets, one block from Cirrus Logic’s headquarters at the corner of Sixth Street and West Avenue and across the street from Whole Foods Market Inc.’s headquarters. Cirrus Logic, which generates a large amount of business from Apple Inc. devices, has filled up its entire headquarters building since it was finished in 2012, spokesman Bill Schnell said.