We report a novel architecture that can be used to construct optical switch fabrics with very high port count and nanoseconds switching speed. It is well known that optical switch fabrics with very fast switching time and high port count are challenging to realize. Currently, one of the most promising solutions is based on a combination of wavelength-tunable lasers and the arrayed waveguide grating router (AWGR). To scale up the number of ports in such switches, a direct method is to use AWGRs with a high channel count. However, such AWGRs introduce very large crosstalk noise due to the close wavelength channel spacing. In this paper, we propose an architecture for realizing a high-port count optical switch fabric using a combination of low-port count AWGRs, optical ON-OFF gates and WDM couplers. Using this new methodology, we constructed a proof-of concept experiment to demonstrate the feasibility of a 256 x 256 optical switch fabric. To our knowledge, this port count is the highest ever reported for switch fabrics of this type.