Enhanced bandwidth issues for 5G system are fruitfully resolved by organizing free space optics (FSO) communication frameworks. The high bandwidth, the maximum number of channel transmission requirements, and high data rate have been boosted during the last years because of the COVID-19 pandemic. The online services and digital applications have increased pressure on installed optical network models. In addition, the optical networks with high capacity transmission produce nonlinear distortions, which degrade system efficiency. This paper presents a mixed FSO and fiber network to tackle the factors of nonlinearities and enrich the system capacity and range. Furthermore, the issues related to radio frequency, FSO pointing, and co-channel interference are considered in this work. The theoretical and simulation structures are validated using advanced measuring parameters, such as bit error rate (BER), peak to average power ratio (PAPR), cumulative distribution function (CDF), and outage probability. The nonlinear factors are addressed successfully, and the capacity is developed from current models. Finally, the proposed model's limitations and future direction are discussed in this paper.
Keywords: co-channel interference; free space optics; free space pointing errors; nonlinear interference.