In order to achieve long-pulse H-mode plasma scenario over 400 s with high heating power in the Experimental Advanced Superconducting Tokamak (EAST) device, the lower graphite divertor will be upgraded into a tungsten (W) divertor with active water cooling, which consists of the W/Cu monoblock units and the W flat-tile units as the divertor plasma facing components. As a fundamental diagnostic tool, the divertor Langmuir probe (Div-LP) diagnostic system will be upgraded accordingly. This paper presents the design of two kinds of new Div-LP systems, which are planned to be utilized on the W/Cu monoblock units and the W flat-tile units for the upgraded lower tungsten divertor, respectively, including their structures and preliminary poloidal and toroidal layouts. The Div-LP diagnostic system can measure the plasma parameters with the schemes of triple-probe, double-probe, and single-probe, to obtain the spatial and temporal distribution of plasma behavior on the divertor targets, which is useful for the discharge control and operation in EAST. In addition, the thermal analysis of the two kinds of probe assemblies is also carried out by using the three-dimensional finite element code ANSYS, which is aimed to get the optimal designs to withstand the long-pulse and high-power operation in EAST future experiments.