Recently, the siamese convolutional neural network plays an important role in the field of visual tracking, which can obtain high tracking accuracy and good real-time performance. However, the requirement of offline training a specific neural network results in the hardware source and time consumption. In order to improve the tracking efficiency and save computation resources, we adopt pre-trained densely connected neural network to extract robust target features. Since the pre-trained model is mainly used for classification task, it is not appropriate to directly adopt these deep features for visual tracking. We design a regression network to measure the importance of each channel to the target, and then propose a weighting fusion strategy to select the suitable features for visual tracking. Besides, we provide deep analysis about the proposed channel weighting method to demonstrate the superiority of this method through visualization of feature heatmaps. Extensive experiments on four classical benckmarks show that compared with state-of-the-art methods, our algorithm achieves the best results on several standard indicators and comparable results on other indicators.