A portable fiber SERS probe has been developed based on Ag nanorod array fabricated by oblique angle deposition. The incoming laser beam was designed to focus onto the Raman substrate at 45 degrees incident angle in order to maximize surface enhanced Raman scattering signal. With a fiber Raman system, a detection sensitivity of 10(-17) moles for trans-1, 2- bis(4-pyridyl)ethane molecules has been demonstrated. This Raman probe can also be used for in situ measurement for samples in aqueous solution. Such a fiber probe has great potential as a portable and remote sensor for on-site biological or chemical detection.