We present a fully fiber-coupled source of high-fidelity single photons. An (In,Ga)As semiconductor quantum dot is embedded in an optical Fabry-Perot microcavity with a robust design and rigidly attached single-mode fibers, which enables through-fiber cross-polarized resonant laser excitation and photon extraction. Even without spectral filtering, we observe that the incident coherent light pulses are transformed into a stream of single photons with high purity (97%) and indistinguishability (90%), which is measured at an in-fiber brightness of 5% with an excellent cavity-mode-to-fiber coupling efficiency of 85%. Our results pave the way for fully fiber-integrated photonic quantum networks. Furthermore, our method is equally applicable to fiber-coupled solid-state cavity-QED-based photonic quantum gates