Mosaic crystals, with their high integrated reflectivities, are widely employed in spectrometers used to diagnose high energy density systems. X-ray Thomson scattering (XRTS) has emerged as a powerful diagnostic tool of these systems, providing in principle direct access to important properties such as the temperature via detailed balance. However, the measured XRTS spectrum is broadened by the spectrometer instrument function (IF), and without careful consideration of the IF one risks misdiagnosing system conditions. Here, we consider in detail the IF of 40 and 100  m mosaic Highly Annealed Pyrolytic Graphite crystals, and how the broadening varies across the spectrometer in an energy range of 6.7–8.6 keV. Notably, we find a strong asymmetry in the shape of the IF toward higher energies. As an example, we consider the effect of the asymmetry in the IF on the temperature inferred via XRTS for simulated 80 eV CH plasmas and find that the temperature can be overestimated if an approximate symmetric IF is used. We, therefore, expect a detailed consideration of the full IF will have an important impact on system properties inferred via XRTS in both forward modeling and model-free approaches.