Materials such as added clays, weight materials, drill solids, and metallic wear products in the drilling fluid are known to distort the geomagnetic field at the location of the measurement while drilling (MWD) tool magnetometers that are used to measure the direction of well path. This distortion contributes to substantial errors in determination of azimuth while drilling deviated wells. These errors may result in missing the target of a long deviated 12 ¼ in. section in the range of 1–200 m, representing a significant cost to be mitigated. The error becomes even more pronounced if drilling occurs in arctic regions close to the magnetic north pole (or south pole). The effect on the magnetometer readings is obviously linked to the kinds and amounts of magnetic materials in the drilling fluid. The problem has recently been studied by laboratory experiments and analyses of downhole survey data. A series of experiments has been carried out to understand how some drilling fluid additives relate to the magnetic distortion. Experiments with free iron ions show that presence of iron ions does not contribute to magnetic distortion, while experiments with bentonite-based fluids show a strong effect of bentonite on magnetic shielding. Albeit earlier measurements showing a strong dependency of the content of organophilic clay, clean laboratory prepared oil-based drilling fluids show no increased shielding when adding organophilic hectorite clays. The anticipated difference between these two cases is outlined in the paper. When eroded steel from an offshore drilling site is added into the oil-based drilling fluid, it is found that these swarf and steel fines significantly increase the magnetic shielding of the drilling fluid. The paper outlines how the drilling direction may be distorted by the presence of these additives and contaminants and how this relates to the rheological properties of the drilling fluid.