We present new high-resolution proxy data for the Holocene history of drift ice off Iceland based on the mineralogy of the <2-mm sediment fraction using quantitative X-ray diffraction. These new data, bolstered by a comparison with published proxy records, point to a long-term increasing trend in drift ice input into the North Atlantic from 6 to 5 ka toward the present day at sites influenced by the cold east Greenland Current. This feature reflects the late Holocene Neoglacial or cooling period recorded in ice cores and further terrestrial archives on Greenland. In contrast, a decrease in drift ice during the same period is recorded at sites underlying the North Atlantic Drift, which may reflect a warming of this region. The results document that Holocene changes in iceberg rafting and sea ice advection did not occur uniformly across the North Atlantic. Centennial-scale climate variability in the North Atlantic region over the last ~4 kyr is linked to the observed changes in drift ice input. Increased drift ice may have played a role in the increase of cold intervals during the late Holocene, e.g., the Little Ice Age cooling.