New radiocarbon and chlorofluorocarbon-11 data from the World Ocean Circulation Experiment are used to assess a suite of 19 ocean carbon cycle models. We use the distributions and inventories of these tracers as quantitative metrics of model skill and find that only about a quarter of the suite is consistent with the new data-based metrics. This should serve as a warning bell to the larger community that not all is well with current generation of ocean carbon cycle models. At the same time, this highlights the danger in simply using the available models to represent the state-of-the-art modeling without considering the credibility of each model.