Researchers introduced ORGANIC3D, a framework for testing and improving whether AI models that read 3D CT scans connect written findings to the right anatomy. Its tests alter scans by removing organs, replacing lesions or changing left-right orientation, exposing alignment failures even in models with high classification scores.
The researchers say their model, trained exclusively on public data, reached 77% laterality accuracy, versus at most 66% for earlier models. In tests where an organ was removed, it retracted 96–99% of findings about that organ; other models retracted at most 69%.
Why it matters
For radiology teams assessing AI for CT scans, ORGANIC3D offers tests of whether a model’s findings depend on the relevant anatomy, though the paper does not establish how the results translate to clinical use.