BlogWhat an Automated PDF Accessibility Scan Can and Cannot Detect

What an Automated PDF Accessibility Scan Can and Cannot Detect

Automated PDF scans catch missing tags, blank titles, and broken headings fast. But they cannot judge alt text quality or reading order. Learn the limits.

The Promise and Limits of Automation

Automation excels at three things: scale, speed, and consistency. A scanner can check every image in a thousand-page document catalog for alt text faster than any human team. It never gets tired, never skips a page, and applies the same rule set every time. But automation is not a replacement for human judgment. A scan checks whether properties exist and whether structures follow rules. It does not understand context, intent, or meaning. A document can pass every automated check and still be confusing or unusable for someone with a disability. Knowing where the line sits helps you build better workflows. It prevents the false confidence of a clean scan report, and it saves effort – because many real issues are purely structural, and a scanner will catch those immediately without tying up human reviewers.

What Automated Scans Can Reliably Detect

Document Properties

Document title present or missing. A scan checks whether the PDF has a title in its metadata. Many PDFs ship with the filename as the title – or no title at all. Document language set or not set. Screen readers use the declared language for pronunciation rules. A scan verifies whether the document specifies its language.

Tag Structure

Tag presence or absence. A scan detects whether a PDF has been tagged at all. An untagged PDF is essentially an image stack to a screen reader. Tag type correctness. Is a heading tagged as a heading? Is a paragraph tagged as a paragraph? Is a table tagged as a table? Scanners verify these tag assignments against the actual content. Heading hierarchy issues. Skipped heading levels (jumping from H2 to H4) and missing H1 tags are easy to detect programmatically.

Content Elements

Image alt text presence or absence. A scan can check whether every image has an associated alt text entry. This is one of the most common automated checks. Table header associations. Scanners can verify whether table cells are associated with header rows using proper scope or ID associations. List structure correctness. Is the list tagged as a list? Are the list items properly nested? Automation checks structural list markup. Form field labels. A scan verifies whether form fields have associated labels in the tag tree. Character encoding issues. Scanners detect characters that are not properly encoded, which can cause screen readers to mispronounce or skip text. These checks are objective. There is no ambiguity about whether a document has a title or an image has alt text. The answer is yes or no, and a scanner gets it right.

What Automated Scans Flag But Cannot Fully Evaluate

Alt Text That Exists but Fails

A scan can tell you that an image has alt text. It cannot tell you that the alt text says "image_01_final.jpg" instead of something useful. The programmatic check passes. The accessibility check fails. Only a human reading the alt text alongside the image can judge its quality.

Color Contrast That Passes Technically

Scanners calculate contrast ratios against WCAG thresholds. But a document might pass every ratio while still using color as the only way to distinguish categories in a chart. The numbers look fine. The document is still hard to use for someone who is colorblind.

Reading Order That Is Structurally Correct

A scan can verify that the tag tree has a logical order and that content flows top to bottom without jumps. But it cannot tell whether that order matches how a human would actually read the page. A sidebar might come before the main article in the tag sequence, which is technically ordered but practically confusing.

Tables Tagged Correctly but Too Complex

A scan can confirm that a table has headers with proper cell associations. It cannot tell whether a twelve-column table with merged cells and nested headers is comprehensible when read aloud. The structure is valid. The user experience may not be.

Links That Work but Lead Nowhere Useful

Scanners can verify that a link has alternate text and that the destination is not broken. They cannot tell whether the link text makes sense out of context or whether the destination page is itself accessible. "Click here" passes the link check. It fails the usability check. This middle zone trips up many teams. They see a scan report with few issues and assume the document is in good shape. The real question is what kind of issues remain – and only human review can answer that.

What Still Requires Human Judgment

Accurate and Meaningful Alt Text

A person must decide whether alt text describes the image well enough that someone who cannot see it still understands what it conveys. A scan cannot judge whether "Bar chart showing 23% increase in Q3" is better than "Chart."

Logical Reading Order

Only a human can read through a document with a screen reader and determine whether the sequence makes sense. Does the caption come after the image? Does the footnote interrupt the main text? These are experiential questions, not structural ones.

Complex Diagrams and Charts

Scanners have no ability to evaluate whether a complex flowchart or data visualization is adequately described. A long paragraph of alt text might technically exist, but a human needs to judge whether that description actually communicates what the diagram shows.

Color as the Only Information Channel

A scan might flag that color is used in a chart. But a human must determine whether the same information is available through pattern, label, or text. Two bars might be red and green – the scanner sees colors. A person must decide whether the values are also labeled directly.

Sequential Comprehension

Does the document make sense when read from beginning to end? Are sections organized logically? Is the writing clear? These are questions about content quality that no scanner can answer.

Form Usability in Practice

A scan can verify that form fields have labels. It cannot tell whether the tab order is logical, whether error messages are clear, or whether the form is actually usable with keyboard navigation alone. Only testing with assistive technology reveals these issues.

Meeting Real User Needs

Ultimately, accessibility is about whether people with disabilities can use your documents. A scan cannot simulate that experience. It cannot tell you whether a screen reader user would find your annual report useful or frustrating. That requires user testing or expert manual review.

Ready to check your own PDFs?

Start a Free Scan

How to Combine Automated Scans with Manual Review

Use Scans For

Initial triage. Run every PDF through a scan first. It takes minutes and surfaces obvious structural problems immediately. Bulk assessment. If you manage hundreds or thousands of PDFs, scanning gives you a dataset. You can see which documents have the most issues and where to focus remediation effort. Issue categorization. Scan reports group problems by type – missing tags, heading issues, alt text gaps. This helps you plan remediation work in batches. Progress tracking. Rescanning the same PDF after remediation shows whether structural fixes took effect. It is a useful checkpoint in your workflow.

Use Human Review For

Samples from scan results. After scanning a batch, pick representative documents for manual review. Focus on high-visibility documents, complex layouts, and documents flagged for borderline issues. Complex documents. Annual reports, technical manuals, forms, and documents with charts or diagrams almost always need human eyes. Final quality assurance. Before publishing or submitting documents for compliance review, have someone test them with a screen reader or send them to an accessibility expert.

A Practical Workflow

Scan first. Categorize the issues. Prioritize by document importance and user impact. Remediate the structural problems. Then spot-check a sample with manual review. Rescan to confirm the fixes. Repeat. This approach saves time because you are not manually reviewing every PDF from scratch. It also catches the interpretive issues that automation misses. The scan is a filter, not a finish line.

Setting the Right Expectations for Your Team

An automated PDF accessibility scan is a pre-audit tool, not a certification. It finds likely issues. It does not find all issues. It helps you plan and budget for remediation. It does not mean your PDFs are compliant when the scan comes back clean. This distinction matters when you report results upward. If you tell leadership that your documents "passed accessibility testing" because a scan returned no issues, you are setting up a problem later – when an audit, a user complaint, or a legal review reveals the gaps automation missed. Honesty about limits builds trust. Auditors respect teams that understand the difference between automated testing and comprehensive review. Users benefit when organizations go beyond the minimum. And your own team works more effectively when they know what a scan is telling them – and what it is not. If you treat a scan as an early warning system rather than a final verdict, you get the most value from it. It shows you where to look. It does not replace looking.

FAQ

Can an automated scan guarantee WCAG compliance?

No. An automated scan checks structural and programmatic criteria, but many WCAG success criteria require human interpretation. A scan can identify missing properties and structural problems. It cannot judge whether content is meaningful, whether reading order is logical, or whether complex visuals are adequately described. Use scans as part of a broader workflow that includes manual review.

What percentage of issues can automation detect?

Most accessibility professionals agree that automated tools can detect roughly 25 to 30 percent of WCAG success criteria reliably. Another 20 to 30 percent can be partially flagged but require human verification. The remaining 40 to 50 percent are interpretive criteria that automation cannot evaluate at all. The exact split depends on document type and content complexity.

Should I still hire an accessibility expert if I use a scanner?

Yes, for documents that matter. A scanner is excellent for bulk assessment and structural issue detection. For public-facing documents, legal submissions, and complex layouts, human review is still necessary. Many organizations use scans to narrow the scope of expert review – which makes the expert's time more efficient and less expensive.

How often should I scan my PDFs?

Scan new PDFs before they are published. Scan existing PDFs on a regular schedule – quarterly or bi-annually depending on volume. Rescan after remediation work to verify fixes. If your organization produces PDFs continuously, integrate scanning into your production workflow rather than treating it as a one-time check.

Is a clean scan report a sign that my PDF is accessible?

Not necessarily. A clean scan means the document passed the checks that automation can perform. It may still have poor alt text, confusing reading order, or usability problems that only human testing reveals. A clean scan is a good sign. It is not a final verdict.

Find out what's hiding in your PDFs

Upload your documents and get an instant accessibility scan. See missing titles, broken headings, untagged images, and more — in seconds.

Scan Your PDFs Now

PDFScanAccess Team

We build tools that help organizations find and fix PDF accessibility issues before they become compliance problems.

Related articles