Skip to main content
ScanGov Standards
Guidance
ScanGov
Project ScanGov
Government digital experience standards
Based on public policy, web protocol, guidelines and best practices.
All
Accessibility
AI-friendly
Content
Domain
Performance
Security
SEO
Social
Indicators
Standard
Why
Guidance
Crawlable
Site is available for indexing by well-behaved agents.
Crawlability ensures that search engines can index the content, making it discoverable by users.
21st Century Integrated Digital Experience Act
Memorandum (M-23-22)
The Web Robots Pages
Content available in document
Page main content is available in initial document.
Having main content directly available ensures that search engines can quickly access and rank the page accurately.
The Web Robots Pages
Feedback