Help & Documentation
Everything you need to know about using SECrawl
Quick Start
Get started in minutes
View Reports
Understand your data
Reports & Analysis
SEO Reports Overview
SECrawl provides 20+ pre-built SEO reports: **Content Reports**: - Duplicate page titles - Missing/duplicate H1 tags - Missing/short meta descriptions - Thin content pages **Technical Reports**: - Broken links (4xx, 5xx errors) - Redirect chains - Missing canonical tags - HTTP pages (non-HTTPS) **Performance Reports**: - Slow loading pages - Deep pages (URL structure) - High latency responses **Security Reports**: - Missing security headers - Mixed content warnings - SSL certificate issues Each report shows affected pages, severity, and recommendations for fixing.
Using Advanced Search
Search operators for finding specific pages: **Text search**: Find pages containing specific text in title, URL, or content **Status code**: Filter by HTTP status (status:404, status:200) **Content type**: Filter by type (type:html, type:pdf) **URL patterns**: Use wildcards (url:*/blog/*) **H1 presence**: Find pages with/without H1 (h1:empty, h1:exists) **Meta description**: Filter by meta (meta:empty, meta:short) Combine operators with AND, OR, NOT for complex queries.
Exporting Data
Export your data in multiple formats: **Excel (.xlsx)**: Full data export with formatting **CSV**: Raw data for custom analysis **API**: Programmatic access to all crawl data To export: 1. Navigate to any report or search results 2. Click the "Export" button 3. Select your format 4. Download begins immediately API access available on all paid plans. See API documentation for details.
Integrations
Google Search Console Integration
Connect Google Search Console to enrich your crawl data: 1. Go to Settings → Integrations 2. Click "Connect Google Search Console" 3. Authorize SECrawl to access your GSC properties 4. Select which properties to connect Benefits: - See impressions and clicks for each page - Identify pages with high impressions but low clicks - Find technical issues affecting search performance - Compare crawl data with actual search traffic
Google Analytics 4 Integration
Connect GA4 to see performance metrics: 1. Go to Settings → Integrations 2. Click "Connect Google Analytics 4" 3. Authorize and select your GA4 property Data available: - Sessions and users per page - Engagement rate and bounce rate - Average engagement time - Conversion events Use this to prioritize fixes on high-traffic pages.
Troubleshooting
Crawl Not Starting
If your crawl won't start: **Check URL format**: Must be valid HTTP/HTTPS URL **Verify domain access**: Ensure website is publicly accessible **Check plan limits**: You may have reached your monthly crawl limit **Firewall issues**: Some websites block crawlers Solution: Contact support if issues persist.
Missing Pages in Results
If pages are missing from your crawl: **Check robots.txt**: Website may block crawlers **Verify internal linking**: Pages must be linked from crawled pages **Check crawl depth**: Increase depth setting if pages are deep in site structure **JavaScript content**: Some content may require JS rendering (Professional+ plans) Tip: Use sitemap.xml to ensure all pages are discovered.
Account & Billing
Managing Your Subscription
To manage your subscription: 1. Go to Billing page 2. View current plan and usage 3. Click upgrade/downgrade buttons **Upgrading**: Takes effect immediately with prorated billing **Downgrading**: Takes effect at end of current billing period **Canceling**: Access continues until period end The Free plan needs no credit card. Paid plans are billed monthly — sign up during beta to lock in our limited-time beta pricing for as long as you stay subscribed. Cancel anytime.
Understanding Usage Limits
Your plan includes limits on: **Crawls per month**: How many crawls you can create **Pages per crawl**: Maximum pages per individual crawl **Total pages**: Monthly page crawl limit **AI requests**: Daily AI analysis requests (if applicable) Usage resets on your billing date. Upgrade anytime to increase limits immediately.
Data Retention & Privacy
Data retention by plan: **Free**: 30 days **Starter**: 90 days **Professional**: 1 year **Enterprise**: Indefinite Your data: - Is encrypted at rest and in transit - Never shared with third parties - Can be exported anytime - Can be deleted on request See our Privacy Policy for complete details.
API Documentation
API Overview
SECrawl provides a full REST API for programmatic access. **Base URL**: https://yourdomain.com/api **Authentication**: Bearer token (JWT) Available endpoints: - Create and manage crawls - Retrieve crawl results - Search across all data - Export data - Manage account settings Full API documentation available at /api/docs (OpenAPI/Swagger).
API Authentication
To authenticate API requests: 1. Log in to get your JWT token 2. Include in Authorization header: Authorization: Bearer YOUR_TOKEN Example: curl -H "Authorization: Bearer YOUR_TOKEN" \ https://yourdomain.com/api/crawls Tokens expire after 7 days. Refresh by logging in again.
Still Need Help?
Our support team is ready to assist you with any questions or issues.
Contact Support