User Manual: Technical Site Spider Crawler

Cloud crawler for comprehensive technical website audits: 200/301/404/500 status codes, duplicate metadata detection, Canonical validation, and CSV exports.

Official Tool Landing Page & Features: Technical Audit Spider

Prerequisites & Preparation:

Open Site Spider in your AKRAMYS dashboard.
Prepare your target website URL (e.g., https://example.com).

Want to check features, pricing and full overview?Visit Tool Page

Step-by-Step Instructions:

Entering domain and setting crawl limit

Type your website URL into the domain field. Choose the maximum page limit (50, 100, 250, etc. according to your plan quota).

Pro Tip: Always include https:// or http:// protocol prefix.

Configuring Advanced Crawler Settings

Expand advanced options: 1) 'User-Agent Profile' (Googlebot Desktop, Chrome Browser, or Custom); 2) 'JavaScript Rendering' (enable for client-rendered SPA/React/Next.js platforms).

Pro Tip: Standard CMS websites (WordPress, Shopify) crawl fastest with standard HTML parsing.

Starting crawl and tracking progress

Click 'Start Crawl'. The cloud spider executes the traversal, updating a live progress bar.

Pro Tip: You can switch to the 'History' tab at any time to compare with past site audits.

Reviewing technical audit breakdown

Examine the generated audit dashboard: response code distribution chart (200, 301, 404, 500), broken internal links list, missing/duplicate Title and H1 tags, and non-canonical pages.

Pro Tip: Click on any issue card to open an interactive modal with the exact affected URLs.

Downloading complete crawl reports

Click the 'Download Report' button to export all crawled URL data, status codes, and meta tags into Excel/CSV format.

AKRAMYS Pro Cloud

User Manual: Technical Site Spider Crawler

Launch the tool in your dashboard or view its product overview page.

Explore Tool Landing Page Open in Dashboard

Related SEO & AI Tools

Explore features and guides for related platform modules:

Core Web Vitals & On-Page

Express SEO Diagnostics

Instant on-page technical SEO health check across 50+ key metrics: Core Web Vitals, Schema.org structured data, metadata tags, and mobile readiness.

View Tool Wiki Guide →

HTTP Status & TTFB Speed

Server Status & Speed Checker

Inspect raw HTTP response headers, trace complex 301/302 redirect chains, verify server caching rules, and measure Time to First Byte (TTFB) globally.

View Tool Wiki Guide →

24/7 Instant Alerts

24/7 Uptime Monitor

Know when your website goes down before your customers do. Automated 60-second checks, SSL certificate expiration tracking, and instant alerts to Telegram.

View Tool Wiki Guide →

Frequently Asked Questions (FAQ)

Does the spider support JavaScript-heavy Single Page Applications?

Yes, enable the JavaScript rendering toggle in Advanced Settings before launching the crawl.

← All Wiki Manuals