v0.0.36

Lots of performance improvements and resilience in crawling and analysis - especially with larger crawls on larger websites. llm output format further optimized.

Improvements

• WAF Challenge Page Detection: Audit now detects bot-protection interstitial pages (Cloudflare, Imperva, PerimeterX, etc.) and excludes them from page-level scoring to prevent false positives. A new crawl/waf-challenge-pages warning surfaces when challenge pages are detected.

• SQLite Lock Handling: Improved error messages and warnings when database lock conflicts occur from parallel CLI commands. Added 15-second busy timeout to reduce lock failures.

• Smarter Audit Selection:

  • analyze command now selects the latest completed crawl instead of potentially picking a still-running one
  • report command blocks incomplete or non-analyzed audits with clear error messages
  • Latest audit lookup now matches apex/www domain aliases (e.g., example.com matches www.example.com)

• LLM Report Output Improvements:

  • Affected pages are now sampled breadth-first (shallower paths first) and capped at 5 per issue
  • Evidence item lists capped to prevent oversized reports
  • Object metadata now serializes properly instead of showing [object Object]

• Documentation: Added warning about avoiding parallel crawl, audit, analyze, or report commands against the same workspace database