Description
Web pages can be downloaded recursively with curl-based mirroring. This is useful for archiving small sites, collecting documentation for offline reading, or testing website changes.
Mirroring can create heavy traffic and may download copyrighted or private content. Respect robots policies, site terms, rate limits, and authorization boundaries.