Legal review required. This policy is a launch-readiness draft and is not legal advice.
Robots.txt and Site Instructions
BlazeCrawl includes robots.txt parsing and enforcement in crawl/sitemap discovery paths and caches robots.txt responses. Single-page scrape and extraction requests may not automatically enforce robots.txt for every target before fetching, so customers must treat robots.txt, site terms, noindex/nofollow signals, and other published access instructions as binding unless they have separate written authorization from the site owner.
Customers must not use BlazeCrawl to evade robots.txt, rate limits, bot protections, IP blocks, account blocks, cease-and-desist notices, or other explicit access restrictions.
Authentication, Paywalls, and Access Controls
Customers must not use BlazeCrawl for credential stuffing, password spraying, session hijacking, CAPTCHA abuse, login bypass, paywall bypass, unauthorized account access, or scraping content that is only available after authentication unless they own the account or have explicit permission from the account owner and target service.
Personal Data and Sensitive Data
Customers must not use BlazeCrawl to collect, enrich, infer, sell, or profile personal data at scale unless they have a lawful basis, comply with applicable privacy laws, honor deletion/opt-out requests, and apply appropriate safeguards. Customers must not collect sensitive personal data, children's data, protected health information, financial account data, government identifiers, precise geolocation, biometric data, or credentials unless expressly authorized by law and contract.
Legal Posture for Public Web Data
Some United States cases have treated scraping publicly accessible web data differently from accessing data behind authentication or explicit technical access controls. hiQ Labs v. LinkedIn and Meta v. Bright Data are fact-specific examples, not blanket permission to scrape. Customers must obtain their own legal advice.
Enforcement
BlazeCrawl may throttle, suspend, terminate, or require additional review for activity that creates legal, security, operational, billing, or reputational risk.