Skip to content

Bot detection

Bot detection identifies automated crawlers and testing tools visiting your website and, when recognized, applies consent automatically instead of showing the CMP to them.

How it works

When a request's browser user agent matches a known bot signature, the CMP:

  • Applies implicit consent equivalent to Accept All to every configured Data Processing Service.
  • Does not display the consent banner.
  • Does not display the floating privacy button.
  • Skips the CMP's own analytics/tracking for that request.

This prevents bots from being blocked by (or skewing analytics from) your consent setup, while still allowing services like Googlebot or Lighthouse to load and evaluate your site normally.

Detected bots

The following user agents are currently recognized:

  • AdsBot-Google
  • AdsBot-Google-Mobile
  • Bingbot
  • BingPreview
  • Chrome-Lighthouse
  • DuckDuckBot
  • Feedfetcher-Google
  • Google Favicon
  • Google Page Speed Insights / Google PageSpeed Insights
  • Google PP
  • Google Search Console
  • Google Web Preview
  • Google-InspectionTool
  • Google-Read-Aloud
  • Google-SearchByImage
  • Google-Speaker
  • Google-Structured-Data-Testing-Tool
  • Googlebot
  • Googlebot-Image
  • Googlebot-Mobile
  • Googlebot-News
  • Googlebot-Video
  • HeadlessChrome
  • Lighthouse
  • Optimizer
  • Pagespeed
  • Playwright
  • SISTRIX
  • Slurp
  • Storebot-Google
  • Yahoo! Site Explorer Feed Validator
  • Yahoo! Slurp
  • YahooCacheSystem
  • YahooSeeker

This list reflects the detection logic in the CMP SDK and may be extended over time.

Enabling bot detection

  1. In the Usercentrics Admin Interface, go to Configuration.
  2. Select the CMP Settings tab.
  3. Scroll to the Bot Detection section and toggle it on.