{"id":12106,"date":"2026-10-29T10:06:49","date_gmt":"2026-10-29T09:06:49","guid":{"rendered":"https:\/\/bernard.digital\/?page_id=12106"},"modified":"2026-10-29T10:20:00","modified_gmt":"2026-10-29T09:20:00","slug":"ai-crawlers","status":"publish","type":"page","link":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/","title":{"rendered":"AI crawlers"},"content":{"rendered":"[vc_row type=&#8221;in_container&#8221; full_screen_row_position=&#8221;middle&#8221; column_margin=&#8221;default&#8221; column_direction=&#8221;default&#8221; scene_position=&#8221;center&#8221; text_color=&#8221;dark&#8221; text_align=&#8221;left&#8221; overlay_strength=&#8221;0.3&#8243; shape_divider_position=&#8221;bottom&#8221;][vc_column column_padding=&#8221;no-extra-padding&#8221; column_padding_position=&#8221;all&#8221; background_color_opacity=&#8221;1&#8243; background_hover_color_opacity=&#8221;1&#8243; width=&#8221;1\/1&#8243;][vc_raw_html]JTNDZGl2JTIwY2xhc3MlM0QlMjJiei10ZXJtLXdyYXAlMjIlM0UlM0NhcnRpY2xlJTIwY2xhc3MlM0QlMjJiei10ZXJtJTIyJTIwZGF0YS10ZXJtJTNEJTIya2ktY3Jhd2xlciUyMiUzRSUwQSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2V5JTIyJTNFR0VPJTIwR2xvc3NhcnklM0MlMkZwJTNFJTBBJTNDaDElM0VBSSUyMGNyYXdsZXJzJTNDJTJGaDElM0UlMEElM0NwJTIwY2xhc3MlM0QlMjJiei10ZXJtX19kZWYlMjIlM0UlM0NzdHJvbmclM0VBSSUyMGNyYXdsZXJzJTIwYXJlJTIwYm90cyUyMGZyb20lMjBBSSUyMHByb3ZpZGVycyUyMHRoYXQlMjBmZXRjaCUyMHdlYnNpdGVzJTJDJTIwZWl0aGVyJTIwdG8lMjBjb2xsZWN0JTIwdHJhaW5pbmclMjBkYXRhJTIwb3IlMjB0byUyMHJldHJpZXZlJTIwY29udGVudCUyMHRvJTIwYW5zd2VyJTIwYSUyMHNwZWNpZmljJTIwcXVlc3Rpb24uJTNDJTJGc3Ryb25nJTNFJTNDJTJGcCUzRSUwQSUzQ2gyJTNFQXQlMjBhJTIwZ2xhbmNlJTNDJTJGaDIlM0UlMEElM0NmaWd1cmUlMjBjbGFzcyUzRCUyMmJ6LXR4JTIyJTNFJTNDZmlnY2FwdGlvbiUzRSUyRiUyRiUyMHR3byUyMGtpbmRzJTIwb2YlMjBhaSUyMGNyYXdsZXJzJTNDJTJGZmlnY2FwdGlvbiUzRSUzQ3ByZSUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBrJTIyJTNFVFJBSU5JTkclM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyMEdQVEJvdCUyMCVDMiVCNyUyMENsYXVkZUJvdCUyMCVDMiVCNyUyMENDQm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBjJTIyJTNFJTIwJTIwY29sbGVjdCUyMHRleHQlMjBmb3IlMjBmdXR1cmUlMjBtb2RlbHMlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGQlMjIlM0UlMjAlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGslMjIlM0VTRUFSQ0glMjBBTkQlMjBBTlNXRVIlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyME9BSS1TZWFyY2hCb3QlMjAlQzIlQjclMjBQZXJwbGV4aXR5Qm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjB5JTIyJTNFJTIwJTIwZmV0Y2glMjBjb250ZW50JTIwZm9yJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzJTNDJTJGc3BhbiUzRSUzQyUyRnByZSUzRSUzQyUyRmZpZ3VyZSUzRSUwQSUzQ2gyJTNFRXhhbXBsZSUzQyUyRmgyJTNFJTBBJTNDcCUzRUlmJTIwYSUyMHdlYnNpdGUlMjBibG9ja3MlMjBhbGwlMjBBSSUyMGJvdHMlMjB3aG9sZXNhbGUlMjBpbiUyMHJvYm90cy50eHQlMkMlMjBpdCUyMGVuZHMlMjB1cCUyMG5laXRoZXIlMjBpbiUyMHRyYWluaW5nJTIwZGF0YSUyMG5vciUyMGluJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzLiUyME1hbnklMjBzaXRlcyUyMGhhdmUlMjBkb25lJTIwdGhpcyUyMHVubm90aWNlZCUyQyUyMGZvciUyMGV4YW1wbGUlMjB0aHJvdWdoJTIwYSUyMGRlZmF1bHQlMjBzZXR0aW5nJTIwaW4lMjB0aGUlMjBDRE4lMjBvciUyMGElMjBzZWN1cml0eSUyMHBsdWdpbi4lM0MlMkZwJTNFJTBBJTNDaDIlM0VJbiUyMHByYWN0aWNlJTNDJTJGaDIlM0UlMEElM0NwJTNFQ2hlY2slMjB5b3VyJTIwcm9ib3RzLnR4dCUyMGFuZCUyMHlvdXIlMjBob3N0aW5nJTIwb3IlMjBDRE4lMjBzZXR0aW5ncy4lMjBJZiUyMHlvdSUyMHdhbnQlMjB0byUyMGJlJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUyQyUyMHlvdSUyMHNob3VsZCUyMGF0JTIwbGVhc3QlMjBhbGxvdyUyMHRoZSUyMHNlYXJjaCUyMGJvdHMuJTIwV2hldGhlciUyMHlvdSUyMGFsc28lMjBhbGxvdyUyMHRyYWluaW5nJTIwYm90cyUyMGlzJTIwYSUyMHNlcGFyYXRlJTIwZGVjaXNpb24uJTNDJTJGcCUzRSUwQSUzQ2gyJTNFSG93JTIwaXQlMjBmaXRzJTIwdG9nZXRoZXIlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2N0eCUyMiUzRVRyYWluaW5nJTIwYm90cyUyMGZpbGwlMjB0aGUlMjAlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnRyYWluaW5nLWRhdGElMkYlMjIlM0VUcmFpbmluZyUyMGRhdGElM0MlMkZhJTNFJTJDJTIwc2VhcmNoJTIwYm90cyUyMGRlbGl2ZXIlMjB0aGUlMjBjb250ZW50JTIwZm9yJTIwJTNDYSUyMGNsYXNzJTNEJTIyYnotdGVybS1saW5rJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZyYWclMkYlMjIlM0VSQUclM0MlMkZhJTNFLiUyMFRoZSUyMCUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGbGxtcy10eHQlMkYlMjIlM0VsbG1zLnR4dCUzQyUyRmElM0UlMjBpcyUyMGElMjB2b2x1bnRhcnklMjBleHRyYSUyMG9mZmVyZWQlMjB0byUyMHRoZXNlJTIwYm90cy4lM0MlMkZwJTNFJTNDaDIlM0VSZWxhdGVkJTIwdGVybXMlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX3JlbCUyMiUzRSUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGdHJhaW5pbmctZGF0YSUyRiUyMiUzRVRyYWluaW5nJTIwZGF0YSUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnJhZyUyRiUyMiUzRVJBRyUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRmxsbXMtdHh0JTJGJTIyJTNFbGxtcy50eHQlM0MlMkZhJTNFJTNDJTJGcCUzRSUwQSUzQyUyRmFydGljbGUlM0UlM0Nhc2lkZSUyMGNsYXNzJTNEJTIyYnotZ2N0YSUyMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LWdjdGFfX2slMjIlM0VHRU8lMjBhdWRpdCUzQyUyRnAlM0UlM0NoMiUzRUlzJTIweW91ciUyMGJyYW5kJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUzRiUzQyUyRmgyJTNFJTNDcCUzRUklRTIlODAlOTlsbCUyMGNoZWNrJTIwaXQlMjBmb3IlMjB5b3UlM0ElMjBpbiUyMENoYXRHUFQlMkMlMjBHZW1pbmklMjBhbmQlMjBQZXJwbGV4aXR5LiUyMEZyZWUlMjBhbmQlMjB3aXRob3V0JTIwb2JsaWdhdGlvbiUyQyUyMGFzJTIwYSUyMHZpZGVvJTIwd2l0aGluJTIwNDglMjBob3Vycy4lM0MlMkZwJTNFJTNDYSUyMGNsYXNzJTNEJTIyYnotZ2N0YV9fYnRuJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWF1ZGl0JTJGJTIyJTNFUmVxdWVzdCUyMGF1ZGl0JTNDJTJGYSUzRSUzQyUyRmFzaWRlJTNFJTNDc3R5bGUlMjBpZCUzRCUyMmJ6LWdjdGEtY3NzJTIyJTNFLmJ6LWdjdGElN0JiYWNrZ3JvdW5kJTNBJTIzMTYxNTE0JTNCY29sb3IlM0ElMjNmNGYyZWYlM0Jib3JkZXItcmFkaXVzJTNBMTVweCUzQnBhZGRpbmclM0EzNnB4JTNCbWFyZ2luJTNBNTZweCUyMGF1dG8lMjAwJTNCbWF4LXdpZHRoJTNBNzYwcHglM0J0ZXh0LWFsaWduJTNBbGVmdCU3RC5iei1nY3RhJTIwcC5iei1nY3RhX19rJTdCZm9udC1zaXplJTNBMTNweCFpbXBvcnRhbnQlM0JsZXR0ZXItc3BhY2luZyUzQS4wOGVtJTNCdGV4dC10cmFuc2Zvcm0lM0F1cHBlcmNhc2UlM0Jjb2xvciUzQXJnYmEoMjQ0JTJDMjQyJTJDMjM5JTJDLjY2KSUzQm1hcmdpbiUzQTAlMjAwJTIwMTJweCFpbXBvcnRhbnQlM0JwYWRkaW5nJTNBMCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuNCFpbXBvcnRhbnQlN0QuYnotZ2N0YSUyMGgyJTdCY29sb3IlM0ElMjNmNGYyZWYhaW1wb3J0YW50JTNCZm9udC1zaXplJTNBMjRweCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuMjUhaW1wb3J0YW50JTNCbWFyZ2luJTNBMCUyMDAlMjAxMHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwcCU3QmNvbG9yJTNBcmdiYSgyNDQlMkMyNDIlMkMyMzklMkMuODIpJTNCbWFyZ2luJTNBMCUyMDAlMjAyNHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwYS5iei1nY3RhX19idG4lN0JkaXNwbGF5JTNBaW5saW5lLWZsZXglM0JhbGlnbi1pdGVtcyUzQWNlbnRlciUzQm1pbi1oZWlnaHQlM0E0OHB4JTNCYmFja2dyb3VuZCUzQSUyM2ZmZmYwMCUzQmNvbG9yJTNBJTIzMTYxNTE0IWltcG9ydGFudCUzQmJvcmRlci1yYWRpdXMlM0E0cHglM0JwYWRkaW5nJTNBMTNweCUyMDIycHglM0Jmb250LWZhbWlseSUzQSUyMldvcmslMjBTYW5zJTIyJTJDc2Fucy1zZXJpZiUzQmZvbnQtd2VpZ2h0JTNBNjAwJTNCZm9udC1zaXplJTNBMTVweCUzQmxpbmUtaGVpZ2h0JTNBMS4yJTNCdGV4dC1kZWNvcmF0aW9uJTNBbm9uZSFpbXBvcnRhbnQlM0J0cmFuc2l0aW9uJTNBdHJhbnNmb3JtJTIwLjJzJTIwY3ViaWMtYmV6aWVyKC4yJTJDLjglMkMuMiUyQzEpJTJDYm94LXNoYWRvdyUyMC4ycyUyMGVhc2UlN0QuYnotZ2N0YSUyMGEuYnotZ2N0YV9fYnRuJTNBaG92ZXIlN0J0cmFuc2Zvcm0lM0F0cmFuc2xhdGVZKC0ycHgpJTNCYm94LXNoYWRvdyUzQTAlMjA4cHglMjAxOHB4JTIwLThweCUyMHJnYmEoMCUyQzAlMkMwJTJDLjYpJTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biUzQWZvY3VzLXZpc2libGUlN0JvdXRsaW5lJTNBMnB4JTIwc29saWQlMjAlMjNmZmZmMDAlM0JvdXRsaW5lLW9mZnNldCUzQTNweCU3RCU0MG1lZGlhKG1heC13aWR0aCUzQTY5MHB4KSU3Qi5iei1nY3RhJTdCcGFkZGluZyUzQTI4cHglMjAyMnB4JTdELmJ6LWdjdGElMjBoMiU3QmZvbnQtc2l6ZSUzQTIwcHghaW1wb3J0YW50JTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biU3QndpZHRoJTNBMTAwJTI1JTNCanVzdGlmeS1jb250ZW50JTNBY2VudGVyJTdEJTdEJTNDJTJGc3R5bGUlM0UlM0MlMkZkaXYlM0UlMEElM0NzY3JpcHQlMjB0eXBlJTNEJTIyYXBwbGljYXRpb24lMkZsZCUyQmpzb24lMjIlM0UlN0IlMjIlNDBjb250ZXh0JTIyJTNBJTIwJTIyaHR0cHMlM0ElMkYlMkZzY2hlbWEub3JnJTIyJTJDJTIwJTIyJTQwdHlwZSUyMiUzQSUyMCUyMkRlZmluZWRUZXJtJTIyJTJDJTIwJTIybmFtZSUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjIlMkMlMjAlMjJkZXNjcmlwdGlvbiUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjBhcmUlMjBib3RzJTIwZnJvbSUyMEFJJTIwcHJvdmlkZXJzJTIwdGhhdCUyMGZldGNoJTIwd2Vic2l0ZXMlMkMlMjBlaXRoZXIlMjB0byUyMGNvbGxlY3QlMjB0cmFpbmluZyUyMGRhdGElMjBvciUyMHRvJTIwcmV0cmlldmUlMjBjb250ZW50JTIwdG8lMjBhbnN3ZXIlMjBhJTIwc3BlY2lmaWMlMjBxdWVzdGlvbi4lMjIlMkMlMjAlMjJpbkxhbmd1YWdlJTIyJTNBJTIwJTIyZGUlMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZhaS1jcmF3bGVycyUyRiUyMiUyQyUyMCUyMmluRGVmaW5lZFRlcm1TZXQlMjIlM0ElMjAlN0IlMjIlNDB0eXBlJTIyJTNBJTIwJTIyRGVmaW5lZFRlcm1TZXQlMjIlMkMlMjAlMjJuYW1lJTIyJTNBJTIwJTIyR0VPJTIwR2xvc3NhcnklMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkYlMjIlN0QlN0QlM0MlMkZzY3JpcHQlM0U=[\/vc_raw_html][\/vc_column][\/vc_row]\n","protected":false},"excerpt":{"rendered":"<p>[vc_row type=&#8221;in_container&#8221; full_screen_row_position=&#8221;middle&#8221; column_margin=&#8221;default&#8221; column_direction=&#8221;default&#8221; scene_position=&#8221;center&#8221; text_color=&#8221;dark&#8221; text_align=&#8221;left&#8221; overlay_strength=&#8221;0.3&#8243; shape_divider_position=&#8221;bottom&#8221;][vc_column column_padding=&#8221;no-extra-padding&#8221; column_padding_position=&#8221;all&#8221; background_color_opacity=&#8221;1&#8243; background_hover_color_opacity=&#8221;1&#8243; width=&#8221;1\/1&#8243;][vc_raw_html]JTNDZGl2JTIwY2xhc3MlM0QlMjJiei10ZXJtLXdyYXAlMjIlM0UlM0NhcnRpY2xlJTIwY2xhc3MlM0QlMjJiei10ZXJtJTIyJTIwZGF0YS10ZXJtJTNEJTIya2ktY3Jhd2xlciUyMiUzRSUwQSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2V5JTIyJTNFR0VPJTIwR2xvc3NhcnklM0MlMkZwJTNFJTBBJTNDaDElM0VBSSUyMGNyYXdsZXJzJTNDJTJGaDElM0UlMEElM0NwJTIwY2xhc3MlM0QlMjJiei10ZXJtX19kZWYlMjIlM0UlM0NzdHJvbmclM0VBSSUyMGNyYXdsZXJzJTIwYXJlJTIwYm90cyUyMGZyb20lMjBBSSUyMHByb3ZpZGVycyUyMHRoYXQlMjBmZXRjaCUyMHdlYnNpdGVzJTJDJTIwZWl0aGVyJTIwdG8lMjBjb2xsZWN0JTIwdHJhaW5pbmclMjBkYXRhJTIwb3IlMjB0byUyMHJldHJpZXZlJTIwY29udGVudCUyMHRvJTIwYW5zd2VyJTIwYSUyMHNwZWNpZmljJTIwcXVlc3Rpb24uJTNDJTJGc3Ryb25nJTNFJTNDJTJGcCUzRSUwQSUzQ2gyJTNFQXQlMjBhJTIwZ2xhbmNlJTNDJTJGaDIlM0UlMEElM0NmaWd1cmUlMjBjbGFzcyUzRCUyMmJ6LXR4JTIyJTNFJTNDZmlnY2FwdGlvbiUzRSUyRiUyRiUyMHR3byUyMGtpbmRzJTIwb2YlMjBhaSUyMGNyYXdsZXJzJTNDJTJGZmlnY2FwdGlvbiUzRSUzQ3ByZSUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBrJTIyJTNFVFJBSU5JTkclM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyMEdQVEJvdCUyMCVDMiVCNyUyMENsYXVkZUJvdCUyMCVDMiVCNyUyMENDQm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBjJTIyJTNFJTIwJTIwY29sbGVjdCUyMHRleHQlMjBmb3IlMjBmdXR1cmUlMjBtb2RlbHMlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGQlMjIlM0UlMjAlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGslMjIlM0VTRUFSQ0glMjBBTkQlMjBBTlNXRVIlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyME9BSS1TZWFyY2hCb3QlMjAlQzIlQjclMjBQZXJwbGV4aXR5Qm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjB5JTIyJTNFJTIwJTIwZmV0Y2glMjBjb250ZW50JTIwZm9yJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzJTNDJTJGc3BhbiUzRSUzQyUyRnByZSUzRSUzQyUyRmZpZ3VyZSUzRSUwQSUzQ2gyJTNFRXhhbXBsZSUzQyUyRmgyJTNFJTBBJTNDcCUzRUlmJTIwYSUyMHdlYnNpdGUlMjBibG9ja3MlMjBhbGwlMjBBSSUyMGJvdHMlMjB3aG9sZXNhbGUlMjBpbiUyMHJvYm90cy50eHQlMkMlMjBpdCUyMGVuZHMlMjB1cCUyMG5laXRoZXIlMjBpbiUyMHRyYWluaW5nJTIwZGF0YSUyMG5vciUyMGluJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzLiUyME1hbnklMjBzaXRlcyUyMGhhdmUlMjBkb25lJTIwdGhpcyUyMHVubm90aWNlZCUyQyUyMGZvciUyMGV4YW1wbGUlMjB0aHJvdWdoJTIwYSUyMGRlZmF1bHQlMjBzZXR0aW5nJTIwaW4lMjB0aGUlMjBDRE4lMjBvciUyMGElMjBzZWN1cml0eSUyMHBsdWdpbi4lM0MlMkZwJTNFJTBBJTNDaDIlM0VJbiUyMHByYWN0aWNlJTNDJTJGaDIlM0UlMEElM0NwJTNFQ2hlY2slMjB5b3VyJTIwcm9ib3RzLnR4dCUyMGFuZCUyMHlvdXIlMjBob3N0aW5nJTIwb3IlMjBDRE4lMjBzZXR0aW5ncy4lMjBJZiUyMHlvdSUyMHdhbnQlMjB0byUyMGJlJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUyQyUyMHlvdSUyMHNob3VsZCUyMGF0JTIwbGVhc3QlMjBhbGxvdyUyMHRoZSUyMHNlYXJjaCUyMGJvdHMuJTIwV2hldGhlciUyMHlvdSUyMGFsc28lMjBhbGxvdyUyMHRyYWluaW5nJTIwYm90cyUyMGlzJTIwYSUyMHNlcGFyYXRlJTIwZGVjaXNpb24uJTNDJTJGcCUzRSUwQSUzQ2gyJTNFSG93JTIwaXQlMjBmaXRzJTIwdG9nZXRoZXIlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2N0eCUyMiUzRVRyYWluaW5nJTIwYm90cyUyMGZpbGwlMjB0aGUlMjAlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnRyYWluaW5nLWRhdGElMkYlMjIlM0VUcmFpbmluZyUyMGRhdGElM0MlMkZhJTNFJTJDJTIwc2VhcmNoJTIwYm90cyUyMGRlbGl2ZXIlMjB0aGUlMjBjb250ZW50JTIwZm9yJTIwJTNDYSUyMGNsYXNzJTNEJTIyYnotdGVybS1saW5rJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZyYWclMkYlMjIlM0VSQUclM0MlMkZhJTNFLiUyMFRoZSUyMCUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGbGxtcy10eHQlMkYlMjIlM0VsbG1zLnR4dCUzQyUyRmElM0UlMjBpcyUyMGElMjB2b2x1bnRhcnklMjBleHRyYSUyMG9mZmVyZWQlMjB0byUyMHRoZXNlJTIwYm90cy4lM0MlMkZwJTNFJTNDaDIlM0VSZWxhdGVkJTIwdGVybXMlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX3JlbCUyMiUzRSUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGdHJhaW5pbmctZGF0YSUyRiUyMiUzRVRyYWluaW5nJTIwZGF0YSUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnJhZyUyRiUyMiUzRVJBRyUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRmxsbXMtdHh0JTJGJTIyJTNFbGxtcy50eHQlM0MlMkZhJTNFJTNDJTJGcCUzRSUwQSUzQyUyRmFydGljbGUlM0UlM0Nhc2lkZSUyMGNsYXNzJTNEJTIyYnotZ2N0YSUyMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LWdjdGFfX2slMjIlM0VHRU8lMjBhdWRpdCUzQyUyRnAlM0UlM0NoMiUzRUlzJTIweW91ciUyMGJyYW5kJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUzRiUzQyUyRmgyJTNFJTNDcCUzRUklRTIlODAlOTlsbCUyMGNoZWNrJTIwaXQlMjBmb3IlMjB5b3UlM0ElMjBpbiUyMENoYXRHUFQlMkMlMjBHZW1pbmklMjBhbmQlMjBQZXJwbGV4aXR5LiUyMEZyZWUlMjBhbmQlMjB3aXRob3V0JTIwb2JsaWdhdGlvbiUyQyUyMGFzJTIwYSUyMHZpZGVvJTIwd2l0aGluJTIwNDglMjBob3Vycy4lM0MlMkZwJTNFJTNDYSUyMGNsYXNzJTNEJTIyYnotZ2N0YV9fYnRuJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWF1ZGl0JTJGJTIyJTNFUmVxdWVzdCUyMGF1ZGl0JTNDJTJGYSUzRSUzQyUyRmFzaWRlJTNFJTNDc3R5bGUlMjBpZCUzRCUyMmJ6LWdjdGEtY3NzJTIyJTNFLmJ6LWdjdGElN0JiYWNrZ3JvdW5kJTNBJTIzMTYxNTE0JTNCY29sb3IlM0ElMjNmNGYyZWYlM0Jib3JkZXItcmFkaXVzJTNBMTVweCUzQnBhZGRpbmclM0EzNnB4JTNCbWFyZ2luJTNBNTZweCUyMGF1dG8lMjAwJTNCbWF4LXdpZHRoJTNBNzYwcHglM0J0ZXh0LWFsaWduJTNBbGVmdCU3RC5iei1nY3RhJTIwcC5iei1nY3RhX19rJTdCZm9udC1zaXplJTNBMTNweCFpbXBvcnRhbnQlM0JsZXR0ZXItc3BhY2luZyUzQS4wOGVtJTNCdGV4dC10cmFuc2Zvcm0lM0F1cHBlcmNhc2UlM0Jjb2xvciUzQXJnYmEoMjQ0JTJDMjQyJTJDMjM5JTJDLjY2KSUzQm1hcmdpbiUzQTAlMjAwJTIwMTJweCFpbXBvcnRhbnQlM0JwYWRkaW5nJTNBMCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuNCFpbXBvcnRhbnQlN0QuYnotZ2N0YSUyMGgyJTdCY29sb3IlM0ElMjNmNGYyZWYhaW1wb3J0YW50JTNCZm9udC1zaXplJTNBMjRweCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuMjUhaW1wb3J0YW50JTNCbWFyZ2luJTNBMCUyMDAlMjAxMHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwcCU3QmNvbG9yJTNBcmdiYSgyNDQlMkMyNDIlMkMyMzklMkMuODIpJTNCbWFyZ2luJTNBMCUyMDAlMjAyNHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwYS5iei1nY3RhX19idG4lN0JkaXNwbGF5JTNBaW5saW5lLWZsZXglM0JhbGlnbi1pdGVtcyUzQWNlbnRlciUzQm1pbi1oZWlnaHQlM0E0OHB4JTNCYmFja2dyb3VuZCUzQSUyM2ZmZmYwMCUzQmNvbG9yJTNBJTIzMTYxNTE0IWltcG9ydGFudCUzQmJvcmRlci1yYWRpdXMlM0E0cHglM0JwYWRkaW5nJTNBMTNweCUyMDIycHglM0Jmb250LWZhbWlseSUzQSUyMldvcmslMjBTYW5zJTIyJTJDc2Fucy1zZXJpZiUzQmZvbnQtd2VpZ2h0JTNBNjAwJTNCZm9udC1zaXplJTNBMTVweCUzQmxpbmUtaGVpZ2h0JTNBMS4yJTNCdGV4dC1kZWNvcmF0aW9uJTNBbm9uZSFpbXBvcnRhbnQlM0J0cmFuc2l0aW9uJTNBdHJhbnNmb3JtJTIwLjJzJTIwY3ViaWMtYmV6aWVyKC4yJTJDLjglMkMuMiUyQzEpJTJDYm94LXNoYWRvdyUyMC4ycyUyMGVhc2UlN0QuYnotZ2N0YSUyMGEuYnotZ2N0YV9fYnRuJTNBaG92ZXIlN0J0cmFuc2Zvcm0lM0F0cmFuc2xhdGVZKC0ycHgpJTNCYm94LXNoYWRvdyUzQTAlMjA4cHglMjAxOHB4JTIwLThweCUyMHJnYmEoMCUyQzAlMkMwJTJDLjYpJTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biUzQWZvY3VzLXZpc2libGUlN0JvdXRsaW5lJTNBMnB4JTIwc29saWQlMjAlMjNmZmZmMDAlM0JvdXRsaW5lLW9mZnNldCUzQTNweCU3RCU0MG1lZGlhKG1heC13aWR0aCUzQTY5MHB4KSU3Qi5iei1nY3RhJTdCcGFkZGluZyUzQTI4cHglMjAyMnB4JTdELmJ6LWdjdGElMjBoMiU3QmZvbnQtc2l6ZSUzQTIwcHghaW1wb3J0YW50JTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biU3QndpZHRoJTNBMTAwJTI1JTNCanVzdGlmeS1jb250ZW50JTNBY2VudGVyJTdEJTdEJTNDJTJGc3R5bGUlM0UlM0MlMkZkaXYlM0UlMEElM0NzY3JpcHQlMjB0eXBlJTNEJTIyYXBwbGljYXRpb24lMkZsZCUyQmpzb24lMjIlM0UlN0IlMjIlNDBjb250ZXh0JTIyJTNBJTIwJTIyaHR0cHMlM0ElMkYlMkZzY2hlbWEub3JnJTIyJTJDJTIwJTIyJTQwdHlwZSUyMiUzQSUyMCUyMkRlZmluZWRUZXJtJTIyJTJDJTIwJTIybmFtZSUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjIlMkMlMjAlMjJkZXNjcmlwdGlvbiUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjBhcmUlMjBib3RzJTIwZnJvbSUyMEFJJTIwcHJvdmlkZXJzJTIwdGhhdCUyMGZldGNoJTIwd2Vic2l0ZXMlMkMlMjBlaXRoZXIlMjB0byUyMGNvbGxlY3QlMjB0cmFpbmluZyUyMGRhdGElMjBvciUyMHRvJTIwcmV0cmlldmUlMjBjb250ZW50JTIwdG8lMjBhbnN3ZXIlMjBhJTIwc3BlY2lmaWMlMjBxdWVzdGlvbi4lMjIlMkMlMjAlMjJpbkxhbmd1YWdlJTIyJTNBJTIwJTIyZGUlMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZhaS1jcmF3bGVycyUyRiUyMiUyQyUyMCUyMmluRGVmaW5lZFRlcm1TZXQlMjIlM0ElMjAlN0IlMjIlNDB0eXBlJTIyJTNBJTIwJTIyRGVmaW5lZFRlcm1TZXQlMjIlMkMlMjAlMjJuYW1lJTIyJTNBJTIwJTIyR0VPJTIwR2xvc3NhcnklMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkYlMjIlN0QlN0QlM0MlMkZzY3JpcHQlM0U=[\/vc_raw_html][\/vc_column][\/vc_row]<\/p>\n","protected":false},"author":2,"featured_media":11363,"parent":12056,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_wp_convertkit_post_meta":{"form":"-1","landing_page":"0","tag":"0","restrict_content":"0"},"footnotes":""},"class_list":["post-12106","page","type-page","status-publish","has-post-thumbnail"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>AI crawlers - bernard.digital<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI crawlers - bernard.digital\" \/>\n<meta property=\"og:description\" content=\"[vc_row type=&#8221;in_container&#8221; full_screen_row_position=&#8221;middle&#8221; column_margin=&#8221;default&#8221; column_direction=&#8221;default&#8221; scene_position=&#8221;center&#8221; text_color=&#8221;dark&#8221; text_align=&#8221;left&#8221; overlay_strength=&#8221;0.3&#8243; shape_divider_position=&#8221;bottom&#8221;][vc_column column_padding=&#8221;no-extra-padding&#8221; column_padding_position=&#8221;all&#8221; background_color_opacity=&#8221;1&#8243; background_hover_color_opacity=&#8221;1&#8243; width=&#8221;1\/1&#8243;][vc_raw_html]JTNDZGl2JTIwY2xhc3MlM0QlMjJiei10ZXJtLXdyYXAlMjIlM0UlM0NhcnRpY2xlJTIwY2xhc3MlM0QlMjJiei10ZXJtJTIyJTIwZGF0YS10ZXJtJTNEJTIya2ktY3Jhd2xlciUyMiUzRSUwQSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2V5JTIyJTNFR0VPJTIwR2xvc3NhcnklM0MlMkZwJTNFJTBBJTNDaDElM0VBSSUyMGNyYXdsZXJzJTNDJTJGaDElM0UlMEElM0NwJTIwY2xhc3MlM0QlMjJiei10ZXJtX19kZWYlMjIlM0UlM0NzdHJvbmclM0VBSSUyMGNyYXdsZXJzJTIwYXJlJTIwYm90cyUyMGZyb20lMjBBSSUyMHByb3ZpZGVycyUyMHRoYXQlMjBmZXRjaCUyMHdlYnNpdGVzJTJDJTIwZWl0aGVyJTIwdG8lMjBjb2xsZWN0JTIwdHJhaW5pbmclMjBkYXRhJTIwb3IlMjB0byUyMHJldHJpZXZlJTIwY29udGVudCUyMHRvJTIwYW5zd2VyJTIwYSUyMHNwZWNpZmljJTIwcXVlc3Rpb24uJTNDJTJGc3Ryb25nJTNFJTNDJTJGcCUzRSUwQSUzQ2gyJTNFQXQlMjBhJTIwZ2xhbmNlJTNDJTJGaDIlM0UlMEElM0NmaWd1cmUlMjBjbGFzcyUzRCUyMmJ6LXR4JTIyJTNFJTNDZmlnY2FwdGlvbiUzRSUyRiUyRiUyMHR3byUyMGtpbmRzJTIwb2YlMjBhaSUyMGNyYXdsZXJzJTNDJTJGZmlnY2FwdGlvbiUzRSUzQ3ByZSUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBrJTIyJTNFVFJBSU5JTkclM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyMEdQVEJvdCUyMCVDMiVCNyUyMENsYXVkZUJvdCUyMCVDMiVCNyUyMENDQm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBjJTIyJTNFJTIwJTIwY29sbGVjdCUyMHRleHQlMjBmb3IlMjBmdXR1cmUlMjBtb2RlbHMlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGQlMjIlM0UlMjAlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGslMjIlM0VTRUFSQ0glMjBBTkQlMjBBTlNXRVIlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyME9BSS1TZWFyY2hCb3QlMjAlQzIlQjclMjBQZXJwbGV4aXR5Qm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjB5JTIyJTNFJTIwJTIwZmV0Y2glMjBjb250ZW50JTIwZm9yJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzJTNDJTJGc3BhbiUzRSUzQyUyRnByZSUzRSUzQyUyRmZpZ3VyZSUzRSUwQSUzQ2gyJTNFRXhhbXBsZSUzQyUyRmgyJTNFJTBBJTNDcCUzRUlmJTIwYSUyMHdlYnNpdGUlMjBibG9ja3MlMjBhbGwlMjBBSSUyMGJvdHMlMjB3aG9sZXNhbGUlMjBpbiUyMHJvYm90cy50eHQlMkMlMjBpdCUyMGVuZHMlMjB1cCUyMG5laXRoZXIlMjBpbiUyMHRyYWluaW5nJTIwZGF0YSUyMG5vciUyMGluJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzLiUyME1hbnklMjBzaXRlcyUyMGhhdmUlMjBkb25lJTIwdGhpcyUyMHVubm90aWNlZCUyQyUyMGZvciUyMGV4YW1wbGUlMjB0aHJvdWdoJTIwYSUyMGRlZmF1bHQlMjBzZXR0aW5nJTIwaW4lMjB0aGUlMjBDRE4lMjBvciUyMGElMjBzZWN1cml0eSUyMHBsdWdpbi4lM0MlMkZwJTNFJTBBJTNDaDIlM0VJbiUyMHByYWN0aWNlJTNDJTJGaDIlM0UlMEElM0NwJTNFQ2hlY2slMjB5b3VyJTIwcm9ib3RzLnR4dCUyMGFuZCUyMHlvdXIlMjBob3N0aW5nJTIwb3IlMjBDRE4lMjBzZXR0aW5ncy4lMjBJZiUyMHlvdSUyMHdhbnQlMjB0byUyMGJlJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUyQyUyMHlvdSUyMHNob3VsZCUyMGF0JTIwbGVhc3QlMjBhbGxvdyUyMHRoZSUyMHNlYXJjaCUyMGJvdHMuJTIwV2hldGhlciUyMHlvdSUyMGFsc28lMjBhbGxvdyUyMHRyYWluaW5nJTIwYm90cyUyMGlzJTIwYSUyMHNlcGFyYXRlJTIwZGVjaXNpb24uJTNDJTJGcCUzRSUwQSUzQ2gyJTNFSG93JTIwaXQlMjBmaXRzJTIwdG9nZXRoZXIlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2N0eCUyMiUzRVRyYWluaW5nJTIwYm90cyUyMGZpbGwlMjB0aGUlMjAlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnRyYWluaW5nLWRhdGElMkYlMjIlM0VUcmFpbmluZyUyMGRhdGElM0MlMkZhJTNFJTJDJTIwc2VhcmNoJTIwYm90cyUyMGRlbGl2ZXIlMjB0aGUlMjBjb250ZW50JTIwZm9yJTIwJTNDYSUyMGNsYXNzJTNEJTIyYnotdGVybS1saW5rJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZyYWclMkYlMjIlM0VSQUclM0MlMkZhJTNFLiUyMFRoZSUyMCUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGbGxtcy10eHQlMkYlMjIlM0VsbG1zLnR4dCUzQyUyRmElM0UlMjBpcyUyMGElMjB2b2x1bnRhcnklMjBleHRyYSUyMG9mZmVyZWQlMjB0byUyMHRoZXNlJTIwYm90cy4lM0MlMkZwJTNFJTNDaDIlM0VSZWxhdGVkJTIwdGVybXMlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX3JlbCUyMiUzRSUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGdHJhaW5pbmctZGF0YSUyRiUyMiUzRVRyYWluaW5nJTIwZGF0YSUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnJhZyUyRiUyMiUzRVJBRyUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRmxsbXMtdHh0JTJGJTIyJTNFbGxtcy50eHQlM0MlMkZhJTNFJTNDJTJGcCUzRSUwQSUzQyUyRmFydGljbGUlM0UlM0Nhc2lkZSUyMGNsYXNzJTNEJTIyYnotZ2N0YSUyMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LWdjdGFfX2slMjIlM0VHRU8lMjBhdWRpdCUzQyUyRnAlM0UlM0NoMiUzRUlzJTIweW91ciUyMGJyYW5kJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUzRiUzQyUyRmgyJTNFJTNDcCUzRUklRTIlODAlOTlsbCUyMGNoZWNrJTIwaXQlMjBmb3IlMjB5b3UlM0ElMjBpbiUyMENoYXRHUFQlMkMlMjBHZW1pbmklMjBhbmQlMjBQZXJwbGV4aXR5LiUyMEZyZWUlMjBhbmQlMjB3aXRob3V0JTIwb2JsaWdhdGlvbiUyQyUyMGFzJTIwYSUyMHZpZGVvJTIwd2l0aGluJTIwNDglMjBob3Vycy4lM0MlMkZwJTNFJTNDYSUyMGNsYXNzJTNEJTIyYnotZ2N0YV9fYnRuJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWF1ZGl0JTJGJTIyJTNFUmVxdWVzdCUyMGF1ZGl0JTNDJTJGYSUzRSUzQyUyRmFzaWRlJTNFJTNDc3R5bGUlMjBpZCUzRCUyMmJ6LWdjdGEtY3NzJTIyJTNFLmJ6LWdjdGElN0JiYWNrZ3JvdW5kJTNBJTIzMTYxNTE0JTNCY29sb3IlM0ElMjNmNGYyZWYlM0Jib3JkZXItcmFkaXVzJTNBMTVweCUzQnBhZGRpbmclM0EzNnB4JTNCbWFyZ2luJTNBNTZweCUyMGF1dG8lMjAwJTNCbWF4LXdpZHRoJTNBNzYwcHglM0J0ZXh0LWFsaWduJTNBbGVmdCU3RC5iei1nY3RhJTIwcC5iei1nY3RhX19rJTdCZm9udC1zaXplJTNBMTNweCFpbXBvcnRhbnQlM0JsZXR0ZXItc3BhY2luZyUzQS4wOGVtJTNCdGV4dC10cmFuc2Zvcm0lM0F1cHBlcmNhc2UlM0Jjb2xvciUzQXJnYmEoMjQ0JTJDMjQyJTJDMjM5JTJDLjY2KSUzQm1hcmdpbiUzQTAlMjAwJTIwMTJweCFpbXBvcnRhbnQlM0JwYWRkaW5nJTNBMCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuNCFpbXBvcnRhbnQlN0QuYnotZ2N0YSUyMGgyJTdCY29sb3IlM0ElMjNmNGYyZWYhaW1wb3J0YW50JTNCZm9udC1zaXplJTNBMjRweCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuMjUhaW1wb3J0YW50JTNCbWFyZ2luJTNBMCUyMDAlMjAxMHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwcCU3QmNvbG9yJTNBcmdiYSgyNDQlMkMyNDIlMkMyMzklMkMuODIpJTNCbWFyZ2luJTNBMCUyMDAlMjAyNHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwYS5iei1nY3RhX19idG4lN0JkaXNwbGF5JTNBaW5saW5lLWZsZXglM0JhbGlnbi1pdGVtcyUzQWNlbnRlciUzQm1pbi1oZWlnaHQlM0E0OHB4JTNCYmFja2dyb3VuZCUzQSUyM2ZmZmYwMCUzQmNvbG9yJTNBJTIzMTYxNTE0IWltcG9ydGFudCUzQmJvcmRlci1yYWRpdXMlM0E0cHglM0JwYWRkaW5nJTNBMTNweCUyMDIycHglM0Jmb250LWZhbWlseSUzQSUyMldvcmslMjBTYW5zJTIyJTJDc2Fucy1zZXJpZiUzQmZvbnQtd2VpZ2h0JTNBNjAwJTNCZm9udC1zaXplJTNBMTVweCUzQmxpbmUtaGVpZ2h0JTNBMS4yJTNCdGV4dC1kZWNvcmF0aW9uJTNBbm9uZSFpbXBvcnRhbnQlM0J0cmFuc2l0aW9uJTNBdHJhbnNmb3JtJTIwLjJzJTIwY3ViaWMtYmV6aWVyKC4yJTJDLjglMkMuMiUyQzEpJTJDYm94LXNoYWRvdyUyMC4ycyUyMGVhc2UlN0QuYnotZ2N0YSUyMGEuYnotZ2N0YV9fYnRuJTNBaG92ZXIlN0J0cmFuc2Zvcm0lM0F0cmFuc2xhdGVZKC0ycHgpJTNCYm94LXNoYWRvdyUzQTAlMjA4cHglMjAxOHB4JTIwLThweCUyMHJnYmEoMCUyQzAlMkMwJTJDLjYpJTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biUzQWZvY3VzLXZpc2libGUlN0JvdXRsaW5lJTNBMnB4JTIwc29saWQlMjAlMjNmZmZmMDAlM0JvdXRsaW5lLW9mZnNldCUzQTNweCU3RCU0MG1lZGlhKG1heC13aWR0aCUzQTY5MHB4KSU3Qi5iei1nY3RhJTdCcGFkZGluZyUzQTI4cHglMjAyMnB4JTdELmJ6LWdjdGElMjBoMiU3QmZvbnQtc2l6ZSUzQTIwcHghaW1wb3J0YW50JTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biU3QndpZHRoJTNBMTAwJTI1JTNCanVzdGlmeS1jb250ZW50JTNBY2VudGVyJTdEJTdEJTNDJTJGc3R5bGUlM0UlM0MlMkZkaXYlM0UlMEElM0NzY3JpcHQlMjB0eXBlJTNEJTIyYXBwbGljYXRpb24lMkZsZCUyQmpzb24lMjIlM0UlN0IlMjIlNDBjb250ZXh0JTIyJTNBJTIwJTIyaHR0cHMlM0ElMkYlMkZzY2hlbWEub3JnJTIyJTJDJTIwJTIyJTQwdHlwZSUyMiUzQSUyMCUyMkRlZmluZWRUZXJtJTIyJTJDJTIwJTIybmFtZSUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjIlMkMlMjAlMjJkZXNjcmlwdGlvbiUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjBhcmUlMjBib3RzJTIwZnJvbSUyMEFJJTIwcHJvdmlkZXJzJTIwdGhhdCUyMGZldGNoJTIwd2Vic2l0ZXMlMkMlMjBlaXRoZXIlMjB0byUyMGNvbGxlY3QlMjB0cmFpbmluZyUyMGRhdGElMjBvciUyMHRvJTIwcmV0cmlldmUlMjBjb250ZW50JTIwdG8lMjBhbnN3ZXIlMjBhJTIwc3BlY2lmaWMlMjBxdWVzdGlvbi4lMjIlMkMlMjAlMjJpbkxhbmd1YWdlJTIyJTNBJTIwJTIyZGUlMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZhaS1jcmF3bGVycyUyRiUyMiUyQyUyMCUyMmluRGVmaW5lZFRlcm1TZXQlMjIlM0ElMjAlN0IlMjIlNDB0eXBlJTIyJTNBJTIwJTIyRGVmaW5lZFRlcm1TZXQlMjIlMkMlMjAlMjJuYW1lJTIyJTNBJTIwJTIyR0VPJTIwR2xvc3NhcnklMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkYlMjIlN0QlN0QlM0MlMkZzY3JpcHQlM0U=[\/vc_raw_html][\/vc_column][\/vc_row]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/\" \/>\n<meta property=\"og:site_name\" content=\"bernard.digital\" \/>\n<meta property=\"article:modified_time\" content=\"2026-10-29T09:20:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/bernard.digital\/wp-content\/uploads\/2026\/10\/og-geo-handbuch-glossar-ki-crawler.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/\",\"url\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/\",\"name\":\"AI crawlers - bernard.digital\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/bernard.digital\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/og-geo-handbuch-glossar-ki-crawler.jpg\",\"datePublished\":\"2026-10-29T09:06:49+00:00\",\"dateModified\":\"2026-10-29T09:20:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/#primaryimage\",\"url\":\"https:\\\/\\\/bernard.digital\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/og-geo-handbuch-glossar-ki-crawler.jpg\",\"contentUrl\":\"https:\\\/\\\/bernard.digital\\\/wp-content\\\/uploads\\\/2026\\\/10\\\/og-geo-handbuch-glossar-ki-crawler.jpg\",\"width\":1200,\"height\":630,\"caption\":\"KI-Crawler\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbook\\\/glossary\\\/ai-crawlers\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Start\",\"item\":\"https:\\\/\\\/bernard.digital\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"GEO Handbook\",\"item\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbuch\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"GEO Glossary\",\"item\":\"https:\\\/\\\/bernard.digital\\\/en\\\/geo-handbuch\\\/glossar\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"AI crawlers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/bernard.digital\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/bernard.digital\\\/en\\\/\",\"name\":\"bernard.digital\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/bernard.digital\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI crawlers - bernard.digital","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/","og_locale":"en_US","og_type":"article","og_title":"AI crawlers - bernard.digital","og_description":"[vc_row type=&#8221;in_container&#8221; full_screen_row_position=&#8221;middle&#8221; column_margin=&#8221;default&#8221; column_direction=&#8221;default&#8221; scene_position=&#8221;center&#8221; text_color=&#8221;dark&#8221; text_align=&#8221;left&#8221; overlay_strength=&#8221;0.3&#8243; shape_divider_position=&#8221;bottom&#8221;][vc_column column_padding=&#8221;no-extra-padding&#8221; column_padding_position=&#8221;all&#8221; background_color_opacity=&#8221;1&#8243; background_hover_color_opacity=&#8221;1&#8243; width=&#8221;1\/1&#8243;][vc_raw_html]JTNDZGl2JTIwY2xhc3MlM0QlMjJiei10ZXJtLXdyYXAlMjIlM0UlM0NhcnRpY2xlJTIwY2xhc3MlM0QlMjJiei10ZXJtJTIyJTIwZGF0YS10ZXJtJTNEJTIya2ktY3Jhd2xlciUyMiUzRSUwQSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2V5JTIyJTNFR0VPJTIwR2xvc3NhcnklM0MlMkZwJTNFJTBBJTNDaDElM0VBSSUyMGNyYXdsZXJzJTNDJTJGaDElM0UlMEElM0NwJTIwY2xhc3MlM0QlMjJiei10ZXJtX19kZWYlMjIlM0UlM0NzdHJvbmclM0VBSSUyMGNyYXdsZXJzJTIwYXJlJTIwYm90cyUyMGZyb20lMjBBSSUyMHByb3ZpZGVycyUyMHRoYXQlMjBmZXRjaCUyMHdlYnNpdGVzJTJDJTIwZWl0aGVyJTIwdG8lMjBjb2xsZWN0JTIwdHJhaW5pbmclMjBkYXRhJTIwb3IlMjB0byUyMHJldHJpZXZlJTIwY29udGVudCUyMHRvJTIwYW5zd2VyJTIwYSUyMHNwZWNpZmljJTIwcXVlc3Rpb24uJTNDJTJGc3Ryb25nJTNFJTNDJTJGcCUzRSUwQSUzQ2gyJTNFQXQlMjBhJTIwZ2xhbmNlJTNDJTJGaDIlM0UlMEElM0NmaWd1cmUlMjBjbGFzcyUzRCUyMmJ6LXR4JTIyJTNFJTNDZmlnY2FwdGlvbiUzRSUyRiUyRiUyMHR3byUyMGtpbmRzJTIwb2YlMjBhaSUyMGNyYXdsZXJzJTNDJTJGZmlnY2FwdGlvbiUzRSUzQ3ByZSUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBrJTIyJTNFVFJBSU5JTkclM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyMEdQVEJvdCUyMCVDMiVCNyUyMENsYXVkZUJvdCUyMCVDMiVCNyUyMENDQm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjBjJTIyJTNFJTIwJTIwY29sbGVjdCUyMHRleHQlMjBmb3IlMjBmdXR1cmUlMjBtb2RlbHMlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGQlMjIlM0UlMjAlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMGslMjIlM0VTRUFSQ0glMjBBTkQlMjBBTlNXRVIlM0MlMkZzcGFuJTNFJTNDc3BhbiUyMGNsYXNzJTNEJTIybCUyMiUzRSUyMCUyME9BSS1TZWFyY2hCb3QlMjAlQzIlQjclMjBQZXJwbGV4aXR5Qm90JTNDJTJGc3BhbiUzRSUzQ3NwYW4lMjBjbGFzcyUzRCUyMmwlMjB5JTIyJTNFJTIwJTIwZmV0Y2glMjBjb250ZW50JTIwZm9yJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzJTNDJTJGc3BhbiUzRSUzQyUyRnByZSUzRSUzQyUyRmZpZ3VyZSUzRSUwQSUzQ2gyJTNFRXhhbXBsZSUzQyUyRmgyJTNFJTBBJTNDcCUzRUlmJTIwYSUyMHdlYnNpdGUlMjBibG9ja3MlMjBhbGwlMjBBSSUyMGJvdHMlMjB3aG9sZXNhbGUlMjBpbiUyMHJvYm90cy50eHQlMkMlMjBpdCUyMGVuZHMlMjB1cCUyMG5laXRoZXIlMjBpbiUyMHRyYWluaW5nJTIwZGF0YSUyMG5vciUyMGluJTIwYW5zd2VycyUyMHdpdGglMjBzb3VyY2VzLiUyME1hbnklMjBzaXRlcyUyMGhhdmUlMjBkb25lJTIwdGhpcyUyMHVubm90aWNlZCUyQyUyMGZvciUyMGV4YW1wbGUlMjB0aHJvdWdoJTIwYSUyMGRlZmF1bHQlMjBzZXR0aW5nJTIwaW4lMjB0aGUlMjBDRE4lMjBvciUyMGElMjBzZWN1cml0eSUyMHBsdWdpbi4lM0MlMkZwJTNFJTBBJTNDaDIlM0VJbiUyMHByYWN0aWNlJTNDJTJGaDIlM0UlMEElM0NwJTNFQ2hlY2slMjB5b3VyJTIwcm9ib3RzLnR4dCUyMGFuZCUyMHlvdXIlMjBob3N0aW5nJTIwb3IlMjBDRE4lMjBzZXR0aW5ncy4lMjBJZiUyMHlvdSUyMHdhbnQlMjB0byUyMGJlJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUyQyUyMHlvdSUyMHNob3VsZCUyMGF0JTIwbGVhc3QlMjBhbGxvdyUyMHRoZSUyMHNlYXJjaCUyMGJvdHMuJTIwV2hldGhlciUyMHlvdSUyMGFsc28lMjBhbGxvdyUyMHRyYWluaW5nJTIwYm90cyUyMGlzJTIwYSUyMHNlcGFyYXRlJTIwZGVjaXNpb24uJTNDJTJGcCUzRSUwQSUzQ2gyJTNFSG93JTIwaXQlMjBmaXRzJTIwdG9nZXRoZXIlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX2N0eCUyMiUzRVRyYWluaW5nJTIwYm90cyUyMGZpbGwlMjB0aGUlMjAlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnRyYWluaW5nLWRhdGElMkYlMjIlM0VUcmFpbmluZyUyMGRhdGElM0MlMkZhJTNFJTJDJTIwc2VhcmNoJTIwYm90cyUyMGRlbGl2ZXIlMjB0aGUlMjBjb250ZW50JTIwZm9yJTIwJTNDYSUyMGNsYXNzJTNEJTIyYnotdGVybS1saW5rJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZyYWclMkYlMjIlM0VSQUclM0MlMkZhJTNFLiUyMFRoZSUyMCUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGbGxtcy10eHQlMkYlMjIlM0VsbG1zLnR4dCUzQyUyRmElM0UlMjBpcyUyMGElMjB2b2x1bnRhcnklMjBleHRyYSUyMG9mZmVyZWQlMjB0byUyMHRoZXNlJTIwYm90cy4lM0MlMkZwJTNFJTNDaDIlM0VSZWxhdGVkJTIwdGVybXMlM0MlMkZoMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LXRlcm1fX3JlbCUyMiUzRSUzQ2ElMjBjbGFzcyUzRCUyMmJ6LXRlcm0tbGluayUyMiUyMGhyZWYlM0QlMjIlMkZlbiUyRmdlby1oYW5kYm9vayUyRmdsb3NzYXJ5JTJGdHJhaW5pbmctZGF0YSUyRiUyMiUzRVRyYWluaW5nJTIwZGF0YSUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRnJhZyUyRiUyMiUzRVJBRyUzQyUyRmElM0UlM0NhJTIwY2xhc3MlM0QlMjJiei10ZXJtLWxpbmslMjIlMjBocmVmJTNEJTIyJTJGZW4lMkZnZW8taGFuZGJvb2slMkZnbG9zc2FyeSUyRmxsbXMtdHh0JTJGJTIyJTNFbGxtcy50eHQlM0MlMkZhJTNFJTNDJTJGcCUzRSUwQSUzQyUyRmFydGljbGUlM0UlM0Nhc2lkZSUyMGNsYXNzJTNEJTIyYnotZ2N0YSUyMiUzRSUzQ3AlMjBjbGFzcyUzRCUyMmJ6LWdjdGFfX2slMjIlM0VHRU8lMjBhdWRpdCUzQyUyRnAlM0UlM0NoMiUzRUlzJTIweW91ciUyMGJyYW5kJTIwbmFtZWQlMjBpbiUyMEFJJTIwYW5zd2VycyUzRiUzQyUyRmgyJTNFJTNDcCUzRUklRTIlODAlOTlsbCUyMGNoZWNrJTIwaXQlMjBmb3IlMjB5b3UlM0ElMjBpbiUyMENoYXRHUFQlMkMlMjBHZW1pbmklMjBhbmQlMjBQZXJwbGV4aXR5LiUyMEZyZWUlMjBhbmQlMjB3aXRob3V0JTIwb2JsaWdhdGlvbiUyQyUyMGFzJTIwYSUyMHZpZGVvJTIwd2l0aGluJTIwNDglMjBob3Vycy4lM0MlMkZwJTNFJTNDYSUyMGNsYXNzJTNEJTIyYnotZ2N0YV9fYnRuJTIyJTIwaHJlZiUzRCUyMiUyRmVuJTJGZ2VvLWF1ZGl0JTJGJTIyJTNFUmVxdWVzdCUyMGF1ZGl0JTNDJTJGYSUzRSUzQyUyRmFzaWRlJTNFJTNDc3R5bGUlMjBpZCUzRCUyMmJ6LWdjdGEtY3NzJTIyJTNFLmJ6LWdjdGElN0JiYWNrZ3JvdW5kJTNBJTIzMTYxNTE0JTNCY29sb3IlM0ElMjNmNGYyZWYlM0Jib3JkZXItcmFkaXVzJTNBMTVweCUzQnBhZGRpbmclM0EzNnB4JTNCbWFyZ2luJTNBNTZweCUyMGF1dG8lMjAwJTNCbWF4LXdpZHRoJTNBNzYwcHglM0J0ZXh0LWFsaWduJTNBbGVmdCU3RC5iei1nY3RhJTIwcC5iei1nY3RhX19rJTdCZm9udC1zaXplJTNBMTNweCFpbXBvcnRhbnQlM0JsZXR0ZXItc3BhY2luZyUzQS4wOGVtJTNCdGV4dC10cmFuc2Zvcm0lM0F1cHBlcmNhc2UlM0Jjb2xvciUzQXJnYmEoMjQ0JTJDMjQyJTJDMjM5JTJDLjY2KSUzQm1hcmdpbiUzQTAlMjAwJTIwMTJweCFpbXBvcnRhbnQlM0JwYWRkaW5nJTNBMCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuNCFpbXBvcnRhbnQlN0QuYnotZ2N0YSUyMGgyJTdCY29sb3IlM0ElMjNmNGYyZWYhaW1wb3J0YW50JTNCZm9udC1zaXplJTNBMjRweCFpbXBvcnRhbnQlM0JsaW5lLWhlaWdodCUzQTEuMjUhaW1wb3J0YW50JTNCbWFyZ2luJTNBMCUyMDAlMjAxMHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwcCU3QmNvbG9yJTNBcmdiYSgyNDQlMkMyNDIlMkMyMzklMkMuODIpJTNCbWFyZ2luJTNBMCUyMDAlMjAyNHB4IWltcG9ydGFudCUzQnBhZGRpbmclM0EwIWltcG9ydGFudCU3RC5iei1nY3RhJTIwYS5iei1nY3RhX19idG4lN0JkaXNwbGF5JTNBaW5saW5lLWZsZXglM0JhbGlnbi1pdGVtcyUzQWNlbnRlciUzQm1pbi1oZWlnaHQlM0E0OHB4JTNCYmFja2dyb3VuZCUzQSUyM2ZmZmYwMCUzQmNvbG9yJTNBJTIzMTYxNTE0IWltcG9ydGFudCUzQmJvcmRlci1yYWRpdXMlM0E0cHglM0JwYWRkaW5nJTNBMTNweCUyMDIycHglM0Jmb250LWZhbWlseSUzQSUyMldvcmslMjBTYW5zJTIyJTJDc2Fucy1zZXJpZiUzQmZvbnQtd2VpZ2h0JTNBNjAwJTNCZm9udC1zaXplJTNBMTVweCUzQmxpbmUtaGVpZ2h0JTNBMS4yJTNCdGV4dC1kZWNvcmF0aW9uJTNBbm9uZSFpbXBvcnRhbnQlM0J0cmFuc2l0aW9uJTNBdHJhbnNmb3JtJTIwLjJzJTIwY3ViaWMtYmV6aWVyKC4yJTJDLjglMkMuMiUyQzEpJTJDYm94LXNoYWRvdyUyMC4ycyUyMGVhc2UlN0QuYnotZ2N0YSUyMGEuYnotZ2N0YV9fYnRuJTNBaG92ZXIlN0J0cmFuc2Zvcm0lM0F0cmFuc2xhdGVZKC0ycHgpJTNCYm94LXNoYWRvdyUzQTAlMjA4cHglMjAxOHB4JTIwLThweCUyMHJnYmEoMCUyQzAlMkMwJTJDLjYpJTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biUzQWZvY3VzLXZpc2libGUlN0JvdXRsaW5lJTNBMnB4JTIwc29saWQlMjAlMjNmZmZmMDAlM0JvdXRsaW5lLW9mZnNldCUzQTNweCU3RCU0MG1lZGlhKG1heC13aWR0aCUzQTY5MHB4KSU3Qi5iei1nY3RhJTdCcGFkZGluZyUzQTI4cHglMjAyMnB4JTdELmJ6LWdjdGElMjBoMiU3QmZvbnQtc2l6ZSUzQTIwcHghaW1wb3J0YW50JTdELmJ6LWdjdGElMjBhLmJ6LWdjdGFfX2J0biU3QndpZHRoJTNBMTAwJTI1JTNCanVzdGlmeS1jb250ZW50JTNBY2VudGVyJTdEJTdEJTNDJTJGc3R5bGUlM0UlM0MlMkZkaXYlM0UlMEElM0NzY3JpcHQlMjB0eXBlJTNEJTIyYXBwbGljYXRpb24lMkZsZCUyQmpzb24lMjIlM0UlN0IlMjIlNDBjb250ZXh0JTIyJTNBJTIwJTIyaHR0cHMlM0ElMkYlMkZzY2hlbWEub3JnJTIyJTJDJTIwJTIyJTQwdHlwZSUyMiUzQSUyMCUyMkRlZmluZWRUZXJtJTIyJTJDJTIwJTIybmFtZSUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjIlMkMlMjAlMjJkZXNjcmlwdGlvbiUyMiUzQSUyMCUyMkFJJTIwY3Jhd2xlcnMlMjBhcmUlMjBib3RzJTIwZnJvbSUyMEFJJTIwcHJvdmlkZXJzJTIwdGhhdCUyMGZldGNoJTIwd2Vic2l0ZXMlMkMlMjBlaXRoZXIlMjB0byUyMGNvbGxlY3QlMjB0cmFpbmluZyUyMGRhdGElMjBvciUyMHRvJTIwcmV0cmlldmUlMjBjb250ZW50JTIwdG8lMjBhbnN3ZXIlMjBhJTIwc3BlY2lmaWMlMjBxdWVzdGlvbi4lMjIlMkMlMjAlMjJpbkxhbmd1YWdlJTIyJTNBJTIwJTIyZGUlMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkZhaS1jcmF3bGVycyUyRiUyMiUyQyUyMCUyMmluRGVmaW5lZFRlcm1TZXQlMjIlM0ElMjAlN0IlMjIlNDB0eXBlJTIyJTNBJTIwJTIyRGVmaW5lZFRlcm1TZXQlMjIlMkMlMjAlMjJuYW1lJTIyJTNBJTIwJTIyR0VPJTIwR2xvc3NhcnklMjIlMkMlMjAlMjJ1cmwlMjIlM0ElMjAlMjJodHRwcyUzQSUyRiUyRmJlcm5hcmQuZGlnaXRhbCUyRmVuJTJGZ2VvLWhhbmRib29rJTJGZ2xvc3NhcnklMkYlMjIlN0QlN0QlM0MlMkZzY3JpcHQlM0U=[\/vc_raw_html][\/vc_column][\/vc_row]","og_url":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/","og_site_name":"bernard.digital","article_modified_time":"2026-10-29T09:20:00+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/bernard.digital\/wp-content\/uploads\/2026\/10\/og-geo-handbuch-glossar-ki-crawler.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/","url":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/","name":"AI crawlers - bernard.digital","isPartOf":{"@id":"https:\/\/bernard.digital\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/#primaryimage"},"image":{"@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/#primaryimage"},"thumbnailUrl":"https:\/\/bernard.digital\/wp-content\/uploads\/2026\/10\/og-geo-handbuch-glossar-ki-crawler.jpg","datePublished":"2026-10-29T09:06:49+00:00","dateModified":"2026-10-29T09:20:00+00:00","breadcrumb":{"@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/#primaryimage","url":"https:\/\/bernard.digital\/wp-content\/uploads\/2026\/10\/og-geo-handbuch-glossar-ki-crawler.jpg","contentUrl":"https:\/\/bernard.digital\/wp-content\/uploads\/2026\/10\/og-geo-handbuch-glossar-ki-crawler.jpg","width":1200,"height":630,"caption":"KI-Crawler"},{"@type":"BreadcrumbList","@id":"https:\/\/bernard.digital\/en\/geo-handbook\/glossary\/ai-crawlers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Start","item":"https:\/\/bernard.digital\/en\/"},{"@type":"ListItem","position":2,"name":"GEO Handbook","item":"https:\/\/bernard.digital\/en\/geo-handbuch\/"},{"@type":"ListItem","position":3,"name":"GEO Glossary","item":"https:\/\/bernard.digital\/en\/geo-handbuch\/glossar\/"},{"@type":"ListItem","position":4,"name":"AI crawlers"}]},{"@type":"WebSite","@id":"https:\/\/bernard.digital\/en\/#website","url":"https:\/\/bernard.digital\/en\/","name":"bernard.digital","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/bernard.digital\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/pages\/12106","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/comments?post=12106"}],"version-history":[{"count":3,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/pages\/12106\/revisions"}],"predecessor-version":[{"id":12184,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/pages\/12106\/revisions\/12184"}],"up":[{"embeddable":true,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/pages\/12056"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/media\/11363"}],"wp:attachment":[{"href":"https:\/\/bernard.digital\/en\/wp-json\/wp\/v2\/media?parent=12106"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}