How do I connect TidyTools to Lodol?

Authenticate TidyTools once from your workspace and every action and trigger it supports becomes available to drop into a workflow. There is no glue code to write or maintain.

All integrations

TidyTools

AnalyticsMonitoringAI Agents

Find out how websites treat AI crawlers, and turn web pages into text an AI can read, with TidyTools' free tools. Check any website now for which of 29 AI crawlers (GPTBot, ClaudeBot, PerplexityBot and more) its robots.txt allows, with a ready-made fix; look up any of 10,000 popular websites in the daily AI Crawler Index; list the sites that block a crawler; follow which sites changed their rules since yesterday; and get the overall blocking figures by crawler and industry. Also turns any web page or PDF into clean Markdown. No account or API key required.

Get Started Browse all integrations

6 actions

Actions

Steps your workflow can run in TidyTools.

Check which AI crawlers a website allowsCheck any website right now: which of 29 AI crawlers, such as ChatGPT's GPTBot, Claude's ClaudeBot and PerplexityBot, its robots.txt file lets in, partly blocks or shuts out, with the exact rule behind each one. Also says whether it has an llms.txt file and Content Signals, scores how visible it is to AI search out of 100, and gives ready-to-paste robots.txt lines that fix any AI search crawlers blocked by mistake.

Turn a web page into MarkdownRead a web page or a PDF and get its text back as clean Markdown, ready to hand to an AI step, save as a note or summarise: headings, links and tables kept, menus and page furniture dropped, up to 100,000 characters. Pages that only show their text after running scripts in a browser come back nearly empty, with a note saying so.

Get AI crawler blocking statisticsGet today's figures from the AI Crawler Index, a daily check of 10,000 popular websites: how many block each of 29 AI crawlers, as counts and percentages, the share among the top 100 sites, how many have an llms.txt file, the breakdown by industry, and the day-by-day trend for the best-known crawlers.

Look up a website in the AI Crawler IndexLook up one of the 10,000 popular websites in today's AI Crawler Index: its industry, how popular it is, its overall stance on AI, which crawlers it allows and blocks, and every change to its rules the index has recorded. Instant, with no live check. Says found is false for a website the index does not cover; use Check which AI crawlers a website allows for those.

Find websites that block an AI crawlerList the popular websites that block one AI crawler, such as GPTBot or ClaudeBot, most popular first, from today's AI Crawler Index of 10,000 websites. Narrow it to one industry or popularity band, and choose fully blocked, partly blocked or both.

List websites that changed their AI crawler rulesSee which of 10,000 popular websites changed their rules for AI crawlers since the day before: who started or stopped blocking a crawler, changed their overall stance, added or removed an llms.txt file, or changed their Content Signals. Narrow it to one crawler or one industry. Run it daily to be told when a competitor or a publisher changes course.