Link crawler robot
Premium Certified Partner
Maintained by
Brendan Heywood, Catalyst IT, Daniel Thee Roperto
An admin tool robot crawler which scans your moodle for broken, large or slow links.
Comments
Comments are no longer open for new posts. Existing comments remain available to read.
There is a typo in your newest version - 2025020401
.../moodle.4.5.10-20260415/admin/tool/crawler/classes/robot/crawler.php
PHP Warning: Undefined variable $cookiefilelocation in .../moodle.4.5.10-20260415/admin/tool/crawler/classes/robot/crawler.php on line 1095
Typo is on line 1094:
static $cookiefilelocaion = '';
Missing the letter "t" in 'location' .
https://login.microsoftonline.com/9d83cfc7-6330-47d5-b18d-45bafe3b1d87/saml2?SAML... blah, blah... Is there any way around this?
Crawl start Crawl end Duration Cron ticks Total URLs Total links Broken links Big / slow links
oct 21, 19:28:10 - 41:26:49 7 7.825 111.693 379 287
could someone give me an idea how to make the bot to search into a specific module/course only rather than the whole Moodle site. I am new in using it and doing some testing now - so will appreciate any advice. Thank you!
I'm testing it but not working
Any update to Moodle latest version, please?
Sajjad Hussain
I've installed the plugin to my Moodle 3.4.5 environment that is using a SQL Server database and i'm getting errors from the plugin. When looking into the code, I found that there is SQL specific to MySQL and is not supported by SQL Server. Also I found that the table mdl_tool_crawler_url has a field called "external" which is a keyword in SQL Server.
Has anyone got this plugin to work with a SQL Server DB? Did you run into the same issues I have?
~Adam
Any one help me about why Progress ETA is more than 5 year from crawl start date in robot status tab.
Progress 1.53% ETA in Monday, 21 April 2025, 4:55 AM | Reset Progress
Any updates to M3.6?
Ricardo
Couple of other questions;
1. Is a valid cert required? Your curl command fails due to self-signed cert on my dev machine. can override with -k
2. We are running OKTA/SAML as the default login, again your curl test command returns the OKTA login rather than going to the page. The user is set for basic auth but our default is SAML.
thanks