https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlersI have not heard of this term before. Is it something to do with using a bot?"We would like to apologise for the Betfair exchange being unavailable on Saturday from 16:23 to 16:52 and later from 20:55 to 21:16. We disabled betting after web site sphttps://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=531086651#531086651i always thought spiderman was a web crawler?Sun, 07 Apr 2013 21:21:56 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=531035659#531035659there is specialist software that can prevent distributed denial of service DDOS attacks. I wouldnt think any large company has a problem with them now, they would be more of an inconvenience than anything.mtgox, the main bitcoin exchange, is sufferiSat, 06 Apr 2013 05:36:57 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=531035009#531035009Squeaky bum day for Betfair managers.Sat, 06 Apr 2013 04:41:20 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530920961#530920961Not just Betfair though is it. Bet365 has regularly crashed on Champions League nights right at 7.45pm.Mon, 01 Apr 2013 19:32:23 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530917377#530917377Betfair just need to be able to handle the load on weekends.-----------this is the bit I'm not sure about. when it crashed a couple of saturdays ago there was nothing major on. the four mid-table 3pm EPL games probably accounted for less traffic thanMon, 01 Apr 2013 16:46:14 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530909753#530909753I don't know what the odds of Betfair crashing due to "automated crawlers" are but I would take any 1.01 about Betfair crashing due to future "site enhancements" to prevent "automated crawlers"Mon, 01 Apr 2013 12:36:04 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530905711#5309057111st April ?Mon, 01 Apr 2013 10:21:37 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530903797#530903797Obviously very difficult for betfair, Investor. 10 years on and they're still searching for that missing link as to why the site grinds down/crashes around 3pm every SaturdayMon, 01 Apr 2013 09:07:15 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530903397#530903397brendanuk1 01 Apr 13 14:12 Joined: 12 Jan 02 | Topic/replies: 21,726 | Blogger: brendanuk1's blogIts a bit odd, I cant see why they dont just block them, and tell them to use the API.They might have a problem identifying them, but I would have thoughMon, 01 Apr 2013 08:51:17 -0500https://community.betfair.com/general_betting/go/thread/view/94082/29841081/betfair-crashed-on-saturday-because-of-automated-crawlers?post_id=530902949#530902949The site crashed because of Betfair's incompetence, they like to scapegoat 'bots' the same way the Government use immigrants.seems better explanation to meMon, 01 Apr 2013 08:33:14 -0500