Forums

General Betting

There is currently 1 person viewing this thread.
These 61 comments are related to the topic:
As an IT professional, what advice would you give Betfair?

Post your reply

Text Format: Table: Smilies:
Forum does not support HTML
Insert Photo
Cancel
Page 2 of 2  •  Previous | 1 | 2 | Next
sort by:
Show
per page
Replies: 61
By:
brendanuk1
When: 14 Mar 11 20:20
99.99 is 1min a week = no chance here, think they would struggle with 3 9s. And if downtime due to upgrades was included they wouldnt do 99%

http://en.wikipedia.org/wiki/High_availability
By:
viva el presidente!
When: 14 Mar 11 20:23
I'm surprised we've had such different experiences. I remember a period of months when it was pretty bad about 18-15 months ago, then the most troublefree 12 months I'd experienced since day 1 (jun 06), followed by the worst couple of months.
By:
Just Checking
When: 14 Mar 11 20:27
I was pleasantly surprised it was ok during the world cup, as approaching 3pm on a saturday a few months before that, the site would predictably grind to a juddering halt.
By:
Artisan
When: 14 Mar 11 20:29
You could well be right Viva.  But people have certainly been reporting performance issues (myself included) since the last big crash.  Thinking back, perhaps it had been relatively trouble free for the previous 12 months or so.  I'll take a look at a couple of sites that are usually quick to report on outages, and see what the history says.
By:
Alex the old wrinkled retainer
When: 14 Mar 11 20:31
brendanuk1
14 Mar 11 18:50 Joined: 12 Jan 02 | Topic/replies: 14,296 | Blogger: brendanuk1's blog
Many organisations advertise jobs that don't exist because they know they have natural wastage and a list of potential future employees is good business sense.  (I used to do it.)

thats just silly, do you work in IT?



No.  I ran and advised businesses with many employees though.
By:
Artisan
When: 14 Mar 11 20:36
Brendan

Yes, I'm probably setting the bar too high.  Excluding scheduled downtime do we think 3 9s (99.9% - 10 mins a week) would: a) be realistically achievable, and b) satisfy us (I guess from a risk point of view mainly)?
By:
getintheir
When: 14 Mar 11 20:46
alex,

do you have list of the tricks of the trade you could share with us?   Mischief

artisan,

i would say 1 outage a month lasting no longer than 1 hour (ideally less). which i guess is around 99.85%
By:
brendanuk1
When: 14 Mar 11 20:59
99.9 sounds ok they have a good a chance of failing as of succeeding imo.

Once real time results of third party monitoring is made public they could set up a market. Will Betfair reach its uptime SLA? Yes/No
By:
Artisan
When: 14 Mar 11 21:05
Viva

I've taken a squint at the BetAngel site forum - they usually pick up on BF outages pretty quickly.  I found the following bits and pieces:


"Mon Jan 31, 2011 11:37 am  (Following scheduled maintenance)
Still erratic at the moment, so please be careful before trying anything. We will be keeping an eye on things but it would be useful if anybody post issues to this thread.

It looks like the site is not fully up at the moment, the odds being returned by the API are all over the place.

Betfair Customer Services 03 Jul 10 13:42
Betfair would like to apologise for the difficulties some customers are experiencing on the website, particularly in respect of the ‘My Bets’ tab and markets prices not updating correctly.

We are investigating the cause of this problem as a matter of extreme urgency and will keep you updated.

Sun Jan 31, 2010 12:36 am
Firstly some music to cheer you up while reading this post, I thought the band kind of suited:

At bang on midnight Betfair, yup you guessed it, died again! Not just the API but Betfair wide. I then spent 10 mins on hold being told all the customer services people were too busy to answer my call so eventually hung up!

Sat Jan 30, 2010 6:59 am
Be careful this morning the API has been all over the shop overnight and is still playing up early this morning."

If that's all there was, then prior to the end of January this year, they've only had two major hits in the preceding 12 months, one in July (what dates were the World Cup?), and one in January last year.  So on that basis, your recollection is more accurate than mine.  Although I suspect all of the niggles (slow browsers, clearing cache, Aus wallets going etc.) won't be recorded, but certainly stick in people's minds.
By:
Artisan
When: 14 Mar 11 21:09
Very good Brendan.  And given the general accuracy of the BF prices, people should be able to quantify their risk pretty accurately.
By:
getintheir
When: 14 Mar 11 21:14
and hedge their risks accordingly. we'll all be jumping up and down with delight when there is an outage! Cool
By:
Artisan
When: 14 Mar 11 21:16
In fact, thinking about it some more, your idea is definitely worth pursuing.  BF should create a market on the chances of the site going down today.  Site users, traders in particular, could hedge against being hit by such an eventuality (effectively take out insurance).  The problem being that the premiums at the moment might be prohibitive.
By:
Artisan
When: 14 Mar 11 21:21
getinthere

I was posting at the same time as you - obviously we're all thinking along the same lines.
By:
getintheir
When: 14 Mar 11 21:26
you would of course have to keep adjusting your hedge to current exposure levels. after a month of not having an outage the price may be getting pretty short and expensive to increase your hedge :-)

if im on £14k in IT I could also fund my lifestyle by pulling the plug just after getting a wedge on.
By:
frog2
When: 14 Mar 11 21:58
It all seems very disjointed having data and people in Malta, Dublin, Australian, London etc. Did the major problems start when they started the major shift over to Dublin? Is there is a massive pre-occupation with making tax savings and this is forcing sub-optimal technical choices to made? It all seems such a waste of money moving everything just to deny the UK exchequer a few quid given how well Betfair has done over the last decade being based here.
By:
brendanuk1
When: 14 Mar 11 22:11
Seems there was a code freeze before going to Dublin, this caused a back log of changes and these were pushed through poorly tested and once problems started to happen they just ploughed on.
By:
gus
When: 14 Mar 11 22:51
Getting back to the original topic of this thread:

"As an IT professional, what advice would you give Betfair?"

I'd add: There have , in the recent past (another poster mentioned the period before and during last year's World Cup, and i'd agree) , been long periods when the BF (Sports Exchange) site has been stable, reliable, and a joy to use.

What irritates me, and i'd guess quite a lot of other users is that, having achieved that astonishingly (given the demands) enviable  level of stability / reliability, BF seem to have blown it.

Nothing that has been done during recent months has added to the BF (Sports Exchange) experience, whilst some things that have been done detract from it.

The most irritating thing, to this IT prfessional,  is the perversity of sacrificing such genuinly admirable achievement for no apparent gain.

Just stop doing stuff!
By:
Just Checking
When: 14 Mar 11 23:02
Given the lack of relationship in function between say sports betting and the arcade stuff, if a lot of these new changes are for THAT perhaps they should be hosting that on completely separate servers, e.g. all such servers on arcade.betfair.com, perhaps even with a separate bank like the oz bank so it's all separate. Contain the disease so no upgrade for that has a chance of making the whole house of cards fall down.
By:
Chilly the Dog
When: 15 Mar 11 12:12
Problem with running markets on exchange failures is that some dodgt russian with a large botnet can probably lump on and then nuke the site. the CIA had terrorism prediction markets for a while but decided it was probably not a good idea for the same reasons.
By:
Artisan
When: 15 Mar 11 13:58
Gus

Yep, some of the old adages spring to mind, like: "If it ain't broke don't fix it".

Just Checking

I agree that there is definitely something about segregation; getting the systems into manageable bite sized discrete chunks.  We all know that large unwieldy systems are a nightmare to test, diagnose and fix when they snap.  Mission critical stuff is deliberately broken down into as smaller units as possible for this very reason.
By:
Artisan
When: 15 Mar 11 14:03
Chilly

Good point, but, would the market not naturally price in that risk? Laugh
By:
getintheir
When: 16 Mar 11 23:51
usually senior management chip in with helpful one liners like "just facking sort it" ..so that would be my advice.
Page 2 of 2  •  Previous | 1 | 2 | Next
sort by:
Show
per page

Post your reply

Text Format: Table: Smilies:
Forum does not support HTML
Insert Photo
Cancel
‹ back to topics
www.betfair.com