Forums

General Betting

There is currently 1 person viewing this thread.
colonelll
11 Oct 12 13:59
Joined:
Date Joined: 04 Nov 11
| Topic/replies: 1,623 | Blogger: colonelll's blog
hi all, i wanted to copy huge amount of game stat from soccerway but dont have the time or the strengthCry to do it  manually. I am thinking to write a code to do so, if anyone have written a code to extract data from similar websites, i would be happy to have a look at it and even use it as a starting point. so if anyone is willing to share a code in any programming languge please send me a pm.

Post your reply

Text Format: Table: Smilies:
Forum does not support HTML
Insert Photo
Cancel
sort by:
Show
per page
Replies: 21
By:
oyyou
When: 11 Oct 12 15:59
i dont think soccerway would be happy with that after hard work they do to keep stats up to date
for free + it says it Copyrighted at bottom of page
By:
SHAPESHIFTER
When: 11 Oct 12 16:26
rentacoder or freelancer can create a screen scraper for you for a few quid.
By:
colonelll
When: 11 Oct 12 16:59

Oct 11, 2012 -- 3:59PM, oyyou wrote:


i dont think soccerway would be happy with that after hard work they do to keep stats up to datefor free + it says it Copyrighted at bottom of page


wow, this never came to my mind. isnt it like reading a book and taking note, ala automated note takingWink. and ofcourse for personal use. i would contact them to clarifyCool.

By:
colonelll
When: 11 Oct 12 17:02

Oct 11, 2012 -- 4:26PM, SHAPESHIFTER wrote:


rentacoder or freelancer can create a screen scraper for you for a few quid.


thanks for the comment. i want to do it myself to test myself.

By:
colonelll
When: 11 Oct 12 17:02
just wanted a starting pointCool
By:
dave1357
When: 11 Oct 12 17:59
doubt you can copyright info in the public domain
By:
Mr.Angry
When: 11 Oct 12 18:28
If it's in the public domain, why do you need to copy it?
By:
dave1357
When: 11 Oct 12 18:40
he wants to do sums, execute queries and generally attempt to alchemize the data.
By:
DStyle
When: 11 Oct 12 18:51
if anyone have written a code to extract data from similar websites, i would be happy to have a look at it and even use it as a starting point.

that's fecking decent of you to offer.

let me know if your car needs a wash and whether your lawn needs mowing as well.
By:
colonelll
When: 11 Oct 12 19:32

Oct 11, 2012 -- 6:51PM, DStyle wrote:


if anyone have written a code to extract data from similar websites, i would be happy to have a look at it and even use it as a starting point.that's fecking decent of you to offer.let me know if your car needs a wash and whether your lawn needs mowing as well.


Sadi dont understand why took offence from that. it is quite common practice to share code. cheer up mate, life is too short to be angry on everythingWink.

By:
SHAPESHIFTER
When: 12 Oct 12 00:10
Yep, my tech trades codes all the time. 

He lives in northern Ontario..in a house on a bird sanctuary.....uses satellite to get broadband.....middle of nowhere...

Last year, a black van shows up at his place with RCMP investigators....he'd been trading codes, mainly integration for data clouds to java scripts with someone living in Iran. 

Took him and his hard drives to Toronto for two days, putting him up at a hotel with a security guard.

They returned his hard drives and himself back up into the woods.

Best part of the story:

When he got back and fired up his hard drive, they left two or three small programs on his disc that had been used to extract data/hidden files.

I asked him if he traded them with his Iranian friend.  "not funny" he responded. Grin
By:
Ghetto Joe
When: 12 Oct 12 12:08
You need to be more specific in what language you're coding in but tbh there are hundreds of example scripts for data mining all over the web.
By:
colonelll
When: 12 Oct 12 16:03
i am going to write it with vba to save the data into an excel sheet.
By:
yeahyeahwhatever
When: 12 Oct 12 22:21
if you plan on writing it yourself but you want some help, you could do worse than check out the following sites:

www.guru.com
www.vworker.com
www.elance.com


You can request for someone to do the entire job for you, or just do a bit and then help you with the rest.  It's free to post a job (user bid for your work), you pay through the site (so you're insured) and the money is only released to the worker when you say you're happy.  They've been around for years and are a really cheap way of doing things - frighteningly cheap sometimes.  We had query at work that was running, but running very slowly - so we put a job up to see if anyone could help.  A Portugese masters student did it for... TWELVE pounds.  We were amazed, and it hit home how bad the job situation is in some parts of the world - and before anyone says what mean bastards we were, we did pay him way over that.

Post as much info as you can - screen dumps, links to other sites etc.

good luck
By:
colonelll
When: 13 Oct 12 19:55
thanks yeahyeahwhatever.
By:
Stow_judge
When: 15 Oct 12 20:19
You'll find some clues on this thread I previously started
http://community.betfair.com/general_betting/go/thread/view/94082/29040723/parsing-the-dom-with-visual-basic
By:
yeahyeahwhatever
When: 15 Oct 12 23:14
It's YOU again! Silly

How's it going - did you ever go on that Access course?
By:
Stow_judge
When: 16 Oct 12 17:26
Hello m8.
No, I did not go on the course. I'm still fumbling my way through it. I did actually send you a message to an e-mail address you posted on that thread asking for a few pointers. Maybe that was not an address you check very often. (the detectivefireplace one)
I have got four databases working now. One grabs the forecast SPs, one grabs the Greyhound entries for the next day, one grabs the horse entries for a future date and one other. I'm still grabbing unwanted nulls, then sorting. This is ok for certain types of data, but useless for others.

The bit I can't seem to get working as I'd like, is where you grab text within a specific table of a webpage. I still seem to grab some nulls amongst the text I want to grab.
By:
Stow_judge
When: 27 Oct 12 10:15
^
By:
Srichaphan or Ancic?
When: 27 Oct 12 11:38
What data do you want?
By:
Stow_judge
When: 27 Oct 12 14:12
I'd like to grab the open Greyhound entries from here
http://www.racingpost.com/greyhounds/trap_draws_home.sd

The meeting links take you to these pages, where the entries would be grabbed from
http://www.racingpost.com/greyhounds/trap_draws_home.sd?r_date=2012-10-29&meeting_id=33

I'd also like to grab the trial lines from the race pages (I get the form seperately from elsewhere, but would grab all the data from the race pages, then pull the trials out (All in Access 2000)
http://www.racingpost.com/greyhounds/card.sd

example race page
http://www.racingpost.com/greyhounds/card.sd#resultDay=2012-10-27&raceId=1192357
sort by:
Show
per page

Post your reply

Text Format: Table: Smilies:
Forum does not support HTML
Insert Photo
Cancel
‹ back to topics
www.betfair.com