copying data from websites

i dont think soccerway would be happy with that after hard work they do to keep stats up to date
for free + it says it Copyrighted at bottom of page

rentacoder or freelancer can create a screen scraper for you for a few quid.

Oct 11, 2012 -- 3:59PM, oyyou wrote:

i dont think soccerway would be happy with that after hard work they do to keep stats up to datefor free + it says it Copyrighted at bottom of page

wow, this never came to my mind. isnt it like reading a book and taking note, ala automated note taking. and ofcourse for personal use. i would contact them to clarify.

Oct 11, 2012 -- 4:26PM, SHAPESHIFTER wrote:

rentacoder or freelancer can create a screen scraper for you for a few quid.

thanks for the comment. i want to do it myself to test myself.

just wanted a starting point

doubt you can copyright info in the public domain

If it's in the public domain, why do you need to copy it?

he wants to do sums, execute queries and generally attempt to alchemize the data.

if anyone have written a code to extract data from similar websites, i would be happy to have a look at it and even use it as a starting point.

that's fecking decent of you to offer.

let me know if your car needs a wash and whether your lawn needs mowing as well.

Oct 11, 2012 -- 6:51PM, DStyle wrote:

if anyone have written a code to extract data from similar websites, i would be happy to have a look at it and even use it as a starting point.that's fecking decent of you to offer.let me know if your car needs a wash and whether your lawn needs mowing as well.

i dont understand why took offence from that. it is quite common practice to share code. cheer up mate, life is too short to be angry on everything.

Yep, my tech trades codes all the time. 

He lives in northern Ontario..in a house on a bird sanctuary.....uses satellite to get broadband.....middle of nowhere...

Last year, a black van shows up at his place with RCMP investigators....he'd been trading codes, mainly integration for data clouds to java scripts with someone living in Iran. 

Took him and his hard drives to Toronto for two days, putting him up at a hotel with a security guard.

They returned his hard drives and himself back up into the woods.

Best part of the story:

When he got back and fired up his hard drive, they left two or three small programs on his disc that had been used to extract data/hidden files.

I asked him if he traded them with his Iranian friend.  "not funny" he responded.

You need to be more specific in what language you're coding in but tbh there are hundreds of example scripts for data mining all over the web.

i am going to write it with vba to save the data into an excel sheet.

if you plan on writing it yourself but you want some help, you could do worse than check out the following sites:

www.guru.com
www.vworker.com
www.elance.com


You can request for someone to do the entire job for you, or just do a bit and then help you with the rest.  It's free to post a job (user bid for your work), you pay through the site (so you're insured) and the money is only released to the worker when you say you're happy.  They've been around for years and are a really cheap way of doing things - frighteningly cheap sometimes.  We had query at work that was running, but running very slowly - so we put a job up to see if anyone could help.  A Portugese masters student did it for... TWELVE pounds.  We were amazed, and it hit home how bad the job situation is in some parts of the world - and before anyone says what mean bastards we were, we did pay him way over that.

Post as much info as you can - screen dumps, links to other sites etc.

good luck

thanks yeahyeahwhatever.

You'll find some clues on this thread I previously started
http://community.betfair.com/general_betting/go/thread/view/94082/29040723/parsing-the-dom-with-visual-basic

It's YOU again!

How's it going - did you ever go on that Access course?

Hello m8.
No, I did not go on the course. I'm still fumbling my way through it. I did actually send you a message to an e-mail address you posted on that thread asking for a few pointers. Maybe that was not an address you check very often. (the detectivefireplace one)
I have got four databases working now. One grabs the forecast SPs, one grabs the Greyhound entries for the next day, one grabs the horse entries for a future date and one other. I'm still grabbing unwanted nulls, then sorting. This is ok for certain types of data, but useless for others.

The bit I can't seem to get working as I'd like, is where you grab text within a specific table of a webpage. I still seem to grab some nulls amongst the text I want to grab.

^

What data do you want?

I'd like to grab the open Greyhound entries from here
http://www.racingpost.com/greyhounds/trap_draws_home.sd

The meeting links take you to these pages, where the entries would be grabbed from
http://www.racingpost.com/greyhounds/trap_draws_home.sd?r_date=2012-10-29&meeting_id=33

I'd also like to grab the trial lines from the race pages (I get the form seperately from elsewhere, but would grab all the data from the race pages, then pull the trials out (All in Access 2000)
http://www.racingpost.com/greyhounds/card.sd

example race page
http://www.racingpost.com/greyhounds/card.sd#resultDay=2012-10-27&raceId=1192357