Scrape data from Google

Asked Sep 29 '19 at 18:18

Active Sep 30 '19 at 20:17

Viewed 126 times

my question is general. I would like to search a term on Google and scrape all the results, including the dates of publishing, if there are.
I know that it is possible to scrape a website - following the policy, of course!, and not breaking the rules - by using Python or other softwares. Is it possible to do this in Mathematica?

UPDATE: By using ServiceConnect, I got this output:

results = ServiceExecute["GoogleCustomSearch", "Search", {"Query" -> "machine learning", "FileFormat" -> Entity["FileFormat", "PDF-1"]}]

edited Sep 30 '19 at 20:17

Rohit Namjoshi

10,212
6
16
67

asked Sep 29 '19 at 18:18

still_learning

2

Take a look at this. – Rohit Namjoshi Sep 30 '19 at 14:19
I tried to use what you suggested, but it download an empty object (please see the post) – still_learning Sep 30 '19 at 18:11
If this does not work for you results = ServiceExecute["GoogleCustomSearch", "Search", {"Query" -> "machine learning", MaxItems -> 10}] then most likely the credentials are not setup correctly. Follow the instructions here to get the search engine id and api key. – Rohit Namjoshi Sep 30 '19 at 22:44

Scrape data from Google

0 Answers0