Hi, HNers!<p>I <i>desperately</i> need help scraping the Top 20 URL links (and titles) from Google's SERPs for a bunch of keywords.<p><i>Why I need the URLs and titles</i>:<p>I am launching a personal blog (my very first site) and need to understand the i) type of content that ranks and ii) design a backlink strategy that has a chance of working (by reverse engineering backlinks of future competitors).<p>Having a bunch of links that I can then plug into ahrefs.com will help me out a bunch (money is tight so I will be using ahrefs $7 7-day trial).<p><i>What I have already tried</i>:<p>- SERP Scraper from urlprofiler.com - Unfortunately, it took me ~20 hours to get the top 10 URLs and titles for 195 keywords.
I cannot use proxies because I need to see SERP results from my country code TLDs (co.ke).
Due to the inefficiency of this setup, stopped using this two days ago.<p>- Quotes from Fiverr and Upwork were between $65-$200. Unfortunately, I cannot afford professional help at the moment.<p><i>What I am trying</i>:<p>- I am using a combination of Linkclump Chrome extension+ MurGaa Recorder for Macintosh + Excel.<p>- Here's my present <i>workflow</i> using these tools: Copy paste one keyword into Google.co.ke and search <i></i>>><i></i> Trigger Linkclump action (copy to clipboard) with shortcut key recorded using MurGaa recorder <i></i>>><i></i> Switch windows to Excel <i></i>>><i></i> Copy paste SERP links to Excel <i></i>>><i></i> Repeat for the <i>next</i> keyword.<p>This process is quite inefficient but faster than the first setup.<p><i>Why I need help</i>:<p>I am not coding literate hence cannot roll own solution.<p>I do not have the money to buy a commercial solution.<p><i>How you can help me out</i>:<p>Suggesting a solution or tip. For instance, is it possible to automate my present workflow by using Mac automation scripts? Which ones?<p>Hope that I was not too verbose. I also do not want to come across as demanding help or free stuff. I just need help if at all possible.