TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

LinkedIn Profile Crawler API

2 点作者 nubela将近 5 年前

1 comment

nubela将近 5 年前
Hello everyone, I am product owner of Proxycurl and our new Linkedin here.<p>We love (big) data and crawlers at our company, and many a times, we have tried building products on top of big data that we have crawled. But one of the hardest thing to crawl is Linkedin. While we have the technology and crawling network to do it, most of our customers really wanted a turnkey solution at a price that scales.<p>Eventually, after losing many inbound leads due to the developers not being able to use our rudimentary crawling API, we decided to overhaul our API and build in a dedicated Linkedin API endpoint.<p>The hard thing about Linkedin profiles are that they really hate HTML markup. Or maybe it is intended that way to deter scrapers.<p>Most of their content are placed in &lt;code&gt;&lt;&#x2F;code&gt; and later parsed using their frontend javascript code. This is a cat-and-mouse game between developers and Linkedin. Instead of fighting them one developer at a time, we think a managed service for Linkedin Profile crawling might be useful. Your thoughts?