Sec.gov is blocking all requests from AWS?

1 点作者 atlasspring超过 3 年前

I noticed sec.gov is blocking all requests from AWS since the 4 days ago. Has this been the same for you? How are you able to bypass this issue? Currently I can scrape sec.gov only from local computer. My ideal solution is that I can have a program that runs on some remote servers

2 条评论

talolard超过 3 年前

Add a user agent to the request<p>See here: <a href="https://www.sec.gov/os/accessing-edgar-data" rel="nofollow">https://www.sec.gov/os/accessing-edgar-data</a>

arthurcolle超过 3 年前

You could use a proxy run on another provider, Linode, DigitalOcean, etc. Or you could scrape sec.report<p>What are you using SEC sites for, just EDGAR or something else?