Unable to reach the SEC endpoint

[siljemanger]

I have a code that extracts the url to exhibit 21, by using the url to the 10-K filing. However, I am now experiencing problems with the parse_submission function.

I receive this error message:
Error in charToText(x) :
Unable to reach the SEC endpoint (https://www.sec.gov/Archives/edgar/data/835011/000117184312000904/0001171843-12-000904.txt)

I am using the function in a loop. The problem occurs on different links if I rerun the code. If I run the code manually, it works. If I run the code enough times, I get output in the end, but never for all 3370 observations in my data set.

Any help would be useful, thanks.

[stockqt]

Edgar has a new "Fair access" policy that is supposed to enforce a max request rate of 10 requests/second, but seems to be randomly causing downloads to fail (403 forbidden). I experienced this problem with wget also, it's not specific to edgarWebR. In wget I started using the option --retry-on-http-error=403. For edgarWebR, it might be possible to use httr::RETRY or something similar for the calls like res <- httr::GET(x) in get_doc() etc? Great software, thanks.

[siljemanger]

Thank you!

I realised that I didn't needed to reach the endpoint, I just had to generate the links for further use. Therefore it worked for me to just ignore the error message by using try({my_code}).