Chrishadley's forum posts

Avatar image for chrishadley
Chrishadley

3

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

It looks like all of the ones that scraping was failing on are now working, I've cleared my whole backlog successfully. You rock!

Avatar image for chrishadley
Chrishadley

3

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#2  Edited By Chrishadley

I'm still having the issue with items with very generic names, like 'Marvels', 'Marvel Super-Heroes', 'The Cat', and also, amusingly enough, 'Cyborg' and 'The Order'. It looks like it is hitting a limit of number of responses and locking up. I understand there may be a limit of responses on the API? Is there some way to rate-limit Comic Vine Scraper? I found no way to do that without rewriting it. It will let you pause between comics, but there's no way to limit the number of responses on a single comic. Thank you so much for your help so far!

Edit: Also, it's getting to 600 responses before dying now :)

Avatar image for chrishadley
Chrishadley

3

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

I have been having severe problems using the Comic Vine scraping script for Comicrack for the past few days. I've been getting the error "The Comic Vine online database could not be reached. This may be due to a temporary technical error with the database, or there may be a problem with your internet connection.". This problem has cleared up today, except for scraping comics with very generic names. For example, I have a copy of "Marvels" that I can't scrape for. It acts like it's working, and when it gets to 500 entries it stops, and gives me the "Cannot Access Online Database" error.