Distribute Comicvine database among voluntary contributors

Avatar image for lsdx17
LSDX17

2

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

Seeing how you seem to have trouble to keep up with the frequent request from users (mostly comic vine scraper), wouldn't it be possible to send some (non-editable) parts of your database to some voluntary contributors of disk/cpu time, so that you could redirect searches to those? People contributing would get a free request for every search they would contribute to.

Avatar image for msmock73
msmock73

2

Forum Posts

0

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

It sounds like you want to use some people as replica servers, to cut down on bottlenecks on the website, the person would need a pretty big size storage and give people the ability to access their server. You would also have to set up a syncing process with the main server to ensure their data is never out of date. This could be done through the distributed system, you would have to create the program to create the interactions.

Avatar image for thecollectorx
TheCollectorx

85

Forum Posts

26808

Wiki Points

0

Followers

Reviews: 11

User Lists: 75

#3  Edited By TheCollectorx
No Caption Provided

hi i'm having this problem

Avatar image for scuttle
scuttle

1

Forum Posts

600

Wiki Points

0

Followers

Reviews: 0

User Lists: 0

#4  Edited By scuttle

@msmock73: It's actually not that complicated. Musicbrainz is already doing something similar. You download and install a database-engine and the software, you then download a dump of the database, import it and set up replication. Replication can be done using either built-in functions in the engine, or using periodical dumps from the master database. Musicbrains is doing the latter, so you download new and changed data a few times per day and import it in your mirror.

This would, of course, mean that changes can only be done on the master database, all the mirrors would be read-only