Can I get some "polite usage" limits for the API, I dont want to cause any lag issues for anyone.
http://www.conquerclub.com/forum/viewtopic.php?f=529&t=202362 indicates the server rate limits to 5req / 10s. Is this still accurate? Are there particular times of day/week that have lower load and are more acceptable for increased usage? (Would scraping this after Christmas be preferable?)
I'd like to pull a reasonable portion of the gamelist data to plot changes in popularity of maps and game options. The Map stats page only list the total games/map since release, current popularity is not available.
The API limit is accurate last I checked. At the moment calculating these kinds of statistics will be difficult because of that.
I think it might be easiest to slowly build a database of completed games. You can stretch this out so as not to go over the server limit. You should be able to use each games event and event timestamp to see when the game started and ended and use that to help plot your data. This has the disadvantage of not being accurate near the current time.
Depending on the sample size you are looking for you could just do a single request for Active games. This will get you 200 (I think) active games. I don't think this is "Random" but it might be enough to get you moving in the right direction.
ds.obsidian wrote:Can I get some "polite usage" limits for the API, I dont want to cause any lag issues for anyone.
http://www.conquerclub.com/forum/viewtopic.php?f=529&t=202362 indicates the server rate limits to 5req / 10s. Is this still accurate? Are there particular times of day/week that have lower load and are more acceptable for increased usage? (Would scraping this after Christmas be preferable?)
I'd like to pull a reasonable portion of the gamelist data to plot changes in popularity of maps and game options. The Map stats page only list the total games/map since release, current popularity is not available.
Thanks
the reason the limit was added was because 1/2 userscripts where calling the api way to much. during the time with the old server. the limit was one thing that bW did to try to reduce the load on the site. but it may be possible to remove that limit now with the new servers.
dgz345 - I'm certainly not suggesting removal of rate limiting, its a necessary part of public apis.
blakebowling, its been about 7 yrs since I played CC regularly and there has been a huge increase in maps and options. I've found it can be difficult to judge the effect certain combinations will have when I join a game and I'm interested in running some analysis to find common combinations and the likely effects on gameplay. I have a bunch of comparisons I intend to run, but I'm sure I'll find some I'm not expecting. I'll then make the results available for informed commentary re. new player intros, maintaining player activity etc. I have a few other suggestions but they really depend on the general shape of the numbers so I'll leave that till I have a better idea of whats happened in the past.
