I have a small tutorial regarding C# and item api:
Basically, I can make 100k requests, serialize the JSON, and store to flat file in about a minute or so. With the flat file you can do whatever you wish, in this I load it to MySQL. In the tutorial I don't pull every item attribute, but it can easily be extended to do so.
08/11/2011 10:29 PM55,000+ whatever items divided by 3,000 requests per day is still 2 1/2 weeks of doing nothing but item downloads. There needs to be a better way.
Posted by Roncli
Think of it as 3k credits per day, not 3k requests per day. Each request has a different credit value associated with it. It appears an item request is only a small fraction of a credit. Credits and actual GET requests are not one-to-one.
Remote web servers can have a large amount of latency and while waiting we should be trying to put load on the network as much as possible so that we can get our requests done as quickly as possible. The .NET framework imposes a limit of 2 simultaneous connections on a same host. However, Blizzard's servers can easily handle much more, so this setting should be increased in the app.config.
(takes a good 1.5 hours since it has to do 60,000 server calls to get the item info 1 by 1).
Judging by this, you have not increased the connection limit and you're not making the requests asynchronously. It should be much
faster than this.