Auction House API is live!

90 Goblin Hunter
11120
timeLeft has been added to ours but horde and neutral auctions are currently blank :)

http://us.battle.net/auction-data/zangarmarsh/auctions.json
Reply Quote
Web & Mobile Team
timeLeft has been added to ours but horde and neutral auctions are currently blank :)

http://us.battle.net/auction-data/zangarmarsh/auctions.json


The changes will be visible over time as the dump files are rebuilt.
Edited by Straton on 8/3/2011 6:41 PM PDT
Reply Quote
100 Night Elf Warrior
12990
The auction logs for Dath'Remar do not seem to update.

The lastModified timer changes but when I download a new file as indicated by the URL, it is always the same file as before. The only time the file changed during the last 24 hours was when the timeLeft field was added.
Since then, the lastModified time has changed at least twice but the downloaded file has not.
Reply Quote
90 Human Paladin
14880
I'm having a lot of issues here. I'm just trying to parse the JSON blob for one server's AH dump. And this JSON is HUGE. It's very difficult to parse with certain web technologies such as PHP, and I run into exhausting memory issues (unless I set the memory limit in the ini very high) trying to decode this JSON into a more friendly format such as a CSV or MySQL database.

Is there anything in the API to perhaps cull it down to only a specific item (or subset of items) from the AH listing, rather than the entire dump?
Edited by Laurabelle on 8/3/2011 10:51 PM PDT
Reply Quote
100 Night Elf Druid
8295
The AH API is absolutely awesome news. Until now I've been running manual Auctioneer scans on four different toons to collect market data for my research. The API has cut what used to take me 45-60 min of manual in-game scanning down to 3 sec to grab the json!

Blizz just made it Christmas in August for this data visualization geek!
Reply Quote
100 Undead Mage
10350
I'm having a lot of issues here. I'm just trying to parse the JSON blob for one server's AH dump. And this JSON is HUGE. It's very difficult to parse with certain web technologies such as PHP, and I run into exhausting memory issues (unless I set the memory limit in the ini very high) trying to decode this JSON into a more friendly format such as a CSV or MySQL database.

Is there anything in the API to perhaps cull it down to only a specific item (or subset of items) from the AH listing, rather than the entire dump?


Perhaps download to a file and then parse it in the background. Since AH files dont change all the much, parsing it in realtime shouldn't be needed, Your background process could be configured with extra memory using ini_set('memory_limit','128M');
Reply Quote
85 Night Elf Hunter
5135
I'm having a lot of issues here. I'm just trying to parse the JSON blob for one server's AH dump. And this JSON is HUGE. It's very difficult to parse with certain web technologies such as PHP, and I run into exhausting memory issues (unless I set the memory limit in the ini very high) trying to decode this JSON into a more friendly format such as a CSV or MySQL database.

Is there anything in the API to perhaps cull it down to only a specific item (or subset of items) from the AH listing, rather than the entire dump?


Perhaps download to a file and then parse it in the background. Since AH files dont change all the much, parsing it in realtime shouldn't be needed, Your background process could be configured with extra memory using ini_set('memory_limit','128M');


This is what my application is doing right now. It'll grab the JSON, download it locally and run some processing over the local file. You'll notice far better performance handling the data this way (I have). Plus, you'll be less likely to run into any issues with throttling.

Has it been discussed how many requests a registered application will likely be able to have?
Reply Quote
Web & Mobile Team
08/03/2011 10:46 PMPosted by Laurabelle
Is there anything in the API to perhaps cull it down to only a specific item (or subset of items) from the AH listing, rather than the entire dump?


I believe the best course of action is to let the current features incubate for a little while. That way we can get some good mid to long term stats and information on how it is all being used and what issues, problems and work-arounds developers have to deal with.

08/04/2011 07:00 AMPosted by Aladan
Has it been discussed how many requests a registered application will likely be able to have?


Many times. Check some of the sticky threads.
Reply Quote
Web & Mobile Team
08/03/2011 11:44 PMPosted by Chantee
Blizz just made it Christmas in August for this data visualization geek!


Oh you made my day.
Reply Quote
85 Night Elf Hunter
5135
08/04/2011 07:00 AMPosted by Aladan
Has it been discussed how many requests a registered application will likely be able to have?


Many times. Check some of the sticky threads.[/quote]

Thanks. I would have expected to find it in here: http://us.battle.net/wow/en/forum/topic/2743691064 but only found "Doing so allows you to make a large number of requests per day and ensures that your IP addresses can be accounted for when we update IP blacklists."

It's not a major thing, I was just curious if it was 10x or 100x the daily allotment for example.
Reply Quote
Web & Mobile Team
I just manually verified this was not an issue by creating a temporary copy of the last hour's dump for Dath'Remar and comparing filesize and linecount with the latest dump - these are definitely different.

The auction logs for Dath'Remar do not seem to update.

The lastModified timer changes but when I download a new file as indicated by the URL, it is always the same file as before. The only time the file changed during the last 24 hours was when the timeLeft field was added.
Since then, the lastModified time has changed at least twice but the downloaded file has not.
Reply Quote
90 Human Paladin
14880
I was able to process the JSON dump via a PHP JSON decode after allowing 64M memory usage for scripts. This script then isolates only the alliance AH data, and puts it into an on-going MySQL table.

Since it seems the dump is only updated once per hour (on the 49th minute no less), the script first checks to see the last modified section (as per API) once per minute (via CRON job) and only adds to MySQL the latest dump if a newer one is available.

Finally, a front-end app for the view from the database and some simple visualization tools (compliments of Highcharts API) allowed for a first pass at some analysis tools: http://www.loottrain.com/ewe/graph.php?itemID=52233

Where the itemID in the GET is to be the item data displayed. However, without item API available it's difficult for the item id to name and vice versa conversions.

It is an on-going project, so still rough no doubt. I should also say this was only for US-Boulderfist alliance AH (all I am interested in).
Edited by Laurabelle on 8/4/2011 4:42 PM PDT
Reply Quote
90 Human Paladin
14880
Sorry to post again, and not sure if this is the right place for it. Though, anyone know which character set Blizzard uses for character names (at least for the US servers)?
Reply Quote
85 Goblin Priest
5075
08/05/2011 08:00 AMPosted by Laurabelle
Sorry to post again, and not sure if this is the right place for it. Though, anyone know which character set Blizzard uses for character names (at least for the US servers)?


utf8
Reply Quote
Seems the json dump for ED has been bugged for the last few hours. It seems that the Alliance and Neutral auction data is empty.

My last pull for any alliance data was today at 09:22:09 GMT. (~7 hours ago)
<a href="http://us.battle.net/auction-data/emerald-dream/auctions.json">http://us.battle.net/auction-data/emerald-dream/auctions.json</a>

Edit: Issue seems to be resolved now.
Edited by Kaji on 8/5/2011 9:25 AM PDT
Reply Quote
1 Troll Rogue
0
Some realms sometimes fail to return any auctions for a faction. I've been pulling the entire US set almost every hour for a couple days now, and have some error results. All the affected realms happen to be on the Shadowburn battlegroup.

Here's a small table with some details. The columns are:
Number of different download files with no auctions
First time (UTC) no auctions were seen
Last time (UTC) no auctions were seen
Realm Name
Faction

17 2011-08-05 09:18:11 2011-08-06 04:48:44 Greymane Alliance
16 2011-08-05 08:05:02 2011-08-06 05:34:31 Sargeras Alliance
15 2011-08-05 08:24:39 2011-08-06 01:33:42 Malfurion Alliance
15 2011-08-05 08:12:32 2011-08-06 02:12:35 Detheroc Alliance
15 2011-08-05 08:58:44 2011-08-06 05:32:05 Wildhammer Alliance
14 2011-08-05 09:41:43 2011-08-06 04:47:41 Kalecgos Alliance
14 2011-08-05 08:57:33 2011-08-06 03:42:03 Ursin Alliance
13 2011-08-05 09:42:42 2011-08-06 04:34:32 Lightninghoof Alliance
13 2011-08-05 10:25:22 2011-08-06 05:15:06 Emerald Dream Alliance
13 2011-08-05 08:49:20 2011-08-06 03:38:39 Maelstrom Alliance
13 2011-08-05 08:52:06 2011-08-06 03:38:40 Nazjatar Alliance
13 2011-08-05 08:22:28 2011-08-06 04:28:28 Twisting Nether Alliance
12 2011-08-05 08:48:05 2011-08-06 03:38:38 Baelgun Alliance
11 2011-08-05 08:40:40 2011-08-06 04:08:26 Agamaggan Alliance
11 2011-08-05 10:42:43 2011-08-06 04:06:02 Dark Iron Alliance
11 2011-08-05 12:05:03 2011-08-06 05:29:40 Staghelm Alliance
9 2011-08-05 08:07:04 2011-08-06 04:23:50 Azshara Alliance
9 2011-08-05 10:04:59 2011-08-06 02:26:50 Moonrunner Alliance
4 2011-08-05 20:55:39 2011-08-06 02:56:21 Wildhammer Horde
3 2011-08-06 00:28:11 2011-08-06 03:49:26 Staghelm Horde
2 2011-08-06 00:13:11 2011-08-06 01:03:22 Azshara Horde
2 2011-08-06 02:48:34 2011-08-06 03:38:39 Maelstrom Horde
2 2011-08-06 02:48:21 2011-08-06 03:38:38 Baelgun Horde
1 2011-08-06 04:28:28 2011-08-06 04:28:28 Twisting Nether Horde
1 2011-08-05 17:40:35 2011-08-05 17:40:35 Greymane Horde
1 2011-08-05 14:46:07 2011-08-05 14:46:07 Sargeras Horde
1 2011-08-05 13:03:11 2011-08-05 13:03:11 Nazjatar Horde


edit List may not be comprehensive.
Edited by Ujournalh on 8/5/2011 10:44 PM PDT
Reply Quote

Please report any Code of Conduct violations, including:

Threats of violence. We take these seriously and will alert the proper authorities.

Posts containing personal information about other players. This includes physical addresses, e-mail addresses, phone numbers, and inappropriate photos and/or videos.

Harassing or discriminatory language. This will not be tolerated.

Forums Code of Conduct

Report Post # written by

Reason
Explain (256 characters max)
Submit Cancel

Reported!

[Close]