JavaScript is required to use Bungie.net

Forums

originally posted in:BungieNetPlatform
3/2/2016 6:03:32 PM
2
We don't have any hard-and-fast throttles in place for the PGCR service, but we ask that you try to limit it to under 20 requests/second. Indeed, I've heard of some sites that increment the PGCR URL. It's a bit of an extreme undertaking, but the benefit you get is total informational awareness. You should hit up @Steffwiz, he is a developer on one of the sites that does this en masse scraping, and perhaps you could collaborate on an effort together - and save yourself a lot of bandwidth costs and trouble if you guys can work together with that already scraped dataset! What kind of use case were you thinking of? Maybe it's something that can be done without having to scrape all PGCRs? If not, definitely hit up someone like Steffwiz before bothering to re-grab all of this data if you can... it could be that your use cases are similar enough that you can collaborate somehow!
English

Posting in language:

 

Play nice. Take a minute to review our Code of Conduct before submitting your post. Cancel Edit Create Fireteam Post

  • I want to do Crucible research and write about it. I know - it's like saying I want to play in the sandbox so I buy a backhoe. But we have all this publicly available data just sitting there... It's like when someone on the Internet finds a safe behind a wall in their house. What's in the safe!? The key is stripping the nerd speak, putting it in a format that is readable to non-technical but thoughtful people, and focusing on takeaways and insight. Plus, I see this as a good opportunity for hands on learning for cloud/big data architecture. Before I started playing Destiny, sports analytics was my hobby. But everyone is doing it now, daily fantasy is in hot water, and it's hard to find anything new to talk about as an amateur. Flash forward1,500+ hours into Destiny, and I have a backlog of ideas I'd like to investigate. Here's one example topic: Some players are vocal about hating a particular spawn on a given trials map. We know Alpha/Bravo overall win% is pretty much 50/50 on most maps. But is there meaningful variation within certain tiers of payers? If I find variation, maybe I could tease out a map awareness factor in the leftover noise? I can't imagine that would be possible without a ton of match data. Since PGCR requests can't be choosy, I think incremental is the only way to ensure the data. I'd be interested in leveraging existing resources or partnering with other users. I definitely have more energy than I do knowledge on how to collect and store data effectively and efficiently. Maybe there would be a way to share costs in exchange for sharing data and PGCR responses while keeping the backend proprietary with separate technology stacks or something.

    Posting in language:

     

    Play nice. Take a minute to review our Code of Conduct before submitting your post. Cancel Edit Create Fireteam Post

  • Interesting, I dig it! Yeah, definitely talk with these folks, maybe you can share data for the purpose of achieving that end.

    Posting in language:

     

    Play nice. Take a minute to review our Code of Conduct before submitting your post. Cancel Edit Create Fireteam Post

You are not allowed to view this content.
;
preload icon
preload icon
preload icon