How can you get around server scraping bans?

I lost the ability for my server to retrieve from a sportsbook (Draftkings) json request and im a newb who is not sure what to do now that I see it looks like they are blocking my servers requests.

I tried deleting the cookies in the script, setting headers and refferers to the draftkings itself, but it still won't give me my data back.

Does anyone know any clever hacks on how to get around this? is there a way that i can send the request from the users device ip instead of using my server to retrieve it?

The key is that when someone requests the odds, they are going to be requested. So its not something that I want to run periodically, just a feature i give if someone wants to click on and find odds of a given fight

Shopping Cart Returner Shirt $21.68

DMT Has Friends For Me Shirt $21.68

Shopping Cart Returner Shirt $21.68

  1. 2 months ago
    Anonymous

    Post the error response. A common workaround is to include delay/sleeps between calls to make it look human-like and prevent request limitations

    • 2 months ago
      Anonymous

      would wager my fricking house op has no sleep/delay timers, too poor for a vpn and way too fricking moronic to understand how torify works.

      https://i.imgur.com/XV4I64b.png

      I lost the ability for my server to retrieve from a sportsbook (Draftkings) json request and im a newb who is not sure what to do now that I see it looks like they are blocking my servers requests.

      I tried deleting the cookies in the script, setting headers and refferers to the draftkings itself, but it still won't give me my data back.

      Does anyone know any clever hacks on how to get around this? is there a way that i can send the request from the users device ip instead of using my server to retrieve it?

      The key is that when someone requests the odds, they are going to be requested. So its not something that I want to run periodically, just a feature i give if someone wants to click on and find odds of a given fight

      IQfy is not a help desk for computer illiterate Black folk, street shitters and chinks.

      • 2 months ago
        Anonymous

        not OP but thanks for mentioning torify, wasn't aware of it

    • 2 months ago
      Anonymous

      So as mentioned or thought i mentioned, the query to the draftkings only happens if you click to request it. So unless youre calling the php its not going to request. So Sleep/delay should be no issue no?

      would wager my fricking house op has no sleep/delay timers, too poor for a vpn and way too fricking moronic to understand how torify works.

      [...]
      IQfy is not a help desk for computer illiterate Black folk, street shitters and chinks.

      Op does have VPN but dumbass im hosting this on another provider not my own computer. I would prefer if it runs off them too. I dont have access to install a vpn on that server.

      very much this, anon. people into gambling are just fricking pathetic.

      What is wrong with people looking to entertain themselves with potential of winning something? I collect the betting lines so I can help make an educated guess on the result based on the data I've collected from past events and shit. Im just building tools. Appreciate the bump

      • 2 months ago
        Anonymous

        >So unless youre calling the php its not going to request. So Sleep/delay should be no issue no?
        You're assuming here, hence why I'm telling you to post the error response, Jesus anon

        • 2 months ago
          Anonymous

          hey man, i wish I had an error response - that would give me an avenue to solve. Im getting literally no response but 200 OK

          It was working perfectly fine and then suddenly stopped. Im not too sure why but I figure they ip blocked my host maybe?!

          The payload is just nothing and response is nothing (why you see "Hello" only.).

          If I change the url to another one like the commented out one, I get the whole json response no issue. But its not the endpoint i need.

          • 2 months ago
            Anonymous

            You should've started with that. Try with another IP to see what happens, if it works with another one then your host is blocked for sure

          • 2 months ago
            Anonymous

            well, its hosted at a static ip, i cant change my IP on the server. So im looking for ways I can bypass this. Like is it possible for the request to be made from the device ? I guess the only way I could do that is by making it an actual app?

            I could try the method the one guy mentioned of torify but i think i need to stand up a container, have the request from my website go to the container im hosting and then trigger the call to draftkings and respond with it.. trickier, but probably a decent hack.

            I know there is mma odds api's you can subscribe to, but this is a passion project i dont need to get to that point just yet. I had this working swell... It sucks that i might be prevented from getting around it without migrating to a new server/host. If so, whats the best place to get comparisons for hosting? or should I just use AWS ?

            Any feedback is helpful

          • 2 months ago
            Anonymous

            >is there a way that i can send the request from the users device ip instead of using my server to retrieve it?

            I see, if it's a website you're building then you would have to include javascript code that fetches the JSON. Otherwise I have no clue

          • 2 months ago
            Anonymous

            i dunno - i appreciate your help anyways but might not be in your area of expertise. everything is managed in my PHP script. the php manages the json response too. I switched locations and observed the request to sportsbook from a different local, and it returns a different URL that when I substitute gets me back working. I need to figure a different way before I get blocked across all their sites, but at least I restored some of this functionality!

            I wonder if there is a way i can set my headers in order to avoid detection, but maybe im just gonna have to work towards switching to one of the api-s thats available

            Thanks! Ill leave this up for any suggestions but if it dies at least I got something working for now

          • 2 months ago
            Anonymous

            client side JavaScript and then you better open source your project or else youre part of the problem

          • 2 months ago
            Anonymous

            Everythings on github open for everyone to use. They can replicate/build the entire site to host themselves.

            I try not to be part of the problem

  2. 2 months ago
    Anonymous

    >sports betting
    consider suicide

    • 2 months ago
      Anonymous

      very much this, anon. people into gambling are just fricking pathetic.

  3. 2 months ago
    Anonymous

    use proxies you frickin noob

  4. 2 months ago
    Anonymous

    See if I comment the different endpoint, i get the echo + hello where you can see all the json.. but the original url is not responding at all to my request. But if you took it and tried it yourself in a browser, it works no issue.

    I have only made about 150 requests over the past month too - so I dont think my volume would have even triggered... but maybe ?!

  5. 2 months ago
    Anonymous

    hey - if anyone has suggestion, what php modules would you install or get familiar with?

    I have these options but not all of them have a tool tip when you hover over to give you a brief description

  6. 2 months ago
    Anonymous

    oops forgot pic

  7. 2 months ago
    Anonymous

    this is why I use python with selenium. I see the web browser if I wanted by not putting in the headless option.

Your email address will not be published. Required fields are marked *