A Cheeky Question
I live in the UK but love US tv shows especially certain comedy shows which are not available to UK IP addresses. However up until Jan this year I had developed an automated system to still watch these shows without using a proxy or VPN. With the help of a firefox addon I worked out the actual URl that plays the shows regardless of IP address it was hidden away within numerous AJAX calls. All I need is the relevant episode ID which I can plop into the URL and then I can watch the show regardless that my IP is in the UK. This was working great until this month as I could easily scrape these IDs from the relevant pages and then build up an HTML page with the relevant links so I could watch the shows whenever I wanted. However they have now changed their HTML source code so that the real ID's are not available in the HTML source instead they use an alias that is not related to the real ID. The alias is passed into their media server and the correct URI is returned. As they are using complex layered Ajax to load the videos and return the real ID from the alias it means that a) I cannot scrape anymore to get the true IDs b) web proxies or US proxy details don't work. At the moment for each show I am having to do the search manually e.g go to the page click the video and watch the HTTP requests and pick out the ID from the relevant request. This obviously is a pain to do and I would like to return to the happy days of an automated system if possible. I am not "hacking" as I am not bypassing any challenge/response authorisation and technically all the files are local on my PC (local temp files). Does anyone know of any form of proxy that works with complex AJAX requests that load the content? Its not the actual HTML page that is blocked by IP but the media server which is used by their video player which checks where the Javascript request is made from. Or can anyone think of a way I could automate accessing the relevant http request I need that only occurs when a link is clicked. I am considering some sort of Javascript crawler using an iframe to load the content and some code is required to simulate the relevant click and then read the HTTP requests but I am sure there is a simpler way.... Any code in any language is fine if it helps me :) Thanks for any help in advance
|
