Invalid Status code 308

your timeout in config is too low. check a good config sample:
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...

just noted that siteini.pack has radiotimes revision 26....so update siteini.pack

did a quick test...works fine here

if they banned your ip you shouldn't be able to open the website

Looks like WG+P is having problems handling HTTP 308 Permanent Redirects.

HTTP code 308 is similar to HTTP 301 Moved Permanently redirect, in that they both redirect clients (like a browser) to load the page from a different location.

It is possible to use tools in a web browser to see what HTTP requests are being made, which allows you to see what's going on with any redirects that come up.

Let's look at an example using the URL for an episode of Tipping Point on May 31st 2021. If you open the following URL (without a slash at the end) in a browser ...

https://www.radiotimes.com/tv-programme/e/nq8hdt/tipping-point--31052021

... it will respond with a HTTP 308 code to redirect to the following URL (same as above with a slash at the end) ...

https://www.radiotimes.com/tv-programme/e/nq8hdt/tipping-point--31052021/

... which in turn responds with a HTTP 301 code to finally redirect to

https://www.radiotimes.com/tv-programme/q9nm5/tipping-point/episodes/?ep...

All of that happens in a fraction of a second and the web page that loads (check the address bar) is the last one above.

It looks like WG+P doesn't know how to handle HTTP 308 redirects, so it just treats it as an error response and tries again hoping for a different response.

If that's the case then the solution would be to change the code to handle HTTP 308 redirects the same way it handles HTTP 301 redirects.

However I can think of no reason why this would a problem for some, but not all users using the same site and channels.

rjdavison wrote:

Thanks for taking the time to give the detailed response.

No problem.

rjdavison wrote:

It's odd as all other UK siteini files are working fine.

Presumably radiotimes.com is the only site giving HTTP 308 redirects for some of the programmes. HTTP 301 redirects are probably more common.

Dunno where u guys got this http code 308/301, can you post log ?
Also for your knowledge, wg++ automatically allows redirects by default (from version 3.1 or above).
As i see something about ITV you posted, i runned all itv channels, attached a log for 4 days.
I think is more a setup of the config, that's why (almost got tired to say that) use the sample config in misc folder of the siteini.pack.
All i can say is that radiotimes returns some delay on some shows, but are easly handled by wg++. I will look further on that.
If it works for me why not for you ? probably that's the question...and i'm really curious about.

As i mentioned in the post before a low time-out of 5 sec it's not good in particular for this site. At post #2 i indicated a good config, you may want to try that.

I have been receiving the same "Invalid status code: 308" with radiotimes.com as rjdavison.

I have had no problems with it for months/years but then suddenly this error started showing since 17 May.

It is not a timeout issue, having tried running with various timeout settings (including mat8861's good config sample)

I noticed that rjdavison appears to be using Linux, as am I (Unraid server)

[ Debug ] Running on: Unix 5.10.28.0
[ Debug ] Environment: 4.0.30319.42000
[ Debug ] Mono version: 6.8.0.105 (tarball Tue Feb 4 21:20:20 UTC 2020)

If I run WebGrab with the same config and from the same WAN IP address in Windows 10, I do not receive the error.

I don't know why - but hopefully this helps?

I have also been receiving this same error since 17 May. I have been using this same ini for years without an issue.

I am also running on UNIX.

I will try running on a W10 machine and see what happens.

I hope someone can offer some help.

UPDATE: I can confirm that my .config and .ini run on Windows 10!

I suspect is an issue related to mono

Hello
On my synology im having the same problem. it does download the title and the category.
I did run it on my windows computer there the data comes in without the errors. but there is a lot missing no episodenumbers and no actors. I did look at the guide.xml Matt posted that has the same problem altough given the type of programs its hard to tell but eastenders should have more info.
So something has changed on the radiotimes website.
with kind regards Peter

i am working on it to get full data, which is also the problem for linux. On some shows example: https://www.radiotimes.com/tv-programme/e/nq7qg2/unbeatable--episode-11 there is no details or better a page comes after 2 redirects.
Request URL: https://www.radiotimes.com/tv-programme/e/nq7qg2/unbeatable--episode-11
Request Method: GET
Status Code: 308 (from disk cache)
then:
Request URL: https://www.radiotimes.com/tv-programme/e/nq7qg2/unbeatable--episode-11/
Request Method: GET
Status Code: 301 (from disk cache)
and finally:
Request URL: https://www.radiotimes.com/tv-programme/npgkxj/unbeatable/episodes/?epis...
Request Method: GET
Status Code: 200

I will see with authors what can be done. It also could be they are updating their system, so will see.

siteini updated, seems ok also on linux ;)

I also had this problem - appeared a few days ago on config that had been running well for may months. Just downloaded new site.ini and looks much better. No 308's seen. I am running Linux (ubuntu 16.04). With the previous latest site pack took 5 hours to do 90 odd channels @ 3 days. With today's version it looks like it should complete in less than 45 mins. Getting a few timeouts still but will follow advice from earlier posts in this thread. Many thanks for the rapid fix.

Hi Thanks for the updated information. I'm looking for a little help.

Back ground:
I have been using a customized .ini file since 2017, with a few updates since then to provide the precise details I wanted. I then use the details to build (using Powershell) a .MXF file for importing in to Windows Media Center. All was fine until last week!

I have since been testing the .ini on Windows10, and it appears that it is not redirecting to the detail page for the show and hence is unable to scrub any details. (Looking at the RT web page, I think I will have to update the show detail elements anyway, since the page layout, etc. has changed, but that's my next challenge!)

Can you help me with the changes I need to get to the detail page?

I have attached my Customized .ini - it's not very elegant or I guess efficient, but it did work. ;)

Thanks in advance.
Martin

Hi Martin not that i don't want to help you, but i think they are doing lots of changes.The old reference is "Link":" (see picture) in split but that is causing lots of problems, shows not found and redirects (2-3 times) that webgrab cannot handle.The old link to details basically is inadequate, the new ones (there are at least 3) fill up the web page with details. As matter of fact i made revision 28 with what i suppose is correct, but still incomplete, you get most elements and runs fast (also on linux) but.....as i said is incomplete, what i noticed up to now, no total number of episodes, no premiere....and don't know what else.I attach it for you to test.I guess we have to wait for final changes as it looks they started updating website mid of may

for whoever don't need elements i started telegraph, almost ready, doesn't have actor but basic elements title/description/productiondate/episode on the other side it's very fast

Hi,
Thanks for your feedback.

I have run (on W10 so far) the radiotimes.comv28.ini file you sent and it does work for me and does grab the show details.

However, I still need some details from the Index page, such as the Episode and Programme ID, as I use these to determine show series and repeats in MCE. So for now, I will have to merge two xml downloads (your v28 with my customised version which gets the index page details I need).

Thanks again for your help and work. Let's hope RadioTimes settles down shortly!

Martin

Martin if you tell me what you need i can change it for you, I rewrote the 90% of the siteini and after looking at your old copy i decided be easier to ask you what end result you need.Can you make a sample of how you want episodeID and ProgrammeID ?
is the picture what you need ?

Hi Matt,

Thank you for the offer of help, it is much appreciated!

Attached is a list of the elements I would like. Most of them you currently have in the radiotimes.comv28.

So long as the EpisodeID and ProgrammeId are uniquely identified in the xml, I will be able to find them and use them in my next step.

Thanks again.
Martin

try this i added elements at the end of description

Hi Matt,

Thank you very much for your help. I'll now update my PowerShell script and give it a try.

Martin

Hi Matt,

I have run the .ini you have sent. It's runs well, except there is something wrong with the EId number. It is the same for all programmes on a given channel, i.e. Film4 EId is 'sn52' and BBC1HD EID is 'nqz5qb'. Here is the .xml I get when using a short test run.

Thanks for your feedback.

Woops...here you go.

Is episode data working on radiotimes at the moment, or are we waiting for them to complete their updates? Apologies if this is a repeat question, I had the episode information up until a few days ago, now its gone. I updated to the latest INI, but to improvement

Update : Yes, its working, user error! FACEPALM!

Cheers!

There is revision 28 on github https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/site...
all info are available. It still slows down on some shows, but I guess is a site problem.