You are here

tvguide.com usa stopped working - no new data after Jan 29, 2021

66 posts / 0 new
Last post
sparklesunshine
Offline
Donator
Joined: 4 years
Last seen: 2 years
Graburrz wrote:

sparklesunshine wrote:
Do that as well in all your siteinis but make sure your config is only using one zip code/provider per copied siteini

I think that's what I have. Most all the channels in my config are from providers and channels generated by the tvguide.ini. In order by zip/country here's 6 examples:
site="tvguide.com" site_id="9100001970##9233015158" xmltv_id="WPVI (ABC Philly)" - xx-Dish_19102.ini
site="tvguide.com" site_id="9100008443##9233013462" xmltv_id="Animal Planet (East2)" - xx-Dish_10001.ini
site="tvguide.com" site_id="9133007816##9200008780" xmltv_id="HBO (East)" - xx-DirecTV_10001.ini
site="tvguide.com" site_id="9133003455##9233016893" xmltv_id="Love Nature" - xx-Bell_Satellite_TV_Toronto.ini
site="tvguide.com" site_id="9100008963##9200000213" xmltv_id="PBS WGCU FL" - xx-Palm_Coast_33965.ini
site="tvguide.com" site_id="9133002871##9233003495" xmltv_id="KCBS HDTV" - xx-Broadcast_90807.ini
And I just found one for the tvguide.com.channels.Broadcast TV New York.10001.xml in my config I forgot:
site="tvguide.com" site_id="9133006313##9233009269" xmltv_id="WNBC Cozi TV" - xx-Broadcast TV New York.10001.xml
So I have those 6 copies of the tvguide.ini. Does it throw things off if I missed one, say that Broadcast TV New York ini. Or that I left the main tvguide.com.ini in there?

In the config the same provider/zip should be listed one after the other eg all the 10001 zip codes then all the 15001 zip codes and so on. This will make it faster as it doesn't have to redownload the index for each channel grab assuming you edited the siteini to retain index as mentioned previously.

Each zip code needs to point to a unique copy of the tvguide siteini which it looks like you have done with each siteini having the index line uncommented in siteini.

If you have two different zip codes linked to the same named tvguide siteini then the 2nd zip code channels will fail

Here is an example of mine

Attachments: 
Graburrz
Offline
Donator
Joined: 8 years
Last seen: 2 weeks

Thanks for your guidance on this sparklesunshine My Internet was out all night and came on just I was turning in this late night / early morning hour. Will look over your instructions & exanple.txt file later in the day tomorrow. Eager to speed up this tortoise :)

Graburrz
Offline
Donator
Joined: 8 years
Last seen: 2 weeks

Okay, so it was a matter of appending site="tvguide.com" in the config for all channels with the same zip/provider with the matching suffix added to the duplicated tvguide.ini. This got things speeded up considerably:

tvguide.com_Dish_10001.ini
site="tvguide.com_Dish_10001" site_id="9100008443##9233013462" xmltv_id="Animal Planet (East2)"
tvguide.com_DirecTV_10001.ini
site="tvguide.com_DirecTV_10001" site_id="9133007816##9200008780" xmltv_id="HBO (East)"
tvguide.com_Broadcast_90001
site="tvguide.com_Broadcast_90807" site_id="9133002871##9233003495" xmltv_id="KCBS HDTV"

I found I didn't have to group all the channels from the same zip/provider together as you suggested. Once WG indexed a zip/provider, it pretty much immediately started grabbing data for channels further down in the config from that zip/provider. So thankfully I can keep my preferred channel order.

Thanks so very much for your feedback on this sparklesunshine! :)

nissan22
Offline
nissan22's picture
Donator
Joined: 8 years
Last seen: 3 years

Nothing it's working can you please show me how to grab usa channels because i cant thank you

sparklesunshine
Offline
Donator
Joined: 4 years
Last seen: 2 years
nissan22 wrote:

Nothing it's working can you please show me how to grab usa channels because i cant thank you

Make sure you are using the latest siteini (revision 18)
Make sure you have pulled a new channel list as the old one will not work - I have already posted channel lists for New York and Florida in this thread but if you need a different provider or state then you will have to pull your own channel list using the instructions in the siteini.

Only use one zip code per tvguide.com site ini - if you want to use multiple zip codes create a copy of the siteini and then amend your config to point to the name of your copy. Again see my example in a previous post.

And finally to speed things up uncomment the index line in the site ini so it retains the index and once again see my previous posts

mat8861
Offline
WG++ Team memberDonator
Joined: 9 years
Last seen: 6 hours
nissan22 wrote:

Nothing it's working can you please show me how to grab usa channels because i cant thank you

Post your webgrab log and config (hide license mail / password) so we can see what is wrong. Just posting "nothing is working" want help.

nissan22
Offline
nissan22's picture
Donator
Joined: 8 years
Last seen: 3 years

Thank you

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 16 min

your missing the user-agent from your webgrab config.xml
http://webgrabplus.com/documentation/configuration/webgrabconfigxml#conf...

here one i use..
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.104 Safari/537.36

add it anywhere between the <settings> and </settings> tags where all the other setings are.

Attachments: 
nissan22
Offline
nissan22's picture
Donator
Joined: 8 years
Last seen: 3 years

thank you it worked

condecabello
Offline
Donator
Joined: 9 years
Last seen: 2 months

Hi, I cant generate a provider list for Mexico, used the ini in this thread and uncommented in ##### PROVIDER FILE CREATION BY COUNTRY. Hope you can help me

sparklesunshine
Offline
Donator
Joined: 4 years
Last seen: 2 years
condecabello wrote:

Hi, I cant generate a provider list for Mexico, used the ini in this thread and uncommented in ##### PROVIDER FILE CREATION BY COUNTRY. Hope you can help me

Works totally fine for me - see channel list in attachment

condecabello
Offline
Donator
Joined: 9 years
Last seen: 2 months

Thanks sparkle, please can u tell me what I did wrong??

sparklesunshine
Offline
Donator
Joined: 4 years
Last seen: 2 years
condecabello wrote:

Thanks sparklesunshine, can u please tell me what i did wrong??

The only difference is I didn't have the text you had in your config about how to use the siteini above your siteini line and I ran my config in i mode and not c mode as it uses the old update method (not that I think that makes a difference)

Don't know if you uncommented the lines in the siteini correctly or not

condecabello
Offline
Donator
Joined: 9 years
Last seen: 2 months

Thank u very much, I finally did it

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 16 min

if your using copies for each zip code then edit the ini as i said above to enable keepindexdpage
it will speed things up dramastically.
far as speed,it is what it is..
webgrab scrapes the page the same as you would using your web browser to view it...
some sites are fast and some are slow,it is what it is.

Pages

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl