sparklesunshine wrote:
Do that as well in all your siteinis but make sure your config is only using one zip code/provider per copied siteini
I think that's what I have. Most all the channels in my config are from providers and channels generated by the tvguide.ini. In order by zip/country here's 6 examples:
site="tvguide.com" site_id="9100001970##9233015158" xmltv_id="WPVI (ABC Philly)" - xx-Dish_19102.ini
site="tvguide.com" site_id="9100008443##9233013462" xmltv_id="Animal Planet (East2)" - xx-Dish_10001.ini
site="tvguide.com" site_id="9133007816##9200008780" xmltv_id="HBO (East)" - xx-DirecTV_10001.ini
site="tvguide.com" site_id="9133003455##9233016893" xmltv_id="Love Nature" - xx-Bell_Satellite_TV_Toronto.ini
site="tvguide.com" site_id="9100008963##9200000213" xmltv_id="PBS WGCU FL" - xx-Palm_Coast_33965.ini
site="tvguide.com" site_id="9133002871##9233003495" xmltv_id="KCBS HDTV" - xx-Broadcast_90807.ini
And I just found one for the tvguide.com.channels.Broadcast TV New York.10001.xml in my config I forgot:
site="tvguide.com" site_id="9133006313##9233009269" xmltv_id="WNBC Cozi TV" - xx-Broadcast TV New York.10001.xml
So I have those 6 copies of the tvguide.ini. Does it throw things off if I missed one, say that Broadcast TV New York ini. Or that I left the main tvguide.com.ini in there?
In the config the same provider/zip should be listed one after the other eg all the 10001 zip codes then all the 15001 zip codes and so on. This will make it faster as it doesn't have to redownload the index for each channel grab assuming you edited the siteini to retain index as mentioned previously.
Each zip code needs to point to a unique copy of the tvguide siteini which it looks like you have done with each siteini having the index line uncommented in siteini.
If you have two different zip codes linked to the same named tvguide siteini then the 2nd zip code channels will fail
Thanks for your guidance on this sparklesunshine My Internet was out all night and came on just I was turning in this late night / early morning hour. Will look over your instructions & exanple.txt file later in the day tomorrow. Eager to speed up this tortoise :)
Okay, so it was a matter of appending site="tvguide.com" in the config for all channels with the same zip/provider with the matching suffix added to the duplicated tvguide.ini. This got things speeded up considerably:
I found I didn't have to group all the channels from the same zip/provider together as you suggested. Once WG indexed a zip/provider, it pretty much immediately started grabbing data for channels further down in the config from that zip/provider. So thankfully I can keep my preferred channel order.
Thanks so very much for your feedback on this sparklesunshine! :)
Nothing it's working can you please show me how to grab usa channels because i cant thank you
Make sure you are using the latest siteini (revision 18)
Make sure you have pulled a new channel list as the old one will not work - I have already posted channel lists for New York and Florida in this thread but if you need a different provider or state then you will have to pull your own channel list using the instructions in the siteini.
Only use one zip code per tvguide.com site ini - if you want to use multiple zip codes create a copy of the siteini and then amend your config to point to the name of your copy. Again see my example in a previous post.
And finally to speed things up uncomment the index line in the site ini so it retains the index and once again see my previous posts
Hi, I cant generate a provider list for Mexico, used the ini in this thread and uncommented in ##### PROVIDER FILE CREATION BY COUNTRY. Hope you can help me
Hi, I cant generate a provider list for Mexico, used the ini in this thread and uncommented in ##### PROVIDER FILE CREATION BY COUNTRY. Hope you can help me
Works totally fine for me - see channel list in attachment
Thanks sparklesunshine, can u please tell me what i did wrong??
The only difference is I didn't have the text you had in your config about how to use the siteini above your siteini line and I ran my config in i mode and not c mode as it uses the old update method (not that I think that makes a difference)
Don't know if you uncommented the lines in the siteini correctly or not
if your using copies for each zip code then edit the ini as i said above to enable keepindexdpage
it will speed things up dramastically.
far as speed,it is what it is..
webgrab scrapes the page the same as you would using your web browser to view it...
some sites are fast and some are slow,it is what it is.
In the config the same provider/zip should be listed one after the other eg all the 10001 zip codes then all the 15001 zip codes and so on. This will make it faster as it doesn't have to redownload the index for each channel grab assuming you edited the siteini to retain index as mentioned previously.
Each zip code needs to point to a unique copy of the tvguide siteini which it looks like you have done with each siteini having the index line uncommented in siteini.
If you have two different zip codes linked to the same named tvguide siteini then the 2nd zip code channels will fail
Here is an example of mine
Thanks for your guidance on this sparklesunshine My Internet was out all night and came on just I was turning in this late night / early morning hour. Will look over your instructions & exanple.txt file later in the day tomorrow. Eager to speed up this tortoise :)
Okay, so it was a matter of appending site="tvguide.com" in the config for all channels with the same zip/provider with the matching suffix added to the duplicated tvguide.ini. This got things speeded up considerably:
tvguide.com_Dish_10001.ini
site="tvguide.com_Dish_10001" site_id="9100008443##9233013462" xmltv_id="Animal Planet (East2)"
tvguide.com_DirecTV_10001.ini
site="tvguide.com_DirecTV_10001" site_id="9133007816##9200008780" xmltv_id="HBO (East)"
tvguide.com_Broadcast_90001
site="tvguide.com_Broadcast_90807" site_id="9133002871##9233003495" xmltv_id="KCBS HDTV"
I found I didn't have to group all the channels from the same zip/provider together as you suggested. Once WG indexed a zip/provider, it pretty much immediately started grabbing data for channels further down in the config from that zip/provider. So thankfully I can keep my preferred channel order.
Thanks so very much for your feedback on this sparklesunshine! :)
Nothing it's working can you please show me how to grab usa channels because i cant thank you
Make sure you are using the latest siteini (revision 18)
Make sure you have pulled a new channel list as the old one will not work - I have already posted channel lists for New York and Florida in this thread but if you need a different provider or state then you will have to pull your own channel list using the instructions in the siteini.
Only use one zip code per tvguide.com site ini - if you want to use multiple zip codes create a copy of the siteini and then amend your config to point to the name of your copy. Again see my example in a previous post.
And finally to speed things up uncomment the index line in the site ini so it retains the index and once again see my previous posts
Post your webgrab log and config (hide license mail / password) so we can see what is wrong. Just posting "nothing is working" want help.
Thank you
your missing the user-agent from your webgrab config.xml
http://webgrabplus.com/documentation/configuration/webgrabconfigxml#conf...
here one i use..
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.104 Safari/537.36
add it anywhere between the <settings> and </settings> tags where all the other setings are.
thank you it worked
Hi, I cant generate a provider list for Mexico, used the ini in this thread and uncommented in ##### PROVIDER FILE CREATION BY COUNTRY. Hope you can help me
Works totally fine for me - see channel list in attachment
Thanks sparkle, please can u tell me what I did wrong??
The only difference is I didn't have the text you had in your config about how to use the siteini above your siteini line and I ran my config in i mode and not c mode as it uses the old update method (not that I think that makes a difference)
Don't know if you uncommented the lines in the siteini correctly or not
Thank u very much, I finally did it
if your using copies for each zip code then edit the ini as i said above to enable keepindexdpage
it will speed things up dramastically.
far as speed,it is what it is..
webgrab scrapes the page the same as you would using your web browser to view it...
some sites are fast and some are slow,it is what it is.
Pages