you can try to update the webgrab and retry?... i have the same issue but i have strange behavior, at this moment after the update in the main folder tvtv.us works...
Thanks Blackbear199, deleting all disallow lines did the job. On my end I had to set permission to "read-only" since It was rewriting robots files every time I ran wg.
unfortunally seem there's another new problem from tvtv.us...
now i receive
[ Info ] ( 1/4 ) TVTV.US -- chan. (xmltv_id=Animal Planet PACIFIC) -- mode Force
[Error ] Unable to update channel Animal Planet PACIFIC
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Animal Planet PACIFIC
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
check ur robot.txt file and see if it added those line that I mentioned in the other thread.
if they are there delete them and change the permission on the file to read only like the other user said as his was getting overwritten.
I change Yesterday permission read only... Robot file are not changed
if i delete the robot the new donwloaded make the warnings message of the previous days.
I dont know if it is useful:
i have a site.ini with a custom line
index_urlchannellogo.modify {addstart|https://*******t/LOGO/'config_display_name'.png}
works until this mornings, now seem that the variable config_display_name are not inizialized
If it can help, i'm using both tvtv.us for my american channels and tvtv.ca for my canadian ones. both of them are having the same problem as of today.Something has obviously changed on their website.
I'm getting error when put robots on read only permission.
Group (0) :
update requested for - 563 - out of - 563 - channels for 3 day(s)
( 1/563 ) TVTV.US -- chan. (xmltv_id=CBS WCBS New York NY US) -- mode Incremental
Job finished at 31/08/2019 08:24:36 done in 3s
Åtkomst till sökvägen C:\ProgramData\ServerCare\WebGrab_US\robots\tvtv.us.robots nekas.
vid System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
vid System.IO.File.InternalDelete(String path, Boolean checkHost)
vid WGconsole.P.CheckRobots(String 0, b 1)
vid WGconsole.F.1(String[] 0)
Unhandled Exception
For detailed info, see log file C:\ProgramData\ServerCare\WebGrab_US\WebGrab++.log.txt
Execution stopped
I made the Change in my ini File. However now when Processing any channel that a Movie is playing on only shows up in guide as "Movie" but not the name of the actual movie playing? Do you have any other idea to what needs changed for that to work correctly showing movie name?
Anyone getting the 'no shows in indexpage' error after doing the above updates...
I have found that after doing the updates to the ini file as above it turns out that tvtv have also changed a lot of the channel numbers (XSTATIONIDX) so your channel lists and therefore your config file may now be out of date. Download the new channel list and update your config and thigs should work again
Again error:
[Error ] Unable to update channel NBC (WNBC) New York, NY
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from NBC (WNBC) New York, NY
[Error ] unable to update channel, try again later
i think theres' some problem in your grab
this is is the F12 code:
{"number":"206","channelNumber":206,"subChannelNumber":0,"stationID":594,"name":"ESPN".....},
{"number":"207","channelNumber":207,"subChannelNumber":0,"stationID":1527,"name":"ESPN News".....},
{"number":"208","channelNumber":208,"subChannelNumber":0,"stationID":3331,"name":"ESPN U",.....}
{"number":"209","channelNumber":209,"subChannelNumber":0,"stationID":650,"name":"ESPN2"....}
this is your grab... so the change is that now are not the stationID but the number channel..
but i think that somenthing is wrong
ESPN should be 206 and you have 204... e so fot the others
there's no correspondencce. the programs are not the espn programs
programme start="20190906023000 +0000" stop="20190906030000 +0000" channel="ESPN"
title lang="en"Forensic Files Elemental Clue
sub-title lang="en"Elemental Clue
desc lang="en"Police fear a serial killer is on the loose when two women in the same town are murdered.
category lang="en"True Crime
has anyone bother to look at anything besides me,everyone is doing it wrong.if you looked at the latest changes to the url_index you would see they now use startchan= and endchan= and not station id.so looking at this line..
yes,look under the documentation tab at the top of the forums.
you will need to edit the channel.xml creation section at the bottom of the ini and change the index_site_id.scrub..
I have to study the documentation and understand ... if in the meantime someone could attach the ini file and the webgrab.config to generate the channels I would be grateful
this new channels.xml works amazingly. the only thing is that all channels has a 2 hours out of sync since it's grabbing it at +0000 instead of +0200. Is there a way to fix this easely enough instead of editing it with notepad+++ ?
the times are in UTC,here's a perfect example to show this..
showName: "CBS 2 News at 11:00 p.m."
listDateTime: "2019-09-09 03:00:00"
as you can see the time says its starts at 3am but title says 11pm.
this is channel cbs new York with is UTC-0400.
if you subtract 4 hrs from the shown start time you get 11pm.
this means the start time is in UTC time.
if it doesn't appear correctly when you view the epg data in your player its nor because the source data is wrong,you have other problems.
Is there a recent ini that incorporates all the necessary changes. I've tried the one from 9/7, and made the adjustments that blackbear has given but it is still unable to parse data
[ ] WebGrab+Plus/w MDB & REX Postprocess -- version V2.1.9
[ ]
[ ] Jan van Straaten
[ ] Francis De Paemeleere
[ ]
[ ] thanks to Paul Weterings and all the contributing users
[ ] --------------------------------------------------------------------------------
[ ]
[ ] Job started at 09/09/2019 19:52:01
[ Debug ]
[ Debug ] Running on: Unix 4.15.18.20
[ Debug ] Environment: 4.0.30319.42000
[ Debug ] Mono version: 6.0.0.327 (tarball Thu Aug 29 21:15:03 UTC 2019)
[ Debug ]
[ Debug ] Loading timezone data
[ Debug ] Embedded timezones source: timezone.timezonesdata.txt
[ Debug ] Reading config file: /config/WebGrab++.config.xml
[ Debug ]
[ Info ] found: /config/siteini.pack/USA/tvtv.us.ini -- Revision 01
[ Debug ] xmltv input file - /data/guide.xml - found
[ Debug ] 0 superfluous shows removed
[ Info ] Found existing channel (xmltv_id=ABC (WTEN) Albany, NY) in the config file
[ Info ]
[ Info ]
[ Info ] i=index .=same c=change g=gab r=replace n=new
[ Info ]
[ Info ]
[ Info ] Group (0) :
[ Info ] update requested for - 1 - out of - 1 - channels for 9 day(s)
[ Debug ]
[ Info ] ( 1/1 ) TVTV.US -- chan. (xmltv_id=ABC (WTEN) Albany, NY) -- mode Incremental
[Error ] Unable to update channel ABC (WTEN) Albany, NY
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ABC (WTEN) Albany, NY
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Debug ] 0 shows in 1 channels
[ Debug ] 0 updated shows
[ Debug ] 0 new shows added
[ Info ]
[ Info ]
[ ] Job finished at 09/09/2019 19:52:02 done in 0s
[ Debug ] statistics upload error: The operation has timed out.
it says couldn't access robots file.
when i unchecked read only of file i get:
Unable to update channel US Discovery Science
Generic syntax exception:
message:
no index page data received from US Discovery Science
unable to update channel, try again later
Existing guide data restored!
( 1/32 ) TVTV.US -- chan. (xmltv_id=US History) -- mode Force
!! -- WARNING : tvtv.us doesn't allow epg grabbing !!
it is advised to disable this channel / site from your channel list
And when I run channel creation mode, i get zero channels in xml.
works fine for me. You need to remove all the disallows on tvtv.us.robots file and mark the file read only, and then populate the config file with the channels you want to pull.
you can try to update the webgrab and retry?... i have the same issue but i have strange behavior, at this moment after the update in the main folder tvtv.us works...
I'm using this siteini too.
Please, can someone update it?
Thanks!
www.webgrabplus.com/content/tvtvusini-fix
start reading from post #12.
Thanks Blackbear199, deleting all disallow lines did the job. On my end I had to set permission to "read-only" since It was rewriting robots files every time I ran wg.
It works for me too.
Just put this file in webgrab+plus/robots folder, and unzip first.
Thank you Blackbear199, for solving all the problems. Also for other channel grabbers.
unfortunally seem there's another new problem from tvtv.us...
now i receive
[ Info ] ( 1/4 ) TVTV.US -- chan. (xmltv_id=Animal Planet PACIFIC) -- mode Force
[Error ] Unable to update channel Animal Planet PACIFIC
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Animal Planet PACIFIC
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
some idea?
i have the last webgrab version 2.1.10, i use it until some hour ago.
assuming your using ini fr epg page..
edit ini and on the url_index line at the very end change..
&station=XSTATIONIDX
to
&startchan=XSTATIONIDX&endchan=XSTATIONIDX
i change to:
url_index{url|https://tvtv.us/tvm/t/tv/v4/lineups/XLINEUPIDX/listings/grid?detail=%27f...|urldate|T00:00Z&end=|urldate|T23:59Z&startchan=XSTATIONIDX&endchan=XSTATIONIDX}
but nothing change.
check ur robot.txt file and see if it added those line that I mentioned in the other thread.
if they are there delete them and change the permission on the file to read only like the other user said as his was getting overwritten.
I change Yesterday permission read only... Robot file are not changed
if i delete the robot the new donwloaded make the warnings message of the previous days.
seem a different problem
I dont know if it is useful:
i have a site.ini with a custom line
index_urlchannellogo.modify {addstart|https://*******t/LOGO/'config_display_name'.png}
works until this mornings, now seem that the variable config_display_name are not inizialized
If it can help, i'm using both tvtv.us for my american channels and tvtv.ca for my canadian ones. both of them are having the same problem as of today.Something has obviously changed on their website.
yes,both sites made the same changes
I think I found it,on the url_index look for..
detail=%27full%27
change it to
detail=%27brief%27
Amazing!!! i can confirm that it's now working you are a genius.
I confirm that blackbear is a genius!!
many many thanks
we hope the changes are over
Great work Blackbear
your the best
I'm getting error when put robots on read only permission.
Group (0) :
update requested for - 563 - out of - 563 - channels for 3 day(s)
( 1/563 ) TVTV.US -- chan. (xmltv_id=CBS WCBS New York NY US) -- mode Incremental
Job finished at 31/08/2019 08:24:36 done in 3s
Åtkomst till sökvägen C:\ProgramData\ServerCare\WebGrab_US\robots\tvtv.us.robots nekas.
vid System.IO.__Error.WinIOError(Int32 errorCode, String maybeFullPath)
vid System.IO.File.InternalDelete(String path, Boolean checkHost)
vid WGconsole.P.CheckRobots(String 0, b 1)
vid WGconsole.F.1(String[] 0)
Unhandled Exception
For detailed info, see log file C:\ProgramData\ServerCare\WebGrab_US\WebGrab++.log.txt
Execution stopped
should be another problem i have red only robots file and i tested now and works
I made the Change in my ini File. However now when Processing any channel that a Movie is playing on only shows up in guide as "Movie" but not the name of the actual movie playing? Do you have any other idea to what needs changed for that to work correctly showing movie name?
http://www.webgrabplus.com/content/just-gives-discription-movie-not-titl...
Anyone getting the 'no shows in indexpage' error after doing the above updates...
I have found that after doing the updates to the ini file as above it turns out that tvtv have also changed a lot of the channel numbers (XSTATIONIDX) so your channel lists and therefore your config file may now be out of date. Download the new channel list and update your config and thigs should work again
I am getting that message again. Updated also channel list, and tried with one channel. And still no success.
Again error:
[Error ] Unable to update channel NBC (WNBC) New York, NY
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from NBC (WNBC) New York, NY
[Error ] unable to update channel, try again later
yeah something has changed again. can't grab anything this morning.
Today it works for some channels, and for some don't.
I updated xml for channel id's.
For motortrend it says no shows in index page.
Discovery works ok.
http://www.webgrabplus.com/content/tvtvusini-fix
don't forget to grab the new channels.xml since alot of ID has changed. and modify these in tvtv.us.ini script.
start=|urldate|T00:00Z&end=|urldate|T23:59Z&station=XSTATIONIDX}
to
start=|urldate|T00:00:00.000Z&end=|urldate|T23:59:00.000Z&startchan=XSTATIONIDX&endchan=XSTATIONIDX}
wheres the new channels.xml
i try to see for example
https://tvtv.us/tvm/t/tv/v4/lineups/2381D/listings
"stationID":16875,"name":"DirecTV Sports 717","callsign":"NFLST14"
the siti ini have this ID:
update="i" site="tvtv.us" site_id="2381D/16875" xmltv_id="NFL SUNDAY TICKET 717">NFL SUNDAY TICKET 717
but i receive:
[Error ] no shows in indexpage!
that is the new channels.xml wich i grabbed perfectly this morning with.
They are not correct number id's for channels.
thanks, also for tvtv.ca are changed ID number?
how can i grab for other XLINEUPIDX I have channels that are not on 36212D
i try with the F12 but the station ID are the old one...
i think theres' some problem in your grab
this is is the F12 code:
{"number":"206","channelNumber":206,"subChannelNumber":0,"stationID":594,"name":"ESPN".....},
{"number":"207","channelNumber":207,"subChannelNumber":0,"stationID":1527,"name":"ESPN News".....},
{"number":"208","channelNumber":208,"subChannelNumber":0,"stationID":3331,"name":"ESPN U",.....}
{"number":"209","channelNumber":209,"subChannelNumber":0,"stationID":650,"name":"ESPN2"....}
this is your grab... so the change is that now are not the stationID but the number channel..
but i think that somenthing is wrong
ESPN should be 206 and you have 204... e so fot the others
site="tvtv.us" xmltv_id="ESPN" site_id="36212D/204"
site="tvtv.us" xmltv_id="ESPN News" site_id="36212D/206"
site="tvtv.us" xmltv_id="ESPN U" site_id="36212D/207"
site="tvtv.us" xmltv_id="ESPN2" site_id="36212D/208
there's no correspondencce. the programs are not the espn programs
programme start="20190906023000 +0000" stop="20190906030000 +0000" channel="ESPN"
title lang="en"Forensic Files Elemental Clue
sub-title lang="en"Elemental Clue
desc lang="en"Police fear a serial killer is on the loose when two women in the same town are murdered.
category lang="en"True Crime
has anyone bother to look at anything besides me,everyone is doing it wrong.if you looked at the latest changes to the url_index you would see they now use startchan= and endchan= and not station id.so looking at this line..
update="i" site="tvtv.us" site_id="2381D/16875" xmltv_id="NFL SUNDAY TICKET 717">NFL SUNDAY TICKET 717
and the actual data..
"number":"717","channelNumber":717,"subChannelNumber":0,"stationID":16875,"name":"DirecTV Sports 717","callsign":"NFLST14",
you should be using the "channelNumber": value..
update="i" site="tvtv.us" site_id="2381D/717" xmltv_id="NFL SUNDAY TICKET 717">NFL SUNDAY TICKET 717
I need to correct myself,you need to use the "number":"xxx" value as some channels have a sub channel number other than zero,example..
,{"number":"686-1","channelNumber":686,"subChannelNumber":1,"stationID":31547,"name":"Fox Sports Arizona Plus","callsign":"FSAZ+",
there is a howto to generate the channel xml?
yes,look under the documentation tab at the top of the forums.
you will need to edit the channel.xml creation section at the bottom of the ini and change the index_site_id.scrub..
index_site_id.scrub {multi|{"number":"||",|",}
I have to study the documentation and understand ... if in the meantime someone could attach the ini file and the webgrab.config to generate the channels I would be grateful
should bee correct
that wasn't soo hard todo now was it and u learned something.
Yes, :) thanks for your suggest
this new channels.xml works amazingly. the only thing is that all channels has a 2 hours out of sync since it's grabbing it at +0000 instead of +0200. Is there a way to fix this easely enough instead of editing it with notepad+++ ?
should be because i take it form italy, i think you can change the site.ini...
site {url=tvtv.us|timezone=UTC-02:00|
ore maybe change the timezone..
the times are in UTC,here's a perfect example to show this..
showName: "CBS 2 News at 11:00 p.m."
listDateTime: "2019-09-09 03:00:00"
as you can see the time says its starts at 3am but title says 11pm.
this is channel cbs new York with is UTC-0400.
if you subtract 4 hrs from the shown start time you get 11pm.
this means the start time is in UTC time.
if it doesn't appear correctly when you view the epg data in your player its nor because the source data is wrong,you have other problems.
Is there a recent ini that incorporates all the necessary changes. I've tried the one from 9/7, and made the adjustments that blackbear has given but it is still unable to parse data
[ ] WebGrab+Plus/w MDB & REX Postprocess -- version V2.1.9
[ ]
[ ] Jan van Straaten
[ ] Francis De Paemeleere
[ ]
[ ] thanks to Paul Weterings and all the contributing users
[ ] --------------------------------------------------------------------------------
[ ]
[ ] Job started at 09/09/2019 19:52:01
[ Debug ]
[ Debug ] Running on: Unix 4.15.18.20
[ Debug ] Environment: 4.0.30319.42000
[ Debug ] Mono version: 6.0.0.327 (tarball Thu Aug 29 21:15:03 UTC 2019)
[ Debug ]
[ Debug ] Loading timezone data
[ Debug ] Embedded timezones source: timezone.timezonesdata.txt
[ Debug ] Reading config file: /config/WebGrab++.config.xml
[ Debug ]
[ Info ] found: /config/siteini.pack/USA/tvtv.us.ini -- Revision 01
[ Debug ] xmltv input file - /data/guide.xml - found
[ Debug ] 0 superfluous shows removed
[ Info ] Found existing channel (xmltv_id=ABC (WTEN) Albany, NY) in the config file
[ Info ]
[ Info ]
[ Info ] i=index .=same c=change g=gab r=replace n=new
[ Info ]
[ Info ]
[ Info ] Group (0) :
[ Info ] update requested for - 1 - out of - 1 - channels for 9 day(s)
[ Debug ]
[ Info ] ( 1/1 ) TVTV.US -- chan. (xmltv_id=ABC (WTEN) Albany, NY) -- mode Incremental
[Error ] Unable to update channel ABC (WTEN) Albany, NY
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ABC (WTEN) Albany, NY
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Debug ] 0 shows in 1 channels
[ Debug ] 0 updated shows
[ Debug ] 0 new shows added
[ Info ]
[ Info ]
[ ] Job finished at 09/09/2019 19:52:02 done in 0s
[ Debug ] statistics upload error: The operation has timed out.
in my case, the issue is the channel creation script is cutting off the -XX.
see the attachment to see what is wrong.
I have also attached a working ini file that will correctly generate the channel lineup.
it doesn't work again.
it says couldn't access robots file.
when i unchecked read only of file i get:
Unable to update channel US Discovery Science
Generic syntax exception:
message:
no index page data received from US Discovery Science
unable to update channel, try again later
Existing guide data restored!
( 1/32 ) TVTV.US -- chan. (xmltv_id=US History) -- mode Force
!! -- WARNING : tvtv.us doesn't allow epg grabbing !!
it is advised to disable this channel / site from your channel list
And when I run channel creation mode, i get zero channels in xml.
works fine for me. You need to remove all the disallows on tvtv.us.robots file and mark the file read only, and then populate the config file with the channels you want to pull.
Pages