WG++ 3.1.0.0
Linux Mint 19.3
Mono version: 6.8.0.123
I followed the instructions. Went to DirecTV.com, input my zip code, downloaded cookies (renamed to directv.com.cookies.txt), and removed the lines that gave me errors (about 3 errors before i got no more errors).
So it finally runs with no cookie errors but just times out. If i'm missing a step, I'm all ears.
Thanks
Which browser & extension did you use to get your cookie hr1948? I couldn't get any to download a cookie for DirecTV that WG would recognize.
I use Chrome browser and the cookes.txt extension
Go on site
change zip code in tv guide, confirm and let it load
highlight and copy the cookie in cookie file
run channel list
remove the line containing error
re-run channel list
grab the channel you want
It's exactly the method i followed. I'm getting "operation has timed out"
I noticed you are using Windows. Could it be a Linux/mono issue?
I have the same issue and i asked 2 days ago very strange.
regards
Same issue. Removing the line in the cookie file removed the cookie error, but still timing out when trying to build channel list.
I'm running this on my Windows 7 PC, and I seem to be having the same problem. I'm not all that good at all this technically, but if I'm understanding mat8861's shorthand instructions correctly, I'm left with the grab looping 5 times as specified in my config and then closing out.
I'm assuming mat8861's shorthand means to follow the instructions in directv.com_instructions.txt, except for running the grab once with the dummy before deleting the line in directv.com.cookies.txt with the line I'm assuming is the one with the value 'pses' in it, and then running the grab again.
Thanks jhr1948. I was using the 'Cookies.txt One Click' Chrome extension which seems to do the same job
except it pops up to save the cookie file. I switched to 'Cookies.txt', but got the same WG error with the cookie file it creates.
You asked 2 days ago, Matt updated the DirecTV ini yesterday (1 day ago).
Still don't know why its timing out for me.
yes i checked also with crypted ini and same issue.
regards
Where is the updated ini? Under EPG channels it says 07-11-16, and on github it says last modified 4 years ago.
Networks/directv.com.ini, correct?
In the donor area
Got it. I just discovered webgrab+ and have yet to donate because I can't get the sites I want to work right... zap2it, directv. The sites I can get working don't provide good data... tvguide, tvpassport, tvtv.
retry time-out="180" this is what i use
same result here tested until 720 :(
regards
If it works for me, must work for you....i added a note in donator's area ;) I am sure will work for you also
Got it and working thanks a lot.
btw please dont forget reply my request for .com.co hope you will released :)
regards
Didn't forget..almost ready
Ok Matt, using your note (recommended user-agent), it did work. I have 3 questions:
1. Would you be able to get "New" added to the description (or some other indicator)?
2. Would you be able to get the season/episode "onscreen" entry?
3. Not sure i understand the user-agent thing. I've always see keep the user agent up to date, but i noticed the Chrome version in your suggestion is really old. Is there a page in the documents explaining user-agents?
DirecTV has the "New" and SxxExx info
Thanks again for al the hard work!
With the recommended user-agent and new crypt ini I've got it grabbing data from the channels xml in the donor area. But with the dummy from the old ini, I'm not getting a directv.com.channels.xml to generate. I've tried it with and without enabling 'channel file creation' in the old ini. Is that old ini being read anymore? I have the crypt ini in siteini.user.
@jhr1948 it is not a standard, that's why is a "preferred" one, it depends on sites and also some new stuff Jan added in version 3.1. So before adding to siteini pack i would like to test it for a bit. Also because the error we have now in cookie (the part needed to remove). Hopefully it will get fixed soon although it's not a big problem.
Siteini
the new should be "premiere" not used so much...but can be added as premiere or end of descriptiom (need channel line pls)
Episode it's there...now
Thank you for your quick response and explanation Mat8861
I agree, the errored cookie line is not a huge deal.
As far as a premiere (for New showings) added as an element or in the desctiption, that would awesome.
Here is the zipcode i used: 33911 (not sure if it helps, but i'll attach cookie txt)
Channel line:
<channel update="i" site="directv.com" site_id="30#_#3344" xmltv_id="Fort Myers, FL WGCU PBS 30 A3 HD (WGCU)">Fort Myers, FL WGCU PBS 30 A3 HD (WGCU)</channel>
Regarding SxxExx, It didn't grab any on my end. Here's the xmltv entry from that above screenshot from Directv
<programme start="20200626230000 +0000" stop="20200627000000 +0000" channel="Fort Myers, FL WGCU PBS 30 A3 HD (WGCU)">
<title lang="en">PBS NewsHour</title>
<credits>
<actor role="Host">Judy Woodruff</actor>
</credits>
<date>2020</date>
<category lang="en">Series</category>
<category lang="en">News</category>
<rating system="MPAA">
<value>NR</value>
</rating>
</programme>
redownload please, i forgot to change revision/date.
Mat8861 SxxExx works perfectly now. Unfortunately, i can only grab about 2 or 2 1/2 hours of EPG. Did something change on their website? I'm using your recommended user-agent.
My fault..was testing some stuff and had a typo, to avoid confusion is now rev.19
Perfect Mat8861
Any chance of getting the "New" indication?
Everthing works great. Question, do the cookies expire?
cookies will be updated when webgrab runs.its built in process for sites that use them.
just check the modified date on the cookie file and u will see it changes everytime wg runs.
Appreciate that Blackbear199!
Hey Mat8861, Just wondering if you have worked out the "New" or entry yet?
Hey guys, I need a little help. I am using the new version and I followed the directions. After I removed the error in the cookies, the script times out even when set to 180. Furthermore, How do I enter the channel creation mode to create the channel xmltv for the zipcode I chosen? I do not see any information within the new script on how to place in the channel creation mode like the public ini.
Thanks
Lisa
I believe the zip is determined by the cookie file.
Have you checked out the suggested user agent by Mat8861? That did it for me.
Thanks for the reply. I followed the steps from a-z and ini times out. This is what I did: 1. Went to directv site and entered zipcode. The guide displayed the programming zip code for the area I chose and then I used cookies.txt to save text file as directv.com.cookies.txt. I configured my xml with my license and directv decryption key, timeout 180 and added dummy channel. I ran wg++ and received error. I removed error from cookie and saved. I ran wg++ again and ini starts to update request "i" and times out. Any steps that I am missing? I I tried with google and firefox browser and receive same results. Thanks, Lisa
From your steps i cant tell if you tried what i suggested. Did you use the recommended "User Agent" line that Matt8861 suggest? Because many of us had the timeout issues just like you, until we tried that and it worked.
Thanks for the response. I am not sure what the user agent is. Is that a particular WebGrab++.config.xml that is used? I have done multiple google searches and cannot find info on that particular recommended user agent.
Can you tell me where I can find it?
Thanks
Lisa
http://webgrabplus.com/documentation/configuration/webgrabconfigxml#conf...
Just figured it out. Thanks for the help. I guess I was having a blonde day. (Lol)
I spoke too quick I copied the cookies with the zip code i entered and deleted the errors as instructed. I ran a dummy channel file and the channels that I selected for the zip code will not grab. My log states "Group (0) :
[ Info ] update requested for - 1 - out of - 1 - channels for 1 day(s)
[ Debug ]
[ Info ] ( 1/1 ) DIRECTV.COM -- chan. (xmltv_id=dummy) -- mode Force
[Error ] no shows in indexpage!
[ Info ]
[ Debug ]
[ Debug ] 0 shows in 1 channels
[ Debug ] 0 updated shows
[ Debug ] 0 new shows added
No creation file was created, but if I use the xml that was posted by matt for 90001, I can grab. Can you guide me into the right direct to grab my area?
Thanks
are u using update mode c in ur wg config.xml
you should see a message in your log saying its in channel xml creation mode.
Thanks Blackbear! That was the problem.
glad u figured it out.
you should read the entire page i said above(scroll up or down) as it explains all the settings beside user-agent(for wg config.xml).
on the top of the forums click on the documentation tab,it will take you to same place i said above but also explains alot other thing like channel.xml generation.
Thanks Blackbear. I wish I was as knowledgeable as you with this assembly. Thanks for all your hard work and dedication. It is well appreciated by me.
I just finished reading the info. My config file was old and I am now using a more updated thoroughly written version. The bad news is that everything was running good until this morning. I am receiving the timeout errors again and log indicates same timeouts. I think dtv changed something again within their website.
Thanks
matt8861 will have to look at what changed.
for me its fine here but i see a issue with 3.1 and site compression(i messaged the creator about this).
it works with my version but i get index page only.
Group (0) :
update requested for - 1 - out of - 1 - channels for 1 day(s)
( 1/1 ) DIRECTV.COM -- chan. (xmltv_id=Showtime Showcase HD (SHOCSEHD)) -- mode Force
iinnnnnnnnnnnnnn
0.00 sec/update
Job finished at 02/08/2020 13:05:33 done in 5s
if i go back to 2.1.9 all is fine.
Hello
I have followed the instructions in this thread and it was working last night. This morning I get "ii" then timeouts. I set it to 10 seconds and that was OK yesterday. 180 seconds is too long to wait when you know its going to fail anyway!
Is it just me or is anyone else having problems?
Thanks in advance
-------
Job started at 09/08/2020 14:14:04
Checking License ..
For License request/update data, see WGLicense.log.txt
found: C:\Users\xxxxxx\AppData\Local\WebGrab+Plus\directv.com.ini -- Revision 19
encrypted with userkey and expiry date in 'new (V3)' mode
processing C:\Users\xxxxxx\AppData\Local\WebGrab+Plus\guide.xml ...
Found existing channel (xmltv_id=US CineMAX (East)) in the config file
Found existing channel (xmltv_id=US: CINEMAX (EAST) | HD) in the config file
..................................................
i=index .=same c=change g=gab r=replace n=new
Group (0) :
update requested for - 48 - out of - 48 - channels for 1 day(s)
( 1/48 ) DIRECTV.COM -- chan. (xmltv_id=US CineMAX (East)) -- mode Force
ii
error downloading page: The operation has timed out (10sec)
Retry 1 of 3 times
error downloading page: The operation has timed out (20sec)
Retry 2 of 3 times
.
.
etc
180 is a limit, if wg++ grab in less time... will be less. So setting timeout 180 wg can grab also in 10 seconds if site is fast enough.
Hello mat8861
Yes I was aware of that, I was only using a lower timeout limit because there is no point setting it that high if I know its going to time out anyway. I'll just have to wait longer for it to fail. :(
Is this working for you or is this broken?
Thanks for your help
It definitely works. I had to do 2 recommended things.
1. change timeout to 180
2. use the recommended User Agent (in the post above)
http://webgrabplus.com/documentation/configuration/webgrabconfigxml#conf...
Thanks for your replies.
I am using that User agent. It did work for me originally after changing to that agent, and then stopped. I will investigate further if its working for others.
Cheers
I will say thais, 2 times i had to redownload a cookies TXT file, even when i had it working. Mat8861, Not sure if you know what would cause this.
Hi,
At first i couldn't get it working and this forum thread helped me with the missing parts. I followed the instructions and got the timouts also.
The updated directv.com.ini is in the USA section while in epg channels it is in Networks section. I checked also the others section, but wasn't there so didn't found that until i read here it was in USA section. So maybe create a Networks section in the SiteIni.Pack donaters forum and add it there so ini files are in the same section as stated in the epg channels section of webgrablpus (didn't look further as my nose is long).
The second problem i had was changing the update from i to c in config file. Also got aware of this with the help of this forum thread. So maybe also good to state that in the instructions.txt file. I'm new to webgrabplus and thougt the removing * would enable this. The new directv.com.ini file makes no sense to me so got me thinking how to enable channel list mode which is how i found this thread and figured it out.
Also changed the user agent with the other changes i made above, didn't tested it with the default user agent. Read it wasn't working well so changed that. Maybe also good idea to state this in the instructions.txt file.
Hope that maybe they can add my improvement suggestions, so other may not need this forum thread to figger out the missing parts.
Greetings,
Beloeke
Hi,
Tested it on my pc and was then copying it to my server and it didn't work, got timeouts. Tested it again on my pc and also timeouts. So renewed the cookie file and it was working again. So like stated few posts up the cookie file expires or something.
I'm a newb in programming but wanted to also report my findings for @mat8861 to troubleshoot it and confirm the earlier stated post about the cookies
Many thanx to @mat8861 and all others from webgrabplus for their work.
Well what you said is true, should have been added to siteini.pack but was actually a test that worked, we were suppose to check what was going on (also because changes in wg+ code) we forgot about, sorry. About cookie, that's another weird thing almost like robots, I have my tvtv.us robots read only and works since January, never changed, other users reported the opposite. With cookie that store site data is also a messed story, session and permanent and it's not all, some browsers and antivirus block parts, delete some data to protect privacy etc etc a complete nightmare.For sure if you change zipcode your cookie needs to be updated.
Pages