NFPS xmltv EPG Grabber development

[dara]

I see the issue with the dummy on some of the news 12 on the pvr.stalker, just installed from the git. Weird that its some, but not others.

--

Oops just did a guide reset, and now the dummies don't appear at all. They did with the previous alpha.

[psycon]

yeah unsure why its doing that. probably a syntax issue in the dummy file.. im looking at it now, lemme know if u spot anything.

[dara]

I tested a small dummy with the news channels. The pvr stalker is very sensitive to time end on the dummy program. I'm able to see the program if it's in the current day, and maybe next day, but after 3 days, no. I'm going to see if its sensitive to an early start.

[psycon]

think i found the problem. regenerating the lists now. 10 minutes to go. lol

[dara]

The "Days to Display" does influence what is shown, so a program length that is greater than number, or is outside that time won't be on the current guide. I'm going to try it with a complete dummy, modifying the time start to midnight Pacific (0700 utc) and add three days to that and display to 3 days.

[psycon]

I already have the dummy generator set to modify the dates in the dummy files to only output the next couple days into the resulting file.

[dara]

I just ran the dummyparsed for midnight pacific time for current day to +2 days, and it shows for a "days to display" of 4, and doesn't for 1.

[dara]

I have to fix the dummy on the 4 News 12 so they have the same times as the rest of the dummy, and then sed can figure out what to do! I think the hours in the regex misses those 4 (Long Island, Hudson, New Jersey and Westchester)

[psycon]

its fixed. git updated

[dara]

its fixed. git updated

In the dummy or the go.bat? (Never mind, just saw it! :))

I made some new dummies because some of the channels changed yesterday, but also to make the news12 times consistent with the rest of the dummies. The *.txt ' s have no header, but do have the </tv> footer.

[psycon]

I just fixed the dates in the dummy files so sed.exe parsed them properly..

added your new txts and am regrabbing the lists now

[dara]

OK. I'm up on my local .bat run, (I'm doing the stripping of the headers from the intermediate mc2xml runs, and retaining the xmls, not doing the -f also, and setting up for pacific Midnight on the dummys) but I'll see if I get a good load off the github when its up.

[Juliushell]

Is the guide up on the git already?

[dara]

It's up, but it looks like there may be an issue with the merge of the webgrab and dummy with the mc2xml. The load runs without the webgrab and dummy, at least with the NFPSF. My locally generated guide works, but it does things differently than the .bat that in the github.

[Juliushell]

I see what you mean, i change to only english channels guide and i pop's up very quick and nice, great working with logos and color coded, but the full one is not as you mention.

[psycon]

sorry, went for lunch. did i break something

[Juliushell]

looks like, hehehehehee.....

Edit:

So, seriously, are you gooing to fix it?, not that i try to put pressure on you, i just want to know, not going to use it today, i'm just messing around while i have nothing to do at work, so, you might know how this is.

[psycon]

try reloading... its working fine for me.... use the is.gd links not ipkill

[dara]

NFPSF is working for me from the is.gd.

Deleting those .db's didn't work to get the Stalker to load channels on my android. I'll try it from a fresh start :(

[Juliushell]

I'll give it a try, i was using raw, but it only was showing 8 channels guide.

Edit:

Ok, now raw is working good, so i won't change it, might be that you where uploading when i tried it.

[Juliushell]

Ok, in another matter, i check a couple channels, guide is ok on most of them, even time, but i've found that on channels 967 (Max prime este) & 968 (Max prime oeste) the guide is mixed, 967 is showing what is in 968 and the other way around, so i might be an easy fix for you guys.

[psycon]

yeah thats possible, you probably got it while i was syncing the git.

Ill fx the guide data for those channels now. refresh your DB in about 15 mins.. I assume there weill be some more errors in the spanish channels, your input is appreciated

[Juliushell]

No problem, i'll try to get more issues on latin channels once i get out of work, or have more time at it to do so.

[chippa]

new pvr.stalker released with full support for this xmltv data source. I recommend using it over IPTV simple Client.

psycon, please elaborate....do you mean that I should use the existing stalker video addon (1.0.18) along with the new pvr stalker client instead of the iptv simple client?

[psycon]

no.. pvr.stalker is its own standalone plugin.. it does not require the use of iptv simple client.

[chippa]

Thanks. I tried your new epg url and works great. I believe all the English channels now have info.

[keeganx]

Quick question. For the time zone within pvr.stalker. I have changed to America/Phoenix because I'm from Arizona. The time is still off. Am I putting this information in incorrectly?

[dara]

The timezone doesn't work yet for the PVR stalker. Apparently it grabs your local time, and default timezone, and matches the epg to it. The EPG is set up for utc. Because Arizona doesn't have DST, it may be wrong, so the author needs to build in something to account for that.

[dara]

For the Wisconsin PBS on ch 102 (The Wisconsin Channel - wha-dt2).

[psycon]

can someone using pvr.stalker who has the timezone issue please try one of the new URLS in the OP and let me know if i shifted them the correct way. Your EPG should be correct, or 2 hours out..

[dara]

Latin_tp update to add TeleHitHD (921)

THITHD:TeleHit

[Juliushell]

Ok, an update, channel 950 Film Zone, EPG is 2 hours ahead, if is 16:00 hrs, shows what is going to be at 18:00 hrs, and on 938 Paramount Channel is backwards, it shows what was playing 2 hours ago, 942 Cinemax is 3 hours behind on guide, 944 AMC guide is not for that channel, any of the programs concordate, 953 Fox family 2 hrs ahead on guide, 960 HBO latinoamerica & 961 HBO2 latinoamerica 2 hrs behind, 962 HBO Plus Este guide is not for that channel, that is what i've found until now, later will check some more.

[dara]

Ok, an update, channel 950 Film Zone, EPG is 2 hours ahead, if is 16:00 hrs, shows what is going to be at 18:00 hrs, and on 938 Paramount Channel is backwards, it shows what was playing 2 hours ago, 942 Cinemax is 3 hours behind on guide, 944 AMC guide is not for that channel, any of the programs concordate,

It looks like the listings fop Film Zone are for the Eastern version, vs. the Western version, which is shown.. I'll see if there's a replacement. Probably the same issue with Paramount and Cinemax. AMC is just a guess, it's actually a feed intended for South America/Argentina, but I haven't found a good guide for that (only thing close is Peru), so its probably going to be dummied.

The sources for the latin america are Mexico Total Play, SkyMex, entutele and gato.tv, . Thanks for the feedback.

What could be helpful if you are watching these channels is to report what system that is actually broadcasting them, or the intended market, based on commercial breaks, etc.

[psycon]

added the latin tp and wisc fixes

[dara]

Attached are suggested changes to the go.bat to produce a dummy for each day, vs. one two-day dummy. It uses a command file called datemath, which would go into your bin folder. That command file will correctly calculate the proper dates for the dummy, regardless the end-of-month, year, or leap year. The pre-process_multi.bat is to be integrated into the go.bat before the mc2xml processing. As the dummy.txt to be used has no footer, don't forget to close the complete xml with a footer.

[dara]

Fixes for Euronews (English and German), removing conflicting and empty entry for English on hb13p, and enabling german language listing. (Euronews is on US DISH). Modifying webgrab to deactivate Motors TV and Star Sports, and time corrections reported on spanish channels. Modify latin_tp to get proper listing for FilmZone.

[apun]

Since the new host
http://is.gd/NFPSF

I am having problems with the guide under Live TV. I have tried resetting the EPG database and disabling/Enabling Live TV, Channels load the EPG loads but EPG is only for the PAST 24 Hours, so right now its 1:25 PM EST (My settings are already -4 under EPG settings), The EPG is showing for the last 24 hours and only upto 1PM EST, basically no EPG for current or future programs (I have the EPG set for 3 Days under EPG Settings).

With the ipkill host everything was working smoothly, and I changed the host url to h**p://is.gd/NFPSF[/url] and now no Current or Future EPG, only Past 24 hrs are showing. any help? thanks

[dara]

I think the data is old.

[psycon]

well, someone sure fell asleep at the wheel.. its updated now.

[apun]

well, someone sure fell asleep at the wheel.. its updated now.

thanks its all working now :D

[satmanuk]

how would i use this on a android box?

[big dady]

Just follow the instruction on the first post

[Asskick]

It looks like the listings fop Film Zone are for the Eastern version, vs. the Western version, which is shown.. I'll see if there's a replacement. Probably the same issue with Paramount and Cinemax. AMC is just a guess, it's actually a feed intended for South America/Argentina, but I haven't found a good guide for that (only thing close is Peru), so its probably going to be dummied.

The sources for the latin america are Mexico Total Play, SkyMex, entutele and gato.tv, . Thanks for the feedback.

What could be helpful if you are watching these channels is to report what system that is actually broadcasting them, or the intended market, based on commercial breaks, etc.

Was wondering what grabber u are using for entutele ?? Ive tried looking on the bats but I cant find any reference on how you grab data from it

[psycon]

Radded all the wisc and lat tp fixes.. added dara's new dummy channel setup..

[dara]

Was wondering what grabber u are using for entutele ?? Ive tried looking on the bats but I cant find any reference on how you grab data from it

Webgrabplus is pulling from entutele, which is listed in the configuration file, placed in WebGrabFiles. Here's what it looks like:



<channel update="i" site="entutele.com" site_id="/canal/canal-2" xmltv_id="Canal 2">Mexico 1</channel>
<channel update="i" site="entutele.com" site_id="/canal/canal-5" xmltv_id="Canal 5">Mexico 2</channel>
<channel update="i" site="entutele.com" site_id="/canal/el-trece" xmltv_id="El Trece">Mexico 3</channel>
<channel update="i" site="entutele.com" site_id="/canal/once-tv" xmltv_id="Once TV">Mexico 4</channel>

<channel update="i" site="entutele.com" site_id="/canal/foro-tv" xmltv_id="Foro TV">Mexico 6</channel>
<channel update="i" site="entutele.com" site_id="/canal/azteca-7" xmltv_id="Azteca 7">Mexico 7</channel>
<channel update="i" site="entutele.com" site_id="/canal/teleformula" xmltv_id="TeleFórmula">Mexico 8</channel>
<channel update="i" site="entutele.com" site_id="/canal/proyecto-40" xmltv_id="Proyecto 40">Mexico 9</channel>
<channel update="i" site="entutele.com" site_id="/canal/milenio-tv" xmltv_id="Milenio TV">Mexico 10</channel>



As you see, its for Mexico unnamed channels. Webgrab takes a while to generate, so I was thinking about going back into the Latin_tp (total play) to find those channels there, and putting it through mc2xml. I'd have to find out what the actual channel call signs are though... pain.

[Asskick]

Webgrabplus is pulling from entutele, which is listed in the configuration file, placed in WebGrabFiles. Here's what it looks like:



<channel update="i" site="entutele.com" site_id="/canal/canal-2" xmltv_id="Canal 2">Mexico 1</channel>
<channel update="i" site="entutele.com" site_id="/canal/canal-5" xmltv_id="Canal 5">Mexico 2</channel>
<channel update="i" site="entutele.com" site_id="/canal/el-trece" xmltv_id="El Trece">Mexico 3</channel>
<channel update="i" site="entutele.com" site_id="/canal/once-tv" xmltv_id="Once TV">Mexico 4</channel>

<channel update="i" site="entutele.com" site_id="/canal/foro-tv" xmltv_id="Foro TV">Mexico 6</channel>
<channel update="i" site="entutele.com" site_id="/canal/azteca-7" xmltv_id="Azteca 7">Mexico 7</channel>
<channel update="i" site="entutele.com" site_id="/canal/teleformula" xmltv_id="TeleFórmula">Mexico 8</channel>
<channel update="i" site="entutele.com" site_id="/canal/proyecto-40" xmltv_id="Proyecto 40">Mexico 9</channel>
<channel update="i" site="entutele.com" site_id="/canal/milenio-tv" xmltv_id="Milenio TV">Mexico 10</channel>



As you see, its for Mexico unnamed channels. Webgrab takes a while to generate, so I was thinking about going back into the Latin_tp (total play) to find those channels there, and putting it through mc2xml. I'd have to find out what the actual channel call signs are though... pain.


Great thanks!

Let me load your guide data on my kodi setup, and onces i see which are missing ill help you out with the mexican channels lineup to grab the correct epg id for each channel

I needed some EPG data from Cabelmas that was on entutele, but didnt knew webgrabberplus already had a parser for it :)

And btw scheduledirect has international data too, however it requires anual fee (25 bux or so) and it would just let you add 5 lineups, however they do carry some international lineups. All these are served via a JSON api

[Blackbear199]

when i run this myself the first time.i get a popup from mc2xml asking for location and provider.get it on the first request when it starts to get epg from Microsoft(forget the name) and for hotbird premium.wasnt sure what to select so I guessed.guide looks fine but wasn't getting it before this latest release.after that it runs without stopping.

[dara]

when i run this myself the first time.i get a popup from mc2xml asking for location and provider.get it on the first request when it starts to get epg from Microsoft(forget the name) and for hotbird premium.wasnt sure what to select so I guessed.guide looks fine but wasn't getting it before this latest release.after that it runs without stopping.

The reason you are getting that "popup"... actually the gui for the mc2xml, is that you were missing the .dat file the batch command is expecting. I don't know if its that much of a difference going forward because the .dat has been generated, it is important though if you are not 'forcing' an update, and want to run the batch to just pull new records, and not get the annoying 'ding' for the pull.

[dara]

On the Mexican OTA channels... I looked on the skymex site and found something that help to match channels from a xml to actual channels


http://www.sky.com.mx/sky/paquetes-residenciales

If someone wants, they can submit an update to the latin_skymex .ren and .chl, so we can make the pull more efficient! ... (I could do it... just maybe someone else can! LOL)

[psycon]

had t remove the new dummy channel setup for now.. it broke the EPG for IPTV simple client users.

[dara]

It worked for me on the PVR simple set up, but that's a local file (mine is now about 27 meg). It could be that the dummy channels themselves are just duplicates, but maybe remotely the guide loader is choking. Did you remove the footer from the current dummy.txt?

[kizer8]

My guide is empty today with Kodi 15.0 and stalker 0.80 to is.gd website...Worked fine yesterday, did anything change?

[wickedjoker]

Yeah mine is down also already tried resetting the cache.

[Blackbear199]

when your wondering about it check

https://github.com/psyc0n/NFPS-EPG-Grabber

you will see the nfpse.xml,ect files listed,i just looked and it was last updated 2 days ago so that's your problem.why don't you download it as per 1st post and run it locally on your pc like I do.just point your epg link to your locally generated nfpse.xml(or whichever one you use) instead of the id.gd link.that way I don't rely on someone else to keep my epg updated.

[kizer8]

when your wondering about it check

https://github.com/psyc0n/NFPS-EPG-Grabber

you will see the nfpse.xml,ect files listed,i just looked and it was last updated 2 days ago so that's your problem.why don't you download it as per 1st post and run it locally on your pc like I do.just point your epg link to your locally generated nfpse.xml(or whichever one you use) instead of the id.gd link.that way I don't rely on someone else to keep my epg updated.

I downloaded grabber and ran go.bat and created an NFPSE.xml. Reset PVR and EPG databases, restarted Kodi and I then pointed my stalker PVR client to the local NFPSE.xml, but EPG guide is still blank.. Anyone know why or how to fix?

[Blackbear199]

what I do is disable live tv.then reset pvr and epg database.then enable live tv again.if that don't work disable live tv,reset both databases.restart then enable live tv usually works.when u select local link did u go righ to the nfpse.xml and select it and not just the folder.also check the date on your nfpse.xml(or whatever one you use) after u run go.bat and make sure its been updated.

also did u download the mc2xml and put it in bin folder?
also the webgrab files need to be unzipped and put in programdata.

[1iwilly]

i'm having the same problem when you say bin folder in kodi.??what location


what I do is disable live tv.then reset pvr and epg database.then enable live tv again.if that don't work disable live tv,reset both databases.restart then enable live tv usually works.when u select local link did u go righ to the nfpse.xml and select it and not just the folder.also check the date on your nfpse.xml(or whatever one you use) after u run go.bat and make sure its been updated.

also did u download the mc2xml and put it in bin folder?

[Blackbear199]

in nfps web grab folder you downloaded. I think it will download it if u don't but I downloaded it myself and put it there.
this is in go.bat


If exist mc2xml.exe goto 2
cls
Echo downloading mc2xml
echo
wget --content-disposition http://originaldll.com/download/40275.exe
:2
if exist mc2xml.exe goto 3
cls
echo Problem getting mc2xml. Go to http://mc2xml.awardspace.info/ and download it and pace it in the bin folder.
goto end

[kizer8]

what I do is disable live tv.then reset pvr and epg database.then enable live tv again.if that don't work disable live tv,reset both databases.restart then enable live tv usually works.when u select local link did u go righ to the nfpse.xml and select it and not just the folder.also check the date on your nfpse.xml(or whatever one you use) after u run go.bat and make sure its been updated.

also did u download the mc2xml and put it in bin folder?
also the webgrab files need to be unzipped and put in programdata.

Thx did all you suggested, but still an empty guide on both my g-box Q android tv and kodi running on windows 7 PC.

[Blackbear199]

disable live tv,reset databases(both).exit kodi.
goto C:\Users\***YOUR USERNAMe**\AppData\Roaming\Kodi\userdata\Database
delete any tv and epg .db files
start kodi,enable live tv


***to see appdata folder u need to have show hidden folder enabled.
under view in file explorer select hidden items

[kizer8]

disable live tv,reset databases(both).exit kodi.
goto C:\Users\***YOUR USERNAMe**\AppData\Roaming\Kodi\userdata\Database
delete any tv and epg .db files
start kodi,enable live tv


***to see appdata folder u need to have show hidden folder enabled.
under view in file explorer select hidden items

Thx for the suggestion, but sorry still no EPG guide.. This happened a few days ago also and psycon had to fix something with the dummy files for the guide in the is.gd URL

EDIT: I disabled stalker PVR client and tried the simple PVR client integration with stalker video addon and it also will not load the guide using local or is.gd URL

[Blackbear199]

oh ok.i still use the version with the dummy files.that could explain it.sec I upload it somewhere.

here version with the dummy files.has mc2xml already in bin folder.updated epg today so for a quick check purge databases n epg shud b there.

https://www.sendspace.com/file/xzeb8x

this with stalker client kodi 15 and works fine for me.

[1iwilly]

same issue here i even tried a different zip code diff carrier and it still loads what i had from the start

[dara]

FYI, it looks like psycon is doing some work on github from about 3 hrs ago, so if you downloaded the files during that time, it looks like the guides won't work, probably missing the dummy.txt. There's enough info on this thread to figure out where to get missing stuff, but maybe its a good time to wait until psycon says things are stable.

[kizer8]

FYI, it looks like psycon is doing some work on github from about 3 hrs ago, so if you downloaded the files during that time, it looks like the guides won't work, probably missing the dummy.txt. There's enough info on this thread to figure out where to get missing stuff, but maybe its a good time to wait until psycon says things are stable.

Thx Dara for the update, but why doesn't the is.gd URL work either?

[Blackbear199]

cuz it redirects to the git hub nfps.xml files.just looked again and says updated 4 hrs ago.have u tried lately?

[kizer8]

cuz it redirects to the git hub nfps.xml files.just looked again and says updated 4 hrs ago.have u tried lately?

Just tried 5 min ago with no go.

[dara]

I know for sure that the NFPSE is not valid, but I didn't check the others yet. NFPSF isn't either... both missing the footer "</tv>"

The fix is to create a simple text file, named dummy.ftr with the following code:



</tv>


and put that file into the bin folder, then run everything again.

[Blackbear199]

dunno then.all I can say if guide works here.freezing bad tonight and a lot channels not working.keep trying all I can suggest.

[jpetrone]

EPG wasn't working for me either. I saved the XML from Github and then added the </tv> like Dara said and saved it locally. Then changed the xml source from the url which redirects to github to the file saved locally and now I have the EPG working, but obviously it's static and won't update. So I guess this is good for something temporary.

[crawlers1977]

for those members that are not getting the guides to run when pointing the NFPSS.XML file to your local pc dont run go.bat delete the wg_guide.xml file out of TEMP folder or all your doing is running a updated version of the xml file thats already created

[1iwilly]

for those like me that need a working guide for now this is working just tested it=hxxx://tecbox.tv/repo/teciptvguide/stalker.xml

[littlepr]

for those members that are not getting the guides to run when pointing the NFPSS.XML file to your local pc dont run go.bat delete the wg_guide.xml file out of TEMP folder or all your doing is running a updated version of the xml file thats already created

crawlers1977,

Can you tell me what is causing this failure?

635

[Blackbear199]

too small for me to read,can you manually type the error or part of it.

[skyhigh]

I was having errors with it to, I think it might have to do with webgrab wanting to be extracted to C-Program Data, but I have no directory with that name, I have C-Program files? but it wont extract webgrab there, just gives errors...so when you run the GO Batch it works for a while but then errors out when it gets to the webgrab part

636

637

[Blackbear199]

goto your c: drive.under view at top of windows select hidden items.the programdata folder should show.

[skyhigh]

goto your c: drive.under view at top of windows select hidden items.the programdata folder should show.

no go on windows vista, no such setting under views in C:

[Blackbear199]

http://www.tech-recipes.com/rx/1521/how_to_view_hidden_and_system_files_and_folders_in _vista/

ok vista bit diff.use 8.1 here

[skyhigh]

I may try it on my window 7 machine, but im not all that worried about it really, just need psycon to re run the batch and link the file in the github and all will be well lol

[littlepr]

too small for me to read,can you manually type the error or part of it.


job finished .. done in 425 seconds
C:\Windows\Temp\WG_guide.xml
Access is denied.
0 file(s) copied.
Utilty to correct offset start and stop times in xmltv files
Jan van Straaten, Januari 2011
Could not find file 'C:\Users\Alex\Desktop\NFPS-EPG-Grabber-master\bin\wg_guide.xml'.

file wg_guide.xml + not found or corrupt
press any key to continue

Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of an object.
at xmltv_time_correct.Program.Main(String[] args)

638

[Blackbear199]

C:\Windows\Temp\WG_guide.xml
Access is denied.

u have admin rights? did u run go.bat as admin?

[skyhigh]

http://www.tech-recipes.com/rx/1521/how_to_view_hidden_and_system_files_and_folders_in _vista/

ok vista bit diff.use 8.1 here

Hey thanks blackbear, that worked see here

639

and it running

640

[littlepr]

C:\Windows\Temp\WG_guide.xml
Access is denied.

u have admin rights? did u run go.bat as admin?

Weird...I am an admin. Le me log out and back in to see if that helps.

[skyhigh]

job finished .. done in 425 seconds
C:\Windows\Temp\WG_guide.xml
Access is denied.
0 file(s) copied.
Utilty to correct offset start and stop times in xmltv files
Jan van Straaten, Januari 2011
Could not find file 'C:\Users\Alex\Desktop\NFPS-EPG-Grabber-master\bin\wg_guide.xml'.

file wg_guide.xml + not found or corrupt
press any key to continue

Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of an object.
at xmltv_time_correct.Program.Main(String[] args)

638

Yes, after letting the program run I get this exact error to, using windows vista and windows 7 ?..it will still keep running after you close the error out and create the xml guide file but why the error?

[kizer8]

Is the is.gd URL still being worked on to be fixed?

[dara]

Is the is.gd URL still being worked on to be fixed?

Currently doesn't work, as they are missing </tv> on the end of the files (dummy.ftr wasn't added to the bin folder). You can download them to your local machine, add that footer, and then link to that file locally.

I've attached a dummy.ftr in the zip.

[dara]

For those who are having trouble with permissions in getting into your Windows/temp directory for the wg_guide.xml, you can change the location where the webgrab puts the output file in the "WebGrab++.config.xml" which is in the WebGrab files location, and then modify the go.bat to locate that file to copy into the bin folder. Also, don't forget that you need a dummy.ftr file with "</tv>" in it.

Here's the thing about WebGrab...the way that psycon has it configured, it does take some time to run that portion of the batch. It does get some channels that are missed by the mc2xml grab, but its really insignificant (about 10 english language, 24 spanish language). If you are comfortable with basic programming, modify the go.bat to ignore the processing of the wg_guide.xml by putting 'rem' in front of those lines that have anything to do with WebGrab. I don't want to post a modified batch file here, as its not our intent to teach how to do this.

[littlepr]

For those who are having trouble with permissions in getting into your Windows/temp directory for the wg_guide.xml, you can change the location where the webgrab puts the output file in the "WebGrab++.config.xml" which is in the WebGrab files location, and then modify the go.bat to locate that file to copy into the bin folder. Also, don't forget that you need a dummy.ftr file with "</tv>" in it.

Here's the thing about WebGrab...the way that psycon has it configured, it does take some time to run that portion of the batch. It does get some channels that are missed by the mc2xml grab, but its really insignificant (about 10 english language, 24 spanish language). If you are comfortable with basic programming, modify the go.bat to ignore the processing of the wg_guide.xml by putting 'rem' in front of those lines that have anything to do with WebGrab. I don't want to post a modified batch file here, as its not our intent to teach how to do this.



Dara,

Are you saying we need this dummy.ftr file before running the grab? Where does the dummy.ftr need to go? in the bin folder?

Oops! Ignore... I just saw you mentioned it above.

[dara]

Dara,

Are you saying we need this dummy.ftr file before running the grab? Where does the dummy.ftr need to go? in the bin folder?

Yes, if you want a valid guide. I posted it in #336.

[littlepr]

Dara,

How do I get the skin to work? I was able to create a working NFPSF.xml but the nice colors are not loading. I assume I have to do something with the skin.eminence.ColorEPG.zip, correct?

[Blackbear199]

not need.least for me using default confluence.if you did the skin mod for colors in epg you need to change it back to stock.thats what I had to do and have colors.pyson posted it here somewhere that no mods are needed anymore.

and u need to use stalker client.pvr simple will have no colors and needs skin mod.

[kizer8]

Currently doesn't work, as they are missing </tv> on the end of the files (dummy.ftr wasn't added to the bin folder). You can download them to your local machine, add that footer, and then link to that file locally.

I've attached a dummy.ftr in the zip.

Thx Dara. Using this zip I was able to generate my own working EPG guide with a local xml.

[dara]

Dara,

How do I get the skin to work? I was able to create a working NFPSF.xml but the nice colors are not loading. I assume I have to do something with the skin.eminence.ColorEPG.zip, correct?

I don't mess with alternative skins, but if you are using the 15.0 beta, the colors only work with Confluence skins, as far as know.

[skyhigh]

For those who are having trouble with permissions in getting into your Windows/temp directory for the wg_guide.xml, you can change the location where the webgrab puts the output file in the "WebGrab++.config.xml" which is in the WebGrab files location, and then modify the go.bat to locate that file to copy into the bin folder. Also, don't forget that you need a dummy.ftr file with "</tv>" in it.

Here's the thing about WebGrab...the way that psycon has it configured, it does take some time to run that portion of the batch. It does get some channels that are missed by the mc2xml grab, but its really insignificant (about 10 english language, 24 spanish language). If you are comfortable with basic programming, modify the go.bat to ignore the processing of the wg_guide.xml by putting 'rem' in front of those lines that have anything to do with WebGrab. I don't want to post a modified batch file here, as its not our intent to teach how to do this.

Thank you sir, I edited the xml and bat and pointed to a location of my choice and works good now..

[psycon]

sorry everyone.. power supply on my machine went, and the beach was calling my name.. anyways just fixed it. will update everything momentarily.

[danlevin]

sorry everyone.. power supply on my machine went, and the beach was calling my name.. anyways just fixed it. will update everything momentarily.

thanks, can you explain how to add logos for those who uses only the computer ?

[dara]

Updated dummy files, including CNBC Africa, and name changes. I will be submitting an updated DTV, Skymex and webgrab configuration later, as a heads up. The dummy.body have no headers and footers, the .xml's have them though, for testing.

[psycon]

updated the scripts on my end.. the is.gd links are now autogenerating and do not require my actions anymore. so short of a system failure, guide should always be up now.

[dara]

I'll have to update the dummy again for the mexican channels... trying to see if there are guides for 3 updated channels.

[dara]

Here are updates for latin_skymex, DTV, and webgrab files. Dummy updated for Mexico renames as well. I took the unnamed mexican channels, and put the ones available into the DTV grab, and added CNBC World onto DTV, and updated the webgrab configs to remove unused channels. I also moved up the display of the RT Documentary with a time shift... as that channel listing doesn't change, I probably will make it a dummy as well, later.

[jpetrone]

Who did the descriptions for the "adult" channels? I was laughing going down the list reading the descriptions.

[dara]

Who did the descriptions for the "adult" channels? I was laughing going down the list reading the descriptions.

Credit goes to DualTest.

[dara]

I'm having trouble connecting to the server using 0.8, using my PC. To check I was ok using the PVR Simple w/ IPTV Stalker, and after uninstalling 0.8, and using the rolled back 0.7, was able to connect. Tried a reinstall of 0.8, still can't connect to the server. I'll try clearing things out some more, and maybe it will connect.

[littlepr]

psycon,

Which http://is.gd/XXXXX is supposed to be working? I'm not getting anywhere with http://is.gd/NFPSF which is the one I have always used other than iVue's guide Stalker .xml.

[dara]

I'm having trouble connecting to the server using 0.8, using my PC. To check I was ok using the PVR Simple w/ IPTV Stalker, and after uninstalling 0.8, and using the rolled back 0.7, was able to connect. Tried a reinstall of 0.8, still can't connect to the server. I'll try clearing things out some more, and maybe it will connect.

Looks like there's issues with connecting with everything except IPTV Staker (and the PVR Simple client integration).

[psycon]

added latest fixes by dara..
Fixed the a couple errors made in previous updates.. dummys now working properly..

update: more fixes added.. you should probably purge your databases.

[keddy]

To get epg for Romanian channels you could use WebGrabb like this:



Romania 1:<channel update="i" site="port.ro" site_id="10282" xmltv_id="Digi 24">Digi 24</channel>
Romania 3:<channel update="i" site="port.ro" site_id="10309" xmltv_id="Digi 24 Constanţa">Digi 24 Constanţa</channel>
Romania 4:<channel update="i" site="port.ro" site_id="10308" xmltv_id="Digi 24 Craiova">Digi 24 Craiova</channel>
Romania 5:<channel update="i" site="port.ro" site_id="10095" xmltv_id="Digi 24 Timişoara">Digi 24 Timişoara</channel>
Romania 6:<channel update="i" site="port.ro" site_id="10305" xmltv_id="Digi 24 Oradea">Digi 24 Oradea</channel>

[reege9582]

What do I put for the Mac and Ip address I am having trouble connecting to the server?

0.8 wont load up it gives a error message?

0.6 does load up but when i try it says ....Stalker Client unable to load channel?

[DarkSide]

What do I put for the Mac and Ip address I am having trouble connecting to the server?

0.8 wont load up it gives a error message?

0.6 does load up but when i try it says ....Stalker Client unable to load channel?

your mac should start with 00:1A:79: then you can use the last 6 of your device or make up your own... if using android there is a link in post one for you

[jpetrone]

Hey does anyone know why on the EPG on the top left where the date is, it only shows me the day of the month and the year? The month isn't there.

Thanks
Jordan

654

Edit/update - it's a bug in beta1 isengard. Updating to the latest nightly, fixes the issue.

[psycon]

because whoever made the skin you are using made it that way..

[jpetrone]

because whoever made the skin you are using made it that way..

Hmm.. It's the default kodi skin.

[psycon]

still.. thats a skin issue, nothing to do with the plugins or server.. if it bothers you you could start a thread on the official kodi forum perhaps.

[skyhigh]

Hey does anyone know why on the EPG on the top left where the date is, it only shows me the day of the month and the year? The month isn't there.

Thanks
Jordan

654


Change the skin your using because I dont have that issue with the skin I use..

655

[jpetrone]

Change the skin your using because I dont have that issue with the skin I use..

655

Yea thanks, it was a bug in beta1 for isengard. I installed a nightly version and no longer an issue.

Thanks

[apun]

Change the skin your using because I dont have that issue with the skin I use..

655


hey which skin are you using? and the TV logo pack, tnx

[dara]

Updated dummy files, for new additions and channel name changes...

[kizer8]

Updated dummy files, for new additions and channel name changes...

Thx Dara.. Where do these updated files go?

[dara]

If you are using the psycon script without modification, the *.body files would go into the bin folder. You will have to rename "dummy_eng.body" to "dummyeng.body" though. I try to make it as easy as possible for him to drop the files to where they go, but I didn't check the english dummy.

If you see files from me, they just usually go into the bin folder, with the exception of the WebGrab++.config.xml, which goes into C:/ProgramData/ServerCare/WebGrab folder.

[kizer8]

If you are using the psycon script without modification, the *.body files would go into the bin folder. You will have to rename "dummy_eng.body" to "dummyeng.body" though. I try to make it as easy as possible for him to drop the files to where they go, but I didn't check the english dummy.

If you see files from me, they just usually go into the bin folder, with the exception of the WebGrab++.config.xml, which goes into C:/ProgramData/ServerCare/WebGrab folder.

Dara, yes I am using his script... Do both dummy_eng.body and dummy_eng.xml need the _ chopped off before moving to bin folder?

[psycon]

gidhub upated with daras dummy fix.


kizer - u only need the .body files.. and yeah just remove the _

[kizer8]

gidhub upated with daras dummy fix.


kizer - u only need the .body files.. and yeah just remove the _

Thank you.

[skyhigh]

hey which skin are you using? and the TV logo pack, tnx


I dont want to hijack this fine thread so I posted some info for you in its own thread here, now lets keep this one on topic thanks..

http://iptvtalk.net/showthread.php?4416-CCM-For-Helix-Skin&p=34745#post34745

[dara]

Update for UK channels, and dummies. (added dmax, alibi and itv be, and corrections for peru. BBC Three and BBC Four already in the UK chl and didn't need a rename.).

[dara]

Update for UK channels to get 4 Seven. Also time correct for Webgrabplus to correctly sync Astro Supersport. For some reason, Astro doesn't have listings for live events, so if you see a blank spot in the guide, it means that there is some live event going on, but it made it hard to figure out where the guide actually was.

[Madman_X]

I've been able to get the batch file installed and it worked to generate a xml EPG; however, I think the time zone is off a bit. I noticed that the go.bat file contains a section that refers to Pacific Time (snip below). I'm comfortable editing the batch file as needed to set it to Eastern Time. Does anyone know which part to change?

rem setting time for Midnight, Pacific Daylight Time

sed.exe -e "s/20150513213/%Yr%%Mth%%Day%070/g" dummy1.txt > dummy1_1.txt
sed.exe -e "s/2016051322/%Day1%07/g" dummy1_1.txt > dummy1_conv.txt

sed.exe -e "s/20150513213/%Day1%070/g" dummy2.txt > dummy2_1.txt
sed.exe -e "s/2016051322/%Day2%07/g" dummy2_1.txt > dummy2_conv.txt

sed.exe -e "s/20150513213/%Day2%070/g" dummy3.txt > dummy3_1.txt
sed.exe -e "s/2016051322/%Day3%07/g" dummy3_1.txt > dummy3_conv.txt

Thanks,

MMx

[dara]

That code only changes the dummy listings to start at midnight Pacific for the current day, not the rest of the schedule, otherwise the dummy listings wouldn't show at all. To adjust the time shift, look for the code that changes the time zone from UTC "+0000":



line 357
sed.exe -e "s/+0000/-0100/g" < "NFPSF.xml" > "NFPSFD.xml"

line 441
sed.exe -e "s/+0000/-0100/g" < "NFPSE.xml" > "NFPSED.xml"


This code doesn't change the webgrab channel schedules though, as those aren't originally set for UTC. Change the "-0100" to "-0200"

[Madman_X]

That code only changes the dummy listings to start at midnight Pacific for the current day, not the rest of the schedule, otherwise the dummy listings wouldn't show at all. To adjust the time shift, look for the code that changes the time zone from UTC "+0000":



line 357
sed.exe -e "s/+0000/-0100/g" < "NFPSF.xml" > "NFPSFD.xml"

line 441
sed.exe -e "s/+0000/-0100/g" < "NFPSE.xml" > "NFPSED.xml"


This code doesn't change the webgrab channel schedules though, as those aren't originally set for UTC. Change the "-0100" to "-0200"

Thanks Dara... it seemed to be working fine again, so who knows? I kept looking at the pvr stalker addon to see if there was a time shift option within, but didn't see it. There is a time zone setting, but had read somewhere to leave it set as is. I did read through some earlier threads that warned users that they were on their own if they edit the batch file, so now that it's working, I'll just leave well enough alone for now.

Thanks,

Mmx

[dara]

Updates for added and changed dummy and US channels. Special thanks for thegame16 for the updates to the channel list... especially like the specified updates over on the other site.

[psycon]

added 6 18 and 628 updates to the git.. thanks guys.

[loschg]

Does any one know if there is a PHP version that will do the Same thing?

Gary

[dara]

There is none, but why?

[loschg]

So I Can run it on my Web servers and to automate it..

[dara]

The grabber is simply a batch command script, but all you really need to do is set up something that copies the data from the links at is.gd (or from the github), and re-link it from your server. The data is generated daily, and it won't really help to do this more often as the sources aren't updated more than daily.

[dara]

Update for new US channels, and Teletica. I'm trying to figure out why 5 Star Max doesn't show up.

[psycon]

added dara's update to the git.

This has been added to NFPS server itself now (minus the dummies) so Mag devices and STB emulator should have a more complete guide now..
Using the XML will ensure Kodi Color codes the shows by genre, make sure you have set pvr.stalker to "XMLTV preferred"..

[crawlers1977]

very nice work as always guys still looks the bees knees

[Blackbear199]

fyi guide data hasn't been updated in 2 days on git.

[dara]

psycon needs to kick his box! LOL. I know its probably lots easier to use the link, but 'rolling your own' isn't that hard, and you can customize what you want to show up on the guide.

[Blackbear199]

ya I do run my own.just happened to check the git for any changes and noticed it.
thought i'd give a heads up b4 the I got no epg posting starts.

[fastrick]

Update for new US channels, and Teletica. I'm trying to figure out why 5 Star Max doesn't show up.

How does this work on a mag254?

[dara]

How does this work on a mag254?

It won't. This xmltv is meant for the PVR addons for Kodi.

[thenextman]

thanks to everyone involved in developing and maintaining this impressive EPG solution including Psycon, Dara and DualTest etc., and for their help and guidance in using it

[Blackbear199]

git showing guide data last update 2 days ago again.

[speighty1]

git showing guide data last update 2 days ago again.

Is that the reason why I have no guide at the moment.

Channels are loading but the guide is empty, I have tried clearing the guide data which hasn't helped.

If I go back a bit on the guide it seems to have stopped early this morning, no guide after around 6am.

[dara]

Psycon runs the batch automatically from a virtual machine, so yeah, if github isn't current, you'll run out of data.

[dara]

If you are noticing missing data for US based channels, you aren't alone. I ran my local grabber and the US portion of the batch, but no program data is being pulled from the source, however channel info is. Hopefully it isn't a long term problem, but there are other options to get that data... it may take some time though.

[Panita]

Hi!
I'm using a local batch, I would like to know if there an option that i can set how many days of epg data i want to. dara is right many channel from US only get data on channel info. I noticed that when I run go.bat let's say that i get 20MB if i run again in 2 days, then i get only 15MB. i wonder why this behaviors?

[dara]

You just have to edit the number after "-d" to how many hours of schedule you want to pull on the lines calling mc2xml.

[speighty1]

Hi guys, just wondered if anyone else is having issues with the guide, mine is currently only showing 4 channels, I can still watch the other channels just with no guide.

[Takenover83]

Yes currently guide is not pulling for many channels, such as the hbo's, showtimes, etc...

[Blackbear199]

hi Dar,

I thought the same was going on so I did a cmd line pull on dish sat and can see data for ex 300 HBO.
I dunno why grabber aint workin.



<channel id="I300.28458538.microsoft.com">
<display-name>HBO</display-name>
<display-name>300 HBO</display-name>
<display-name>300</display-name>



<programme start="20150712220000 -0300" stop="20150712230000 -0300" channel="I300.28458538.microsoft.com">
<title lang="en">True Detective</title>
<sub-title lang="en">Down Will Come</sub-title>
<desc lang="en">The detail works a pawn shop lead to close in on a suspect in the Caspere case; Frank revisits his past.</desc>
<credits>
<actor>Colin Farrell</actor>
<actor>Vince Vaughn</actor>
<actor>Rachel McAdams</actor>
<actor>Taylor Kitsch</actor>
<actor>Kelly Reilly</actor>
<actor>Christopher James Baker</actor>
<actor>Afemo Omilami</actor>
<actor>Chris Kerson</actor>
<actor>James Frain</actor>
</credits>
<date>20150712</date>
<category lang="en">Drama</category>
<category lang="en">Episodic</category>
<category lang="en">Series</category>
<episode-num system="onscreen">12</episode-num>
<episode-num system="ms_progid">1.EP018142250013</episode-num>
<episode-num system="dd_progid">EP01814225.0013</episode-num>
<audio>
<stereo>stereo</stereo>
</audio>
<new />
<subtitles type="teletext" />
<rating system="VCHIP">
<value>TV-MA</value>
</rating>
<rating system="advisory">
<value>Adult Situations</value>
</rating>
<rating system="advisory">
<value>Language</value>
</rating>
<rating system="advisory">
<value>Violence</value>
</rating>
</programme>
<programme start="20150712230000 -0300" stop="20150712233000 -0300" channel="I300.28458538.microsoft.com">
<title lang="en">Ballers</title>
<sub-title lang="en">Heads Will Roll</sub-title>
<desc lang="en">Spencer visits a neurologist; Charles is pursued by a woman; Joe breaks the rules to get a client; Ricky finds himself a mantra; Reggie tries to hijack Vernon's renegotiation.</desc>
<credits>
<actor>Dwayne Johnson</actor>
<actor>Rob Corddry</actor>
<actor>Omar Benson Miller</actor>
<actor>John David Washington</actor>
<actor>Donovan Carter</actor>
<actor>Troy Garity</actor>
<actor>Jazmyn Simon</actor>
<actor>Arielle Kebbel</actor>
</credits>
<date>20150712</date>
<category lang="en">Comedy</category>
<category lang="en">Episodic</category>
<category lang="en">Series</category>
<episode-num system="onscreen">04</episode-num>
<episode-num system="ms_progid">1.EP021656140004</episode-num>
<episode-num system="dd_progid">EP02165614.0004</episode-num>
<audio>
<stereo>stereo</stereo>
</audio>
<new />
<subtitles type="teletext" />
<rating system="VCHIP">
<value>TV-MA</value>
</rating>
</programme>


compared channel names in .ren file and looks good.

[dara]

It will pull data from the past, but there isn't anything from July 24 going forward. There's nothing wrong with the grabber, its the source.

[dara]

Did some research and there was a big change in the sourcing for the data:



http://www.avsforum.com/forum/26-home-theater-computers/2058850-big-wmc-guide-changes-starting-today.html


We might not have data for a while.

[Blackbear199]

hi Dara,Pyscon

I was able to get most data back by switching the ones that were not pulling any data from Microsoft to schedule direct.
get a 7 day trail for signing up.only problem with that is schedule direct only allows up to add 4 pulls,i needed 1 more to get all the missing ones.
got data for all the channels I watch so works for me.

[Blackbear199]

I also seen zap2xml which is free.it would be more work to setup,basically start from scratch creating your list where schedule direct can be pulled with mc2xml and use the .chl and .ren files already created.

[Takenover83]

@Blackbear199, what providers/zips did you use for schedulesdirect?
Sorry for going off topic, but trying to get my own guide going till things smooth over.

I used DISH for most of the US channels but I have no clue what to use for the UK ones.

[Blackbear199]

don't edit the uk ones in the go.bat file.leave them as is and it will pull data from Microsoft.
here's ones I edited


Echo Loading PBS
mc2xml -I dummyparsed.xml -C wisc.chl -R wisc.ren -o wisc.xml -D wisc.dat -F -s -2 -u -a -T user:pass

Echo Loading Canadian Lineup
mc2xml -I wisc.xml -R ca.ren -o ca.xml -D ca.dat -F -s -5 -C ca.chl -u -a -T user:pass

Echo Loading DTV
mc2xml -R dtv.ren -o dtv.xml -D dtv.dat -I ca.xml -F -C dtv.chl -s -5 -u -a -T user:pass

Echo Loading US
mc2xml -R us.ren -I mia.xml -o US.xml -D US.dat -F -C US.chl -s -5 -u -a -T user:pass

replace user:pass with ur schedule direct info
delete or rename the .dat files in the bin folder for the above

in your schedule direct account,click add lineup.here are the ones I use,enter the zip/postalcode and the go by the description to find the right one.

T5J 2B2 Edmonton, CA TELUS Optik TV - Digital CableDigital <-----ca.dat
10001 USA, US DISH Network - Satellite Satellite <--------us.dat
10000 USA, US DIRECTV - Satellite Satellite <---------dtv.dat
53532 Madison, US Charter Communications - Digital <-------wisc.dat

when u run it first time u will get a popup for each of the above from mc2xml,just select ok,all the settings are already there.it will save the new .dat file.after that it will run through without asking anymore.

[Blackbear199]

also I only edited the English section as I only use NFPSE.xml

while reading on mc2xml they have this posted on their site.the changes only affect north America data,thats why uk,Ireland,ect will still update pulling from Microsoft.



Microsoft has switched their EPG provider for their North American listings from Zap2It to Rovi and have not updated their legacy service (listings run out on 7/26). It is not known if this is temporary or not. The service continues to update listings for other countries.

[dara]

hi Dara,Pyscon

I was able to get most data back by switching the ones that were not pulling any data from Microsoft to schedule direct.
get a 7 day trail for signing up.only problem with that is schedule direct only allows up to add 4 pulls,i needed 1 more to get all the missing ones.
got data for all the channels I watch so works for me.

Yeah, aware about them, but still trying to figure out a non-subscription way of doing this. zap2xml probably won't work as you can't easily change the channel names to match to those of the server. I'm going to run a test of webgrab++, configured many of the US channels through there, but I know it will take forever to run it... we'll see how long.

[Blackbear199]

I forgot to mention that schedule direct by default give 7 day epg,I changed the other lines to match that pull from Microsoft.
in the mc2xml line you will see -d 48,add that to the above edited lines if u want it to only get the same amount of data from schedule direct.
-d 48 means 48 hrs.

[dara]

This is a quick fix... don't bust me up if it doesn't work! LOL.

Attached is a updated Webgrab config file with as many of the US channels that I could currently find. They are from tvguide, but they don't like their epg from getting grabbed, so be aware of this... don't run this every day. The additional channels will make this webgrab run for about an hour. I didn't check to see if the programs need to be time corrected completely, but apparently they do match up.

I don't expect this to make the is.gd right away , unless psycon sees it. This is for you who roll your own!

Hint ... bypass the generation of US data by the mc2xml grabber... if you don't, those channel assignments will overwrite the webgrabed schedules.

[big dady]

don't bust me up if it doesn't work! LOL.



Come on just a little LOL

[psycon]

Thanks Dara, but, i hate webgrab. lol so damn slow.. i just switched the mc2xml US pull to grab from schedules direct instead of microsoft legacy.. may have a handful less channels but is updating the git now. if someone wants to be a gent and donate an account for schedules direct that would be super.. its $6 for 2 months, or $25 for a year. otherwise my free trial ends in a week.

[Takenover83]

List of English channels that currently do not have EPG data.

5 ABC Miami
7 NBC MIami
8 Fox Miami
121 H2 USA
196 Travel
207 CNBC World
211 BBC World News
245 Ovation
314 StarMax
316 ThrillerMax East
324 Showtime Next
408 MSG
418 Astro SuperSport
419 Astro SuperSport 2
420 Astro SuperSport 3
421 Yes Network

[psycon]

added blackbear199's update.. thanks you..

also you dont really need to modify the script once the .dat files from a scheduled direct pull have been put in your bin folder, it will use the credentials whatever login was used to create the dat files.. (meaning you may want to remove that attachment if you care,, i dont really care and will be sharing the dat files once I/someone pays for an account)

looks like we may need more than one schedules direct account, likely just 2, to get all the US/Canada channels... still looking for donators for that..

[Blackbear199]

Here's a heavily modified version of Pyscon's and all others who contributed grabber.Thanks You.
Its a English only pull.
I removed things like the 20 or so music channels,adult 1,2,3,ect,sports 1,2,3,ect.from start to the few sport channels under sky movies pretty much all channels are there.left the few adult like venus,juicy,ect that are at the end of that section.this only affect what you see in epg,all channels are still selectable if you select channels list.This only affects what you see in epg.
I wanted a nice clean guide for what I watch the most.
I totally removed the webgrab part.
for some reason 5 Starmax has no epg info on schedule direct so I added a dummy channel so it will show in the guide but there's no epg.
Sky Premiere is doing the same for me it its added as a dummy channel also.i'm almost sure it had epg before.

here's my schedule direct I use,i only use 2 now.


10001 USA, US DISH Network - Satellite Satellite
33101 Miami, US DIRECTV Miami - Satellite Satellite

first run for US channels select schedule direct and enter ur schedule direct user/pass.

The thing I like the most is it does the entire pull in less than a minute now.
Have fun and thanks again to Pyscon,Dara and all other who help create this.

Blkbr.

BTW.A current NFPSE.xml is included(ran today).everything is 7 day epg and come in just under 30MB.

[psycon]

Thanks.. may actually start hosting something like this as well as I want one without dummies as well.. can you do me a favor and make one with all the channels we have guide data for... that is, do not include any dummies AT ALL, just all the channels with data..

Consider me AFK for the next 2 weeks.. its time for Shambhala.

[Blackbear199]

I can give it a try Pyscon,I don't need to tell you how tideous it is doin manual pulls and hunting through xml's to find correct channel names.I will work away at it though.
Have fun on your away time.

[Blackbear199]

Fix to show Setanta Sports in guide.

edit channelsie.chl

remove/edit Setanta Sports to
#----Senanta Sports
I423.753280.microsoft.com

channelsie.ren
remove/edit Setanta Sports:Setanta Sports to
#----Setanta Sports
I423.753280.microsoft.com:Setanta Sports
---------------------------------------------------------------------------------------
Fix to add True Movies 2 to guide,its added as dummy.no epg from Microsoft.

edit channelsuk.chl

edit True Movies 2 to
#-----True Movies 2
TRUE_MOV.iptvprivateserver.tv

edit channelsuk.ren
edit True Movies 2:True Movies 2 to
#-----True Movies 2
TRUE_MOV.iptvprivateserver.tv:True Movies 2

open dummyeng.body and add this to it


<channel id="TRUE_MOV.iptvprivateserver.tv">
<display-name>True Movies 2</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="TRUE_MOV.iptvprivateserver.tv">
<title lang="en">True Movies 2</title>
<desc lang="en">True Movies 2 Available Here.</desc>
<category lang="en">Movie</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>

[psycon]

I have added more schedules direct grabbers to my grabber.. (consolidated Canada, Miami, DTV, and Dishnet into us.dat us.chl and us.ren) - you do not need to do a pull for each one as schedules direct gives all 4 with the single pull..


i also created is.gd/NFPS1 which is a full grab minus the dummies and webgrab channels..

[Blackbear199]

added epg for some of the porn,they get pulled from dishnetwork vua schedule direct.

channelsus.chl
PLAYESP
DSPLYBY
HUSLRHD
DXTSY

channelsus.ren
PLAYESP:Playboy TV Latin America
DSPLYBY:Playboy TV
HUSLRHD:Hustler TV USA
DXTSY:Xtsy XXX

you have to edit dummyeng.body and remove the entries for the above channels also.

[psycon]

blackbear. i appreciate your additions.. I am not using your modified version, but have been adding your channel fixes to my .chl and .ren files..

Can you redownload the git and see if i have missed anything.

[Panita]

I wonder if it possible to add the flag -U output UTF-8, cause character from Spanish language doesn't encoded correctly like á,é,Ã*,ó,ú etc.

[Blackbear199]

had a quick look through ur .chl and .ren files
does Setanta Sports show in guide as you have it?
i posted a change on prev page on what i had to change it to.

[psycon]

no. what grab was that from.... your files are named different than mine.. too confusinng.. which is why i wanna just add the fixes to mine..

[Blackbear199]

Ireland,not 100% but i think uk and ire could be combined.i noticed alot channels r same as both are sky as only getting a few channels for ire.

[Blackbear199]

i will only post changes for .chl and .ren files.those that are running their own i assume will be smart enough to know where to put them.they can use whichever grabber they want.

[diode]

Any way to adjust the time offset? EPG is an hour off.

[psycon]

Any way to adjust the time offset? EPG is an hour off.

read the first post please

[Panita]

psycon, is it possible to add the flag that i wrote above on Post#424 (http://iptvtalk.net/showthread.php?2940-NFPS-xmltv-EPG-Grabber&p=47747&viewfull=1#post47747) because info like México appear Mxico, Página = Pgina etc.
Thanks!

[dara]

psycon, is it possible to add the flag that i wrote above on Post#424 (http://iptvtalk.net/showthread.php?2940-NFPS-xmltv-EPG-Grabber&p=47747&viewfull=1#post47747) because info like México appear Mxico, Página = Pgina etc.
Thanks!

Which channels? I just want to see if those are dummy channels or if they are grabbed channels.

[psycon]

Which channels? I just want to see if those are dummy channels or if they are grabbed channels.

did this last night. it better now?

[Panita]

they come from grabbed channels on go.bat setting

latin_tp.dat -F -s -1
latin_skymex.dat -F -s -1

it should be like this

latin_tp.dat -U -F -s -1
latin_skymex.dat -U -F -s -1
channels that come from webgrab like gato.tv are fine.

[takaloku]

Hello!
Have some errors grabbing:
"El sistema no puede encontrar el archivo especificado.
Utilty to correct offset start and stop times in xmltv files
Jan van Straaten, Januari 2011
No se pudo encontrar el archivo 'C:\Users\DiegoM\Downloads\NFPS-EPG-Grabber-mast
er\bin\wg_guide.xml'.
file wg_guide.xml + not found or corrupt
press any key to continue"

Then press key and xmltv_time_correct send other error and "Stopped Working" (Close Program)

Script continue with DATEMATH SYNTAX (press any key 3 times)

And start grabbing with mc2mxl, but when the process finish only have an NFPSF.xml (3.08 mb)
with only 4 channels data:
101 RTE ONE
102 RTE TWO
104 TG 4
423 Setanta Sports

What am i doing wrong!¿?
THANKS!

[dara]

It looks like if we want to have the latino channels on guide, we're going to need the schedules direct as well. The pipe from legacy is dry as well.

[Takenover83]

I know the guide has not updated in several days on the git. But to those who have a schedulesdirect account and run their own. Blackbear199's modified works pretty well. Pretty easy to get going with that version as well.

[Hustler]

Guys, excuse the noob question, but how do you run this on Mac OS? There's one file but opening it opens it with TextEdit. I've tried opening via terminal but get "Permission denied".

Would appreciate any help.

Thanks

[Blackbear199]

uploaded a NFPSE,post #238


http://iptvtalk.net/showthread.php?4483-How-to-set-up-pvr-stalker-with-NFPS-and-have-a-Full-EPG/page24

[Takenover83]

I started creating dummy data for the new random episode channels. But I was not sure of the channel id so I left that area blank. Blackbear199, psycon feel free to use it.

<channel id="">
<display-name>The Simpsons</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">The Simpsons</title>
<desc lang="en">A Random Simpsons Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>The Grimm</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">The Grimm</title>
<desc lang="en">A Random The Grimm Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>South Park</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">South Park</title>
<desc lang="en">A Random South Park Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>Game of Thrones</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">Game of Thrones</title>
<desc lang="en">A Random Game of Thrones Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>Arrow</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">Arrow</title>
<desc lang="en">A Random Arrow Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>Bobs Burgers</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">Bobs Burgers</title>
<desc lang="en">A Random Bobs Burgers Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>Bones</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">Bones</title>
<desc lang="en">A Random Bones Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>Criminal Minds</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">Criminal Minds</title>
<desc lang="en">A Random Criminal Minds Episode Available Here.</desc>
<category lang="en">Series</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>PPV Movie 1</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">PPV Movie 1</title>
<desc lang="en">A Random PPV Movie 1 Available Here.</desc>
<category lang="en">Movie</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>
<channel id="">
<display-name>PPV Movie 2</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="">
<title lang="en">PPV Movie 2</title>
<desc lang="en">A Random PPV Movie 2 Available Here.</desc>
<category lang="en">Movie</category>
<previously-shown />
<rating system="VCHIP">
<value>TV-Y</value>
</rating>
</programme>

[Blackbear199]

already added to mine but thks anyway.for channel id I just make one up...ex BONES.iptvprivateserver.tv,CMINDS.iptvprivateserve r.tv,ect.

[dara]

<channel id="Adult_1.iptvprivateserver.tv">
<display-name>Adult 1</display-name>
</channel>
<programme start="20150513213000 +0000" stop="20160513220000 +0000" channel="Adult_1.iptvprivateserver.tv">


The channel id has to be be unique, and match to the channel tag for the programme.

I haven't updated the dummies lately, but I was debating even doing them for these new channels, as they are already named. I'll use yours in an update, but lets see if they add more to them.

[Blackbear199]

agreed dara.any channels I add as dummy I make sure they don't get pulled when the grabber runs so there's no conflicts also as there are some that will get the channel id but there's no epg data.
all dummy channels are not listed in any .chl or .ren files.they get picked up because the dummy name matches the channel name from the server.

[Takenover83]

I did get all 10 of the new channels working in my guide. Thanks for the tips.

[Takenover83]

Here's a heavily modified version of Pyscon's and all others who contributed grabber.Thanks You.
Its a English only pull.
I removed things like the 20 or so music channels,adult 1,2,3,ect,sports 1,2,3,ect.from start to the few sport channels under sky movies pretty much all channels are there.left the few adult like venus,juicy,ect that are at the end of that section.this only affect what you see in epg,all channels are still selectable if you select channels list.This only affects what you see in epg.
I wanted a nice clean guide for what I watch the most.
I totally removed the webgrab part.
for some reason 5 Starmax has no epg info on schedule direct so I added a dummy channel so it will show in the guide but there's no epg.
Sky Premiere is doing the same for me it its added as a dummy channel also.i'm almost sure it had epg before.

here's my schedule direct I use,i only use 2 now.


10001 USA, US DISH Network - Satellite Satellite
33101 Miami, US DIRECTV Miami - Satellite Satellite

first run for US channels select schedule direct and enter ur schedule direct user/pass.

The thing I like the most is it does the entire pull in less than a minute now.
Have fun and thanks again to Pyscon,Dara and all other who help create this.

Blkbr.

BTW.A current NFPSE.xml is included(ran today).everything is 7 day epg and come in just under 30MB.
Will you be providing a update to this once you are done tinkering?

[Blackbear199]

Undecided on that.I don't mind sharing it but I have it changed so much from psycons original it would be a whole page to explain it all.I added webgrab again as for some channels that I could find no other source for,moved all the webgrab files to the webgrab folder from the grabber folder.its still pretty fast doing a pull(think it added few min for the webgrab section).its prob abt 5 min or so now for a complete 7 day pull.So in short one would have to change all the paths in go.bat to where you keep your files as the directories would be different from mine.also had to add more pulls from Microsoft for sky mexico and a Portugal.

what I could use if someone has a source for the following channels,think they are the only missing English ones I think.

95 - Irish TV(Sky Arts 2 I can get the channel to pull from skyuk(Microsoft) or with webgrab but it never has any epg data
206 CNBC Africa gives me server error with webgrab,i forget which server I was trying.i think it was dstv(south Africa provider).
eNCA forget the channel number.think they removed it as I don't see it listed today.almost sure it was there friday.its a dstv channel also.
437 - Sport 3 = Pac-12 TV Networks (Mountain) (USA)
438 - Sport 4 = Pac-12 TV Networks (Bay Area) (USA)
439 - Sport 5 = Pac-12 TV Networks (Oregon) (USA)
440 - Sport 6 = Pac-12 TV Networks (USA)

the pac-12 regionals are not in any webgrab list.i can find online epg from the pac network site and from what I found searching the net they are only available from AT & T U-Verse cable.

[dara]

Which webgrab sources are you currently using, Blackbear? I'm pulling from the TV Guide, but they don't like that, and it takes forever. I'm delaying on getting a schedules direct account, because personally, I don't really need it, but who knows... we may have a benefactor that will help out. :)

[Blackbear199]

<channel update="i" site="tvguide.co.uk" site_id="861" xmltv_id="True Drama">True Drama</channel>
<channel update="i" site="tvguide.co.uk" site_id="610" xmltv_id="NHK World">NHK World</channel>
<channel update="i" site="portalnacional.com.pt" site_id="russia-today" xmltv_id="Russia Today">RT Documentary</channel>
<channel update="i" site="tvguide.co.uk" site_id="925" xmltv_id="BoxNation">BOXnation</channel>
<channel update="i" site="tvguide.co.uk" site_id="499" xmltv_id="True Movies 2">True Movies 2</channel>
<channel update="i" site="tvguide.co.uk" site_id="264" xmltv_id="Sky Sports 4">SKY Sports 4</channel>
<channel update="i" site="tvguide.co.uk" site_id="918" xmltv_id="Sky Sports 5">SKY Sports 5</channel>
<channel update="i" site="astro.com.my" site_id="82" xmltv_id="Astro SuperSport">ASTRO SuperSport</channel>
<channel update="i" site="astro.com.my" site_id="11" xmltv_id="Astro SuperSport 2">ASTRO SuperSport 2</channel>
<channel update="i" site="astro.com.my" site_id="80" xmltv_id="Astro SuperSport 3">ASTRO SuperSport 3</channel>
<channel update="i" site="portalnacional.com.pt" site_id="sextreme" xmltv_id="Sextreme">Sextreme</channel>
<channel update="i" site="portalnacional.com.pt" site_id="venus" xmltv_id="Venus">Venus</channel>


the rest I get from Microsoft and schedule direct.

[Blackbear199]

also here my channels2correct if u want to add them,astro sports still needs correcting,i think astro supersport 1 is right.


<channel time_error="-2">True Drama</channel>
<channel time_error="-2">NHK World</channel>
<channel time_error="-2">True Movies 2</channel>
<channel time_error="-2">RT Documentary</channel>
<channel time_error="-2">BOXnation</channel>
<channel time_error="-2">SKY Sports 4</channel>
<channel time_error="-2">SKY Sports 5</channel>
<channel time_error="-40">ASTRO SuperSport</channel>
<channel time_error="-32">ASTRO SuperSport 2</channel>
<channel time_error="-19">ASTRO SuperSport 3</channel>
<channel time_error="-2">Venus</channel>
<channel time_error="-2">Sextreme</channel>

[dara]

I have the astro fixed on my local grab, but I'm not sure if it ever made it to psycon's process. It's a pain to verify, because the grab doesn't pull in live events for me, and just leaves them blank. Also, I think the webgrab may be local specific, so the time corrections will be specific for your location. The webgrab in psycon overall grab is based on west coast North America.

[Blackbear199]

thks dara for that.i see those blank entries also and for the life of me couldn't figure out why.

[cdsn99]

Hi all, I downloaded the EPG Grabber, and have been playing around with it for a couple of weeks now, the problem is, when I run it like the instructions say, I end up with data for just a few channels. The xml files is about 3mb After reading the entire thread I'm sure I must be doing something wrong, but now sure what, the program runs, at some point I see an error that says invalid schedules direct user/password, then it continues. I've look for a tutorial on how to make this work for me, but can't seem to find one. Do I need a schedules direct account? If so, I don't mind getting that, but don't really want to purchase it if my problem is from something else. Anyway, any help or tips would be greatly appreciated. thanks.

[Blackbear199]

yes you will need a schedule direct account and add a linup for dishnetwork/direct tv and some others possibly.i'm guessing 90% or more of the epg data comes from there hence why u have little to no guide.until some other permanent fix comes out I have been running my own grabber and you can download the xml files here or continue on yourself and configure your own.its a lot work and a good learning experience.

http://iptvtalk.net/showthread.php?6243-Kodi-NFPSE-xml

[cdsn99]

Thanks for the reply Blackbear, I signed up for a schedules direct acct last night, and I did add dishnetwork lineup, but where do i add my user and pass to the go.bat file or other configuration file so it will grab the data, when I run the mc2xml independently and sigh into schedules direct I get a 30mb file but when I loaded it most of the data was not there. does what I'm saying make sense, I thought maybe I need to incorporate my user/pass with the epg grabber somehow

[Blackbear199]

you can do it 2 ways

1 in your go.bat look for the mc2xml line for us channels and at the end add
-T user:pass
2 delete the channelsus.dat file,when u run the grabber again mc2xml will give you a popup.select schedule direct on left side and enter your user/pass info.it will save a new .dat file and wont ask again.
also u don't do this for uk,Ireland,ect epg data.leave them as is and it will pull the data from Microsoft.
you only need it for the north American channels as Microsoft has stopped their legacy service that mc2xml use to use.

[cdsn99]

Thank you so much Blackbear, will give that a shot a report back, thanks

[cdsn99]

Thanks for the info Blackbear, that seemed to work, I do have a question thought, in schedules direct when i select a lineup, do i need to edit it and only select the channels that in the epg grabber list, or can i just leave the whole dishnetwork lineup and directv lineup, and will the grabber only take the data it wants? hope this makes sense.

[Blackbear199]

I do.i didn't test it both ways to see if it makes a difference in file size though.
I assume since we are using a .chl file it only grabs for those channels.
in theory I think you could select the channels you want in the lineup and do away with the .chl file all together.

[cdsn99]

Ok, I may test that and see if it makes a difference, thanks so much the help, hopefully as I learn more I'll be able to contribute more to the thread, I still don't understand what the dummy files are about , i really wish was there was a good tutorial out there or a learning video on this. anyway thanks again, for all your help, you certainly got me where I can run the grabber and get the data. :)

[Blackbear199]

the dummy files are for channels like the new simpsons,crimal mind,ppv movies,ect that have no epg data.we create dummy data for them so they will show up in the epg grid.

[Blackbear199]

just to elaborate on the dummy files.in the go.bat you see

copy dummy.txt dummy1.txt
copy dummy.txt dummy2.txt
copy dummy.txt dummy3.txt

this creates a file for each day.psycon does 3 day epg

sed.exe -e "s/20150513213/%Yr%%Mth%%Day%070/g" dummy1.txt > dummy1_1.txt
sed.exe -e "s/2016051322/%Day1%07/g" dummy1_1.txt > dummy1_conv.txt

sed.exe -e "s/20150513213/%Day1%070/g" dummy2.txt > dummy2_1.txt
sed.exe -e "s/2016051322/%Day2%07/g" dummy2_1.txt > dummy2_conv.txt

sed.exe -e "s/20150513213/%Day2%070/g" dummy3.txt > dummy3_1.txt
sed.exe -e "s/2016051322/%Day3%07/g" dummy3_1.txt > dummy3_conv.txt

this modify's the date/time for each day

copy /b dummy1_conv.txt + dummy2_conv.txt + dummy3_conv.txt dummy_conv.txt

this puts them all together to create 1 big file
it then gets stripped(I havnt look at exactly what this does)

copy /b dummy.hdr + wg_tc_strip.txt + dummy_conv.txt + dummy.ftr dummyparsed.xml

this puts it all together with the proper header to make it a proper xml file that kodi can read.

lastly if you look at your first epg pull with mc2xml you will see the above file dummyparsed.xml like this

mc2xml -I dummyparsed.xml

that adds our dummy channel epg into the epg data that we are going to pull from schedule direct and Microsoft.

I run a 7 day epg so what I have done is doubled the amount of dummy files to 6 or of all the dummy channels would run out of data in 3 days.

[cdsn99]

Thanks, that makes a little sense to me, lol, I will try and look at those files closer, perhaps it will become more clear, anyway, I added directv lineup and dishnet lineup to schedules direct and left all the channels unedited, the epg grabber appears to have only grabbed the data it needed, as the files size of my NFPSE was 16mb, which seemed about right to me. Also, if you don't mind me asking, how to change the number of days of data that is pulled, is that in the go.bat file also?

[Blackbear199]

in your mc2xml lines you will see -d XX
XX is the number of hours of epg to pull,i use 168.

http://mc2xml.hosterbox.net/

explains it all.

[cdsn99]

Thank you, I will look for that, I will also check out the link and readup there as well , thanks so much for all you help

[dh8389]

Hi, quite a few of my channels are blank epg. And the guide has no colour any more. Any reason for this?

[Blackbear199]

the is.gd epg link data is old.i uploaded a nfpse.xml here until someone fixes it.

http://iptvtalk.net/showthread.php?6243-Kodi-NFPSE-xml
unzip it,in pvr stalker config for xmltv change it to local path and point to where you unzipped the file.

[Jazzphone]

the is.gd epg link data is old.i uploaded a nfpse.xml here until someone fixes it.

http://iptvtalk.net/showthread.php?6243-Kodi-NFPSE-xml
unzip it,in pvr stalker config for xmltv change it to local path and point to where you unzipped the file.

Hi Blackbear,

Are you going to be updating this weekly until the issue gets resolved?

Thanks!

[dh8389]

the is.gd epg link data is old.i uploaded a nfpse.xml here until someone fixes it.

http://iptvtalk.net/showthread.php?6243-Kodi-NFPSE-xml
unzip it,in pvr stalker config for xmltv change it to local path and point to where you unzipped the file.

Thanks, worked like a charm.

[crawlers1977]

ok so i got confirmation of my donation towards mc2xml and with the email is the new donation version 1.3 with the microsoft active and running via rovio since theres no username or password if its gonna be used with the same setup as before its in that case ready for dar or psycon. if you guys want this use of it just leave me a private message and ill pass it along with the email i recieved too

[USJudo]

the is.gd epg link data is old.i uploaded a nfpse.xml here until someone fixes it.

http://iptvtalk.net/showthread.php?6243-Kodi-NFPSE-xml

Worked a charm. Thanks BlackBear.

[dara]

I think we'll have a nearly complete epg in the next few days in the is.gd, thanks to crawlers1977. Still need psycon's help to set things up, but I did a local update of the us-dish, miami, dtv and latin-tp grabs, converting them to the Rovio source. The dummies are updated as well. Hang tight.

[meluvalli]

That's awesome news! Thanks Dara!

[Blackbear199]

if you need anything dara just ask.i have also converted everything to rovi,all English and all Spanish from 825 on up.

[dara]

if you need anything dara just ask.i have also converted everything to rovi,all English and all Spanish from 825 on up.

Thanks, did that already, still waiting for psycon to appear. Hopefully going forward we can have a "synched" set of chl and ren because that change was pretty massive. Are you able to get all the latins into one set, vs. Total Play + Skymex? The new microsoft also allowed me to drop some of the feeds from the webgrab.

[Blackbear199]

for the Spanish I get most from sky mex.except for the following I get from dtv usa


I402.309249961.microsoft.com:Univision
UNIMAS:UniMas
UNVRSO:NBC Universo
CRCTV:Caracol Internacional
I406.28456675.microsoft.com:Telemundo
RMTV:Regional Music
PASN:Pasiones

and the rest I pull from webgrab


<channel update="i" site="entutele.com" site_id="/canal/discovery-channel" xmltv_id="Discovery Channel">Discovery en Español</channel>
<channel update="i" site="entutele.com" site_id="/canal/cnn-en-espanol" xmltv_id="CNN en español">CNN en Español</channel>
<channel update="i" site="entutele.com" site_id="/canal/history-channel" xmltv_id="History Channel">History en Español</channel>
<channel update="i" site="gatotv.com" site_id="azmundo" xmltv_id="Canal AZMundo">Az Mundo</channel>
<channel update="i" site="gatotv.com" site_id="rcn_novelas" xmltv_id="Canal RCN Novelas">RCN Novelas</channel>
<channel update="i" site="gatotv.com" site_id="cinema_dinamita" xmltv_id="Canal Cinema Dinamita">Cine Dinamita</channel>
<channel update="i" site="gatotv.com" site_id="k_music" xmltv_id="Canal K - Music">K Music</channel>
<channel update="i" site="gatotv.com" site_id="multimedios_plus" xmltv_id="Canal Multimedios Plus">Multimedios Plus</channel>
<channel update="i" site="gatotv.com" site_id="13_de_republica_dominicana_telecentro" xmltv_id="Canal Telecentro (13 de República Dominicana)">TeleCentro</channel>
<channel update="i" site="gatotv.com" site_id="bein_sport_en_espanol" xmltv_id="Canal beIN Sport en Español">BeinSports en Español</channel>
<channel update="i" site="gatotv.com" site_id="teletica" xmltv_id="Canal 7 de Teletica (Costa Rica)">Teletica</channel>
<channel update="i" site="gatotv.com" site_id="tooncast" xmltv_id="Canal Tooncast">Tooncast</channel>
<channel update="i" site="gatotv.com" site_id="concert_channel_hd" xmltv_id="Canal Concert Channel HD">Concert Channel</channel>
<channel update="i" site="gatotv.com" site_id="euronews" xmltv_id="Canal Euronews">Euronews en Español</channel>


were u able to get the Spanish with the accents to map with mc2xml? ex Discovery en Español
only way that worked for me was to use webgrab.

channels2correct


<channel time_error="-1">Az Mundo</channel>
<channel time_error="5">RCN Novelas</channel>
<channel time_error="6">TeleCentro</channel>
<channel time_error="-1">Multimedios Plus</channel>
<channel time_error="6">Cine Dinamita</channel>
<channel time_error="-1">K Music</channel>
<channel time_error="-1">BeinSports en Español</channel>
<channel time_error="6">Tooncast</channel>
<channel time_error="-1">Concert Channel</channel>


any not listed there needed no time correction.

[Blackbear199]

here's one I had a hard time finding.the pac-12 regionals
I used a seattle,wa zip and century link for the provider.here the contents of my .dat file


CenturyLink Seattle Digital
8fs+hiAzm7DC/2cw79goWBPieFcqSuhtNfKwzDMt0osv+fXO9gcz7eyO/USy6pAlDQj7DUZe8/cT7Emafw/5tCacILmoF7w+z6eKrBCD8/N5f5k4C0JAbTJEWZECEuM+g9UWoGogoAqxLdWJGTm0xw==


437 - Sport 3 = Pac-12 TV Networks (Mountain) (USA)
438 - Sport 4 = Pac-12 TV Networks (Bay Area) (USA)
439 - Sport 5 = Pac-12 TV Networks (Oregon) (USA)

.ren file


PACMT:Sport 3
PACBA:Sport 4
PACOR:Sport 5

[Blackbear199]

another thing I found with using rovi,did you notice that almost every channel that has a east/west feed uses the same name.i used the Ixx.xxxxxxx.Microsoft.com name to make sure it got the proper epg.
example of one.


<channel id="I318.28457244.microsoft.com">
<display-name>SHO</display-name>
<display-name>318 SHO</display-name>
<display-name>318</display-name>
<display-name>Showtime (East)</display-name>
</channel>
<channel id="I319.28457713.microsoft.com">
<display-name>SHO</display-name>
<display-name>319 SHO</display-name>
<display-name>319</display-name>
<display-name>Showtime (West)</display-name>
</channel>

[dara]

another thing I found with using rovi,did you notice that almost every channel that has a east/west feed uses the same name.i used the Ixx.xxxxxxx.Microsoft.com name to make sure it got the proper epg.
example of one.


Yeah, that's the trick I have to use to get both feeds. I don't do a direct rename using the channel id in the rem, but have been just pulling the west feed in a separate grab, either with dish ("us") and dtv or just doing it with a second pull on the same source using a different set of chl/ren. I saw that you are able to get it to work though.

On the pac12 feeds, just me, I don't bother creating my own pulls for the numbered channels, only because they seemed to change so often in the past, and if you don't keep up with the change, the program data gets crossed over to some other channel. I know that psycon has done that and some of those still work, but I tried to do the canada pull, and got nothing. The other thing bad about that is you'll see the program data, but unless you know... you won't know what the channel is other than its number.

Hopefully those pac12 feeds will get a permanent name, vs. a Sports #.

[Blackbear199]

here's the Canada ones.,i get BBC World News with my Canada pull also.
Sport 2 is Sportsnet 360.
.ren


WN:The Weather Network
I510.45505287.microsoft.com:BBC World News
I845.47494403.microsoft.com:Sport 2
LCN:Canada 1
CICC:Canada 2
CTVED:Canada 3
CTVLH:Canada 4
CKCK:Canada 5
TVA:Canada 6
VHD:Canada 7
CPAC:Canada 8

.dat


Bell TV Atlantic Time Zone Digital
fx2TC1716X/46WfWSNoGR0e2anwAvIqg4znsUxqc/lsCKHZXeIOPQmfusTikRVNJl3uzjqlzbjALqQdyCDdX1U5dTzR PpTY9jXKK8HyAgOeLl2wFaDTHfC3cZUYYU9DtQi3amVZPfizdT x5lQD66mw==

Canada 9 and 10 show as off air in the lastest list posted on zeta so I didn't add them.

[dara]

I was using Telus Alberta for the Canada, (because that's what psycon was using), but I'll give it a try with your info.

I'll also move off of the Total Play for the latins to Skymex as well, so we can compare notes on it, but that will be a later project.

[Blackbear199]

ya,there's so many different pulls one could use,i tried it at first with the telus one psycon had and couldn't get them all so I tried a bell pull and they were all there.

[dara]

What postal code are you using for the canada? I can't get anything using this


mc2xml -c ca -g H0H0H0 -C ca.ren -R ca.xml -o ca.xml -D ca.dat -F -s -2 -d 72 -u -a -f


I may have some junk in my ca.chl or ca.ren that may be causing my error...

[Blackbear199]

e1v5y1
I guessed a postal code for a local town.
bell satellite not the iptv/fibre op one.

[Blackbear199]

btw ur line is incorrect

mc2xml -c ca -g H0H0H0 -C ca.ren -R ca.xml -o ca.xml -D ca.dat -F -s -2 -d 72 -u -a -f

should be
mc2xml -c ca -g E1V5Y1 -R ca.ren -o ca.xml -C ca.chl -D ca.dat -F -s -2 -d 72 -u -a -f

should work.

and don't forget to strip the .ren file i gave to make the .chl file

.chl


WN
I510.45505287.microsoft.com
I845.47494403.microsoft.com
LCN
CICC
CTVED
CTVLH
CKCK
TVA
VHD
CPAC

[dara]

Damn typos! my command line was screwed up.

[Blackbear199]

also I usually don't add the -c and -g flag.one first run I select the country and enter the zip/postal code and it gets encoded into the dat file and wont ask again unless you delete the dat file.

[dara]

Finally got the canada. Since its local...really didn't care too much about those, so I didn't check the command line for months. :)

Here's what I do with my local...



Echo Loading Canadian Lineup
mc2xml -c ca -g e1v5y1 -C ca.chl -R ca.ren -o ca.xml -D ca.dat -F -s -2 -d 72 -u -a -f
sed.exe -e $d ca.xml > ca_strip1.txt
sed.exe -e 1,4d ca_strip1.txt >ca.txt


I do that for each of the pulls, and then combine the *.txt with the header and footer at the end, vs. using the -i process. That way, I'm not dragging the entire xml into the pull for the later big pulls for uk. Normally, I drop the -f, and keep the .xml and let the grabber figure out if it needs to pull new data.

[Blackbear199]

that's a good idea,i like that.i was thinking the exact same thing but didn't come up with a good solution for it.i will change mine and do that also.

Thanks.

[dara]

This is for Blackbear, so only use this if you know what you are doing. It's my local .bat and the dummy processing that doesn't appear in the github. I also do the webgrab separately from the main pull.

[Blackbear199]

Psycon must be around,check the git and files were updated 11 hours ago so the is.gd links shud be working again to populate your guide data.

[psycon]

sorry guys. been away. anyone care to get me up to speed?

[crawlers1977]

well welcome back m8 the guys on here have pulled together regarding the pvr by now you would know where its all at but nice to see you back

[Blackbear199]

Question for Psycon/Dara,

Was looking around webgrab site and came across WG2MP,from the readme...


// Small program that replaces the time offset part of the start and stop time in an xmltv file
// by the corrected time string for the local timezone


was thinking about trying to use it instead of xmltv_time_correct but am wonder if you have tried before I changed everything.as it says it only adjusts time I don't know if it will do the date correct also.i'm thinking it would be nice as everything from mc2xml get adjusted to your pc time when imported and wud'nt have to keep adjusting channels2correct to get them right for the webgrab epg part.

any thoughts.

Update

ran some tests with this and it aint going to work it strips the +/- xxxx utc part off which will wreck it for making the nfpsed.xml and nfpsfd.xml files.

thks.

[psycon]

not sure.. not a fan of webgrab , its soo damn slow.. I merely incorporated dara's webgrab work into the main grab. i'll bet we can find all channels with mc2xml and be able to remove the need for webgrab all together down the road, which would be ideal IMHO.

[Blackbear199]

If you are like me and never used these commands before and wanted to know exactly whats going on well I took the time to do the reading and will try to explain it for those that are running their own grabber.
I had a good idea what it was doing but wanted to know how so here it goes.

first open a cmd prompt and enter

echo %Date:~0,14% and hit enter
you will get a output like this

Tues 08/18/2015

so what happened,well you just asked to display your pc date,thats obvious aint it but what u really asked was show me the pc date starting from position 0 and show the next 14 characters.see the ~0,14% from above.position 0 is at the beginning of the line(to the left of the letter T).
now keeping that in mind lets look at the first commands in that section...

set Day=%Date:~7,2% ----->position 7,next 2 characters = 18 which is todays date and we assign that value to the variable Day via set Day =
set Mth=%Date:~4,2% ----->position 4,next 2 characters = 08 which is the month and we assign that value to the variable Mth via set Mth =
set Yr=%Date:~10,4% ----->position 10,next 4 characters = 2015 which is the year and we assign that value to the variable Yr via set Yr =

so...
Day = 18
Mth = 08
Yr = 2015

next command,i am only going to explain the first one as the rest are just a repeat

call datemath %Yr% %Mth% %Day% + 1 ---->datemath calculates a new date.so we asked to calculate a new date starting from %yr% %Mth% %day% which is 2015 08 18(remember we set these variables above) plus 1 day
set Day1=%_ymd_str% ----> sets the variable Day1 to our newly cacluated date which would be 20150819
the next 2 commads are exactly same but for day2 and day3
so after they are all done we have...

day1 = 20150819
day2 = 20150820
day3 = 20150821

next we make 3 copies of our original dummy file(one for each day we want) and name them dummy1.txt,dummy2.txt,dummy3.txt

finally we want to modify the dates in each of those files for each day of epg
again I will expain the first one as the rest are the same.
sed.exe is nothing more that a editor that we can use to remove,replace,edit text

sed.exe -e "s/20150513213/%Yr%%Mth%%Day%070/g" dummy1.txt > dummy1_1.txt
-e means expression to follow,s means substitute(replace).we want to replace 20150513213(if you look in the dummy.body file you will find this start date) with %Yr%%Mth%%Day%(which we assigned above to be 20150818,todays date.070 sets the time to 0700.g means global which replaces all the starts dates in all our dummy channels in the file named dummy1.txt and outputs the new file as dummy1_1.txt.
sed.exe -e "s/2016051322/%Day1%07/g" dummy1_1.txt > dummy1_conv.txt
this does the exact same thing as above but reads the file Dummy1_1.txt which we created when we replaced the start date but changes the end dates(2016051322,if you look in the dummy.body file you will find this end date) instead of the starting date.the file is outputed as dummy1_conv.txt

so when that's all finished we have

dummy1_conv.txt ---->start date 20150818070000 end date 20150819070000
dummy2_conv.txt ---->start date 20150819070000 end date 20150820070000
dummy3_conv.txt ---->start date 20150820070000 end date 20150821070000

finally we combine all 3 files into one file called dummy_conv.txt
copy /b dummy1_conv.txt + dummy2_conv.txt + dummy3_conv.txt dummy_conv.txt

that's it,now we have 3 days of out dummy channels with correct dates that we add into our epg file.

[Blackbear199]

ya,I tried hard to avoid webgrab but there were channels I just couldn't find anywhere with mc2xml and a did a lot test pull for diff countries.

[Blackbear199]

Psycon or anyone good with sed help with this.i am messing with the wg2mp exe I mentioned above.while it reads the + or - utc time and makes the correction to the start/stop time it removes +/- utc value from the xml.
example


before
start="20150818070000 +0100" stop="20150818080000 +0100"
after
start="20150818060000" stop="20150818070000"

I want to add +0000 back into the start/stop time as that's what it now corrected for so its like this

start="20150818060000 +0000" stop="20150818070000 +0000"
I am trying with this but its giving me a error unterminated s command

sed.exe -e "s/(start|stop)="[^"]*/& +0000/g" < "WG2MP_dummy.xml" > "done.xml"
I just don't know sed well enough,never even realized how much it can do,i know it stupid error but can't figure it out.
thks.

[were55]

Hi Psycon,

Any chance to provide a better EPG for latin channels? especially for movies and sports.

thanks for great job

[Blackbear199]

were55,i'll update my NFPSF/NFPSFD files.gimme a few min.

[dara]

It seems like the mc2xml doesn't work for me for "GB" for the UK pull using microsoft or microsoft legacy. (not schedule direct). Anyone else verify?