Final Release - Rytec UK EPG for Neutrino (DM500)

[hotbaws11]

Final Release - Rytec UK EPG for Neutrino (DM500) -> Version 2 14-Sep-2010

Right guys,

Total overhaul of the prototype on the other post but it was useful for a proof of concept

This script downloads the uk satellite epg listings from the Rytec website and converts it into Neutrino xml format so that it can be loaded in.

The image I used is one of the old Russian ones and at the moment it has a limit of 15999 programs/events that can be loaded. I have also ignored the descriptions at the moment and will think about adding these in at a later date.

The script can be run from telnet however I’m going to create an EPG menu in the FlexMenu that can make different calls to the script, including an option to setup/remove a cron job. For example by typing the script name followed by fta, only the fta channels will be loaded with epg details. I have similar options for films, sport, music, factual. Just type the script name into telnet to see all the usage options. I have also added a ‘most’ option which loads the epg for most of the channels and tries not to go over the 15999 programs/events.

Compatibility -> Plug and play with older images such as rudbox as they have the old date function. For newer images, the script will need a tweak. See other posts below for workarounds until I have created a separate script for newer images.

Performance -> It takes around 20 seconds to process/load epg info for 1 channel so if you select the ‘most’ option, it extracts about 93 channels (15791 events), it takes around 30 mins to load all the info into the EPG. The script will tell give you an estimated time of completion when it starts and also creates a performance log that you can have a look at.

Storage -> No external storage is required, all processing is done in /tmp.

Channel Mapping -> You don’t need a local channel mapping file to get the script running as the script downloads the Rytec version from the server, however it’s a good idea to create a one and have few entries in it as I can see that the Rytec version has a few channels missing etc. So without a manual mapping for these channels, they will not be loaded into Neutrino. The script will tell you what channels can’t be loaded etc so you can then create a manual mapping file.

Comments/Suggestions welcome. I’ll probably get around to using LraiZer’s small busybox that he created which has the printf function. This would allow me to create all event ids in hex and thus have up to 65k events.

[LraiZer]

be aware that the small busybox i made installs a newer date function to make the old russian image compatible with the newer neutrino date functions used in the NeuXmlEPG plugin. you can either update your code for the newer date function or simply remove the /var/bin/date symlink after small busybox install.

[FreddyFr0g]

Looks like a great script!
I had a quick look through it and the only suggestion I can make (apart from having more European channels data, I only have hotbird/astra 19.2) is to use the neutrino.conf for some of the settings like

epg_cache_time=1
epg_dir=
epg_extendedcache_time=6
epg_max_events=12000
epg_old_events=0

So that for example, the data is saved in the epg_dir=, useful if you have a HDD.

[hotbaws11]

Originally Posted by FreddyFr0g

Looks like a great script!
I had a quick look through it and the only suggestion I can make (apart from having more European channels data, I only have hotbird/astra 19.2) is to use the neutrino.conf for some of the settings like

epg_cache_time=1
epg_dir=
epg_extendedcache_time=6
epg_max_events=12000
epg_old_events=0

So that for example, the data is saved in the epg_dir=, useful if you have a HDD.

cheers for the info, I never knew that info existed lol! apart from epg_dir and max_events what do the other options do? Why is the default Neutrino max_events set at 12000? Is this due to neutrino having issues with handling more that this?

On the european channels front, the beauty about Rytec is that he has xml files for most european providers so that script can be easily adapted by chaning RYTEC_ZIP, RYTEC_CHANNEL_MAP_ZIP and CHANNELREGEXP. In fact it might already work if you change they variables! I've already adapted my Enigma code to get the epg for the other sats so when I get a chance, I'll do the same for the neutrino version

@LraiZer, I thought that would be the case. How did you create that busy box anyway as I'd be interested in using some other functions (i.e. bc). Note I don't have any compiling background, just what I learn on google for scripting lol!

[hotbaws11]

guys... silly me, I was testing the script in /tmp and when I tested it in /var/bin it just crashed on me. Hopefully that's me fixed it. sorry about that!

If you ran the original script in /tmp it would have worked fine

[LraiZer]

the busybox was compiled in standard tuxbox-cvs build after editing the busybox.config.m4 file so that only (printf cut date) were added to the final busybox binary. if you let me know what busybox functions you want i could add them.

[Ten Below]

Hello i am new here and would like to try this, will this work on any Neutrino image?

Thanks in advance.

[renwich]

@Hotbaws I've run your script from /var/bin using ./Rytec_EPG_UK_Neutrino.sh most

It downloads the rytec files and does some bits then I'm getting a constant stream from telnet of the following

(I've got an image with a busybox containing printf)

date: invalid date '092104152010'
date: invalid date '092104302010'
date: invalid date '092104302010'
date: invalid date '092105002010'
date: invalid date '092105002010'
date: invalid date '092105302010'
date: invalid date '092105302010'
date: invalid date '092106002010'
date: invalid date '092106002010'
date: invalid date '092109152010'
date: invalid date '092109152010'
date: invalid date '092110002010'
date: invalid date '092110002010'
date: invalid date '092111002010'
date: invalid date '092111002010'
date: invalid date '092111452010'
date: invalid date '092111452010'
date: invalid date '092112152010'
date: invalid date '092112152010'
date: invalid date '092113002010'
date: invalid date '092113002010'
date: invalid date '092113302010'
date: invalid date '092113302010'
date: invalid date '092113452010'

[LraiZer]

Originally Posted by renwich

@Hotbaws I've run your script from /var/bin using ./Rytec_EPG_UK_Neutrino.sh most

It downloads the rytec files and does some bits then I'm getting a constant stream from telnet of the following

(I've got an image with a busybox containing printf)

date: invalid date '092104152010'
date: invalid date '092104302010'
date: invalid date '092104302010'
date: invalid date '092105002010'
date: invalid date '092105002010'
date: invalid date '092105302010'
date: invalid date '092105302010'
date: invalid date '092106002010'
date: invalid date '092106002010'
date: invalid date '092109152010'
date: invalid date '092109152010'
date: invalid date '092110002010'
date: invalid date '092110002010'
date: invalid date '092111002010'
date: invalid date '092111002010'
date: invalid date '092111452010'
date: invalid date '092111452010'
date: invalid date '092112152010'
date: invalid date '092112152010'
date: invalid date '092113002010'
date: invalid date '092113002010'
date: invalid date '092113302010'
date: invalid date '092113302010'
date: invalid date '092113452010'

your busybox date function is too new for this scriptcode to work. this code is only currently compatible with an old busybox date function in an old neutrino image.

the newer date function you are using needs the date to be passed as '2010-09-21 1345 ' not '092113452010'

[hotbaws11]

yeah that's what I was about to say

basically you just need to modify the long sed statement to change the date format into '2010-09-21 1345 ' instead of '092113452010'.

I didn't have a box with a new image to test it with when I was writing it.

I'll have a look at the exact bit that needs changed when I get a min and point it out to you.