Deduplication Media

As the media collection grows it is easy to get duplicate copies of files and I’m having a real problem with my photos among others.

Don’t really have faith in an automatic process which deletes my files! So I found another way by using fdupes to creates a MD5 hash and then compares other files to it.

sudo apt-get install fdupes

Log into the server via SSH and run fdupes with the output saved to a file.

fdupes -r ./Documentaries/ > ~/Documentaries.txt

Then open the file with nano and search for .avi or .mkv files.

Note: .tbn are saved jpg’s for XBMC so will come up in the search, just ignore them.

The photo were doubled checked with digikam, just to make sure. Using this approach I managed to save a few gig’s



Well the crimps arrived from Hong Kong yesterday. Pretty good delivery time as I ordered them on the 28th January.


Still have to finish a bit of woodworking, paint it, order the iPac 2 interface and wire it all up.

After all that its software time.  Already been looking at options and the first I think is the xbmc ROM browser after that it would be a custom build probably on linux although I still have a xp disk knocking about so could use that as there is more software available. 


Finally managed to compile the xbmc server. It seems the default package taglib in debian doesnt play nicely with the compile.

In fact , even if you download and compile a newer verson the xbmc build fails. Took several hours of build, fail,  change, build, fail , change before I found that gem.

Not near my pc at the moment so can’t provide the package name (libtag01?) but a quick

Sudo apt-cache search taglib

Will find it. 

I now have an issue connecting to the mysql db, can do it through myphpadmin but not from shell. Got a few ideas which will try tonight.

On a positive note…

Couch Potato

All installed correctly and are up and running plus they start at boot, each one has a init.d script that you copy to /etc/init.d/ although I suggest making a link instead. Then if the file gets updated from git nothing will need changing.

Sabnzbd is the only one you have to copy the script from the wiki.

Also the majority use /etc/defaults/ to store the service config files.

Only got the virtual hosts to create for nnplus and partkeepr and a few back up / update from jobs to write.

Been using a generic user to run all of these services but noticed in the headphones config it suggests creating a new user with no home directory and I think that’s the way to go when I move to the production build. 

In the end I should have ….

OMV as system admin
Maraschino as user control panel
Sickbeard, Sabnzbd, headphones, couchpotato running
Nnplus indexing usenet
Partkeepr as my electronics db.

Only have 2 gig of ram in the server at the moment so going to double that next time I get paid.

Virtual Box – OMV on Debian Squeeze

As I mentioned in my previous post been playing round with a few things and I’d like to have a headless XBMC ‘server’ installed on top OMV. Previously I didn;t see the point of installing XBMC over OMV but when you plan to connect the two mini Zotac boxes with OpenElec to a central MYSQL db it kinda makes sense to have one version of XBMC doing all the scrapping and updating.

As usual I like to test these thing in a virtual box before I rebuild the live server.

So following the guide on the xbox forums –

to create the headless XBMC but before that I need a working OMV ontop of Debian Squeeze, as suggested by this post

Downloaded the Boot Image and a version of Debian Squeeze

Ran into a few problems creating the virtual machine, the ISO could be mounted but not the IMG file. So after a quick google, found out that you can convert them both to VDI files and then mount those.

vboxmanage convertfromraw -format VDI boot.img omv.vdi
vboxmanage convertfromraw -format VDI squeeze-custom-i386-0315.iso squeeze.vdi

Then set up the drives in the following order

  • SATA 00 – OMV
  • SATA 01 – Squeeze
  • SATA 02 – OMV Squeeze

Once the installation has finished you’ll be asked to write GRUB to the MBR remember that OMV and Squeeze will be removed so Select No and then type /dev/sdc when it askes for the Boot Loader Installation

Once the installation has finished change the SATA port for OMV Squeeze back to SATA 00 then you should be good to go.

OMV Set Up

After following these steps from the OMV Forum post

1)install your debian iso
2) create omv repo files (openmediavault.list, openmediavault-local.list, omv-plugins-org-fedaykin.list)
3) apt-get update
4) apt-get install postfix
5) apt-get install openmediavault-keyring
6) apt-get update
7) apt-get install xmlstarlet
8) apt-get install openmediavault

I answered the questions as follows

  • MD Arrays : All
  • scponly: yes
  • proftpd: from inetd
  • tftpd-hpa: /srv/tftp
  • openmediavault-local-list: Y

9) service apache2 restart
10) ifconfig to find ip of omv

Then used  OVM-First Aid: to reset Web Password

OMV Plug Ins

As I was already logged in via SSH, it was easier to download the plugins deb and then install from there

We now have a full list of plugins

Thanks to cracklestick and tekkbebe on the Open Media Vault forums for give me a started on this post –

This has created a platform for the installation of Percona MYSQL and a headless XBMC, which I am having issues with taglib so can’t post at the moment.

Open Media Vault

Well I’ve been really busy with some other projects recently and some involve Open Media Vault in one way or another, so time to share.


Partkeepr is an electronics database which keeps track of all those components you have laying about and if your like me since I started playing with the raspberry pi that’s quite a few. Partkeepr needs and web server and a msyql database both or which are available on OMV!


Installation is pretty straight forward, just download the package and extract into your web directory then run the installer



Usenet indexers that need MYSQL and web server again.


Install is a little bit more complicated as there are two versions available, a free version then a paid for service.


Virtual Box

I’ve used this a lot on OMV to test the installations of the above. Highly recommended it.



MusicBrainz Server

I look at this for Headphones and it’s pretty straight forward if you already have the virtual box plug installed.


Download the package 6 gig then install appliance with in the OMV plug in


Other Open Media Vault tutorials are available here –


At the moment I am following this guide for a headless XBMC install which I will use with the excellent front end Maraschino –



All of this should let the server handle everything I’ve been playing with over the last six months!

Once I am happy with the installs I write a few more guides and update my old ones