One hand clapping » mp3

iTunes – Fixing ID3 tags in MP3’s – Take two

max — Sun, 03 May 2009 20:15:18 +0000

Overview

In these last three posts [1] [2] [3] I tackled fixing my existing MP3’s to make them more iTunes friendly. I did it with three Perl scripts using two different ID3 libraries : Audio::TabLib which is a Perl wrapper to KDE’s TagLib, and MP3::Tag.

I’ve since given up on MP3::Tag. Although updated recently, it still does not support ID3v2 2.4, which, unfortunately is the default in iTunes versions 7 and 8. So I’ve combined all three scripts into one script that only uses Audio::TagLib. One bonus of this, is that TagLib is a fast C++ library, and so the script runs a lot faster than a Pure Perl based method. One batch run on 160GB of MP3’s only took a couple minutes.

The Script

The following script does all three of the functions from my last posts :

Add Folder.jpg (or another image) to the MP3 for Cover Art
Convert version 1 tags (ID3v1) to version 2 (ID3v2)
Set the iTunes Compilation Flag (ICMP)

You can download the script here : http://warped.org/linux/mp3_fix_tag or copy paste from below :

#!/usr/bin/perl -w
# mp3_tag_fix
# Max Baker max@warped.org
# 5/3/09
 
$VERSION=1.1;
 
use File::Glob qw(:globally :glob);
use Audio::TagLib;
use Getopt::Long;
GetOptions (\%Args, "h|help", "f|front=s", 'b|back=s',
            'c|covers|addcovers','v1tov2', 'comp|compilation');
 
$Cover_Front = $Args{f} || "Folder.jpg";
$Cover_Back  = $Args{b} || "Folder_back.jpg";
 
die &usage if (! scalar @ARGV or $Args{h});
die &usage unless ($Args{c} || $Args{v1tov2} || $Args{comp});
 
foreach my $f (@ARGV) {
    if (-d $f) {
        recurse_dir($f);
        next;
    }
    go($f);
}
 
exit;
 
sub go {
    my $f = shift;
 
    # Only work on files that end in .mp3
    return if $f eq '.';
    return if $f eq '..';
    return unless -r $f and $f =~ /\.mp3$/i;
 
    print "  $f\n";
 
    my $mp3 = Audio::TagLib::MPEG::File->new($f) or die;
    my $id3v1 = $mp3->ID3v1Tag(1);
    my $id3v2 = $mp3->ID3v2Tag(1);
 
    # Cover Art
    if ($Args{c}) {
        #print "    --> Adding Cover Art\n";
        add_image($id3v2,$f,"$root/$Cover_Front","FrontCover","Cover (front)") if -r "$root/$Cover_Front";
        add_image($id3v2,$f,"$root/$Cover_Back", "BackCover", "Cover (back)")  if -r "$root/$Cover_Back";
    }
 
    # Copy v1 tags to v2
    if ($Args{v1tov2}) {
        print "    --> Copying ID3v1 data to ID3v2\n";
        $id3v2->setArtist(Audio::TagLib::String->new($id3v1->artist)) if nb($id3v1->artist);
        $id3v2->setAlbum(Audio::TagLib::String->new($id3v1->album))  if nb($id3v1->album);
        $id3v2->setTitle(Audio::TagLib::String->new($id3v1->title))  if nb($id3v1->title);
        $id3v2->setYear($id3v1->year)                                if nb($id3v1->year);
        $id3v2->setTrack($id3v1->track)                              if nb($id3v1->track);
        $id3v2->setGenre(Audio::TagLib::String->new($id3v1->genre))  if nb($id3v1->genre);
    }
 
    # Add/Replace TCMP - Compilation Tag
    if ($Args{comp}) {
        print "    --> Setting Compilation Flag\n";
        my $tcmp = Audio::TagLib::ByteVector->new("TCMP");
        $id3v2->removeFrames($tcmp);
 
        #my $f = Audio::TagLib::ID3v2::TextIdentificationFrame->new($tcmp, "UTF8");
        my $f = Audio::TagLib::ID3v2::TextIdentificationFrame->new($tcmp);
        $f->setText(Audio::TagLib::String->new("1"));
        $id3v2->addFrame($f);
    }
 
    $mp3->save();
}
 
sub recurse_dir {
    my $root = shift;
 
    print "Entering $root\n";
 
    # bsd_glob handles spaces in file names/paths
    my @files = bsd_glob("$root/*",GLOB_QUOTE);
    foreach my $f (@files) {
        if (-d $f) {
            recurse_dir($f);
            next;
        }
        go($f);
    }
}
 
# not blank or undef
sub nb {
    my $string = shift;
    return 0 unless defined $string;
    return 0 if $string =~ /^\s*$/;
    return 1;
}
 
sub add_image {
    my ($id3v2,$f,$img,$type,$desc) = @_;
 
    print "    --> add_image($type) $img -> $f\n";
 
    open(PICFILE, "< $img") or die "Can't open image $img. $!\n";
 
    my $imgdata;
    my $filesize = -s PICFILE;
    binmode(PICFILE);
    read(PICFILE, $imgdata, $filesize);
    close(PICFILE);
 
    my $imgbv = Audio::TagLib::ByteVector->new();
    $imgbv->setData($imgdata,$filesize);
    my $bv = Audio::TagLib::ByteVector->new("APIC");
    my $field = Audio::TagLib::ID3v2::AttachedPictureFrame->new($bv, "UTF8");
    $field->setPicture($imgbv);
    $field->setTextEncoding("UTF8");
    $field->setMimeType(Audio::TagLib::String->new("image/jpeg"));
    $field->setType($type);
    $field->setDescription(Audio::TagLib::String->new($desc));
    $id3v2->addFrame($field);
}
 
sub usage {
    return < < "end_usage";
USAGE: $0   [options]
 
mp3_tag_fix Version $VERSION
 
This script is used to fix up MP3 files for use in iTunes.
 
It can do the following things :
    * Recursively go through a directory and embed album art 
    * Copy ID3v1 tag data into ID3v2
 

    -c | --addcovers - Embed $Cover_Front / $Cover_Back into the MP3
    --v1tov2         - Copy ID3v1 Tags into ID3v2 Tag
    --comp           - Set iTunes Compilation flag (TCMP)
 
[OPTIONS]
    -f - The name of the image to look for in each dir to embed front-covers
    -b - The name of the image to look for in each dir to embed back-covers
 
Max Baker max\@warped.org 5/3/2009
end_usage
}
commands>cmd>

Prerequisites

See the Prerequisites section on this post.

iTunes – Copying ID3 Tags in your MP3s from ID3v1 to ID3v2 in Perl

max — Sun, 03 May 2009 00:24:42 +0000

Update

I’ve consolidated this script into a new one. GO HERE : http://warped.org/blog/2009/05/03/itunes-fixing-id3-tags-in-mp3s-take-two/

Overview

MP3’s have been around almost 15 years now. In the beginning there was a slot in the top of the MP3 file where you could hold the Artist, Album Name, Title, Track Number, etc. This is called the ID3 tag, and is part of every MP3 file. Fast forward some years and the ID3 standard has changed a number of times from V1 to V2 to V2.2, V2.4, etc.

iTunes sucks. iTunes will only use the ID3v2 information in your file, even though the other info is present and perfectly usable. Thanks Apple. FAIL.

The Script

The following script is based on this one by Bob of the UK : http://rnewson.blogspot.com/2005/10/itunes-artwork-fetcher.html

#!/usr/bin/perl -w
# Based on http://rnewson.blogspot.com/2005/10/itunes-artwork-fetcher.html
use MP3::Tag;
 
# Bug that you may need to patch for : https://rt.cpan.org/Ticket/Display.html?id=45647
 
 
foreach my $file (@ARGV) {
    next unless -r $file;
    id3v1_to_id3v2($file);
}
 
sub id3v1_to_id3v2 {
    my $file = shift;
 
    print "$file\n";
    my $mp3 = MP3::Tag->new($file);
    $mp3->get_tags;
    $mp3->config('write_v24',1);
    my $id3v1 = $mp3->{ID3v1};
    my $id3v2 = $mp3->{ID3v2};
    $id3v2 = $mp3->new_tag("ID3v2") unless defined $id3v2;
 
 
    # === TIT2 (Title/songname/content description): Sordid
    # === TPE1 (Lead performer(s)/Soloist(s)): Amon Tobin
    # === TALB (Album/Movie/Show title): Funkungfusion: Ninja Cuts, Vol
    # === TYER (Year): 1998
    # === TRCK (Track number/Position in set): 2
 
    copy($id3v2, 'TPE1', $id3v1->artist);
    copy($id3v2, 'TALB', $id3v1->album);
    copy($id3v2, 'TCON', $id3v1->genre);
    copy($id3v2, 'TRCK', $id3v1->track);
    copy($id3v2, 'TIT2', $id3v1->song);
    copy($id3v2, 'TYER', $id3v1->year);
    copy($id3v2, 'COMM', 'ENG', $id3v1->comment,$id3v1->comment) if $id3v1->comment;
    $id3v2->write_tag;
    $mp3->close;
}
 
sub copy {
   my ($id3v2, $frame, @data) = @_;
    my $value = $data[0];
    return unless defined $value;
    return unless $value !~ /^\s*$/;
 
    my $frameids = $id3v2->get_frame_ids;
    if (exists $$frameids{$frame}) {
        print "  Changing $frame to @data\n";
        $id3v2->change_frame($frame, @data);
    } else {
        print "  Adding $frame = @data\n";
        $id3v2->add_frame($frame, @data);
    }
}

Prerequisites

This script uses MP3::Tag. I had to patch it to work around a bug. See my post on setting the compilation tag for details.

iTunes – Setting the Compilation Flag on MP3’s using Perl

max — Sun, 03 May 2009 00:10:13 +0000

Update

I’ve consolidated this script into a new one. GO HERE : http://warped.org/blog/2009/05/03/itunes-fixing-id3-tags-in-mp3s-take-two/

Overview

If you have an album that’s a compilation or DJ mix, then Cover Flow gets confused and does not group all the tracks together into an album because there is a different “Artist” for each track.

iTunes gets around this by setting it’s own custom flag in the ID3 tag : the TCMP frame in ID3v2 to be specific.

The Script

The following script uses MP3::Tag to set the TCMP flag on all the MP3’s in the current directory, or the files specified on the command line.

#!/usr/bin/perl -w
# mp3_make_comp
# Max Baker
# 4/29/09
#
# This script will set the I-Tunes Compilation Tag (TCMP)
# on Files passed to it.   If no files are passed, it works on *.mp3 in the current directory.
#
 
use MP3::Tag;
 
unless (scalar @ARGV) {
    @ARGV = glob("*.mp3");
}
 
foreach my $f (@ARGV) {
    next unless -r $f;
    add_comp($f);
}
 
sub add_comp {
    my $file = shift;
    my $mp3 = MP3::Tag->;new($file);
    $mp3->;config('write_v24' =>; 1);
 
    # scan file for existing tags
    $mp3->;get_tags;
 
    unless (exists $mp3->;{ID3v2}) {
        $mp3->;new_tag("ID3v2");
    }
 
    # check for existing tag
    my ($info, $name, @rest) = $mp3->;{ID3v2}->;get_frame("TCMP");
    if (defined($info)) {
        print "$file : TCMP=$info already set.\n";
        return;
    }   
 
    print "$file : Setting TCMP=1\n";
    $mp3->;{ID3v2}->;add_frame("TCMP", "1") or die "$file : Adding TCMP frame failed.\n";
    $mp3->;{ID3v2}->;write_tag;
    $mp3->;close();
}

Prerequisites

I managed to find a bug in MP3::Tag, so you may have to do the patch found here.

$data = pack("N", length($data)) . compress $data
unless $frame->;flags->;{unchanged};

Becomes:

$data = pack("N", length($data)) . compress $data
unless $frame->;{flags}->;{unchanged};

On line 585 of ID3v2.pm.

Next Up : Copying ID3v1 tags to ID3v2 tags.

ITunes – Embedding Folder.jpg into your MP3s for Cover Flow

max — Thu, 30 Apr 2009 05:32:29 +0000

Update

I’ve consolidated this script into a new one. GO HERE : http://warped.org/blog/2009/05/03/itunes-fixing-id3-tags-in-mp3s-take-two/

Overview

Let’s say that you have a well organized MP3 collection that you previously used with something like nAMP / Apache::MP3 that already has album art in each directory. Or better yet, you have a friend who does!

You may have collected album art for every album that you have, but good old Itunes will not recognize that. It will only find album art based on the ID3v2 tags in the files, and if the album is available for purchase from Apple.

There are plenty of programs you can download to help you manually add album art to the MP3’s. But if you already have done this, it sucks to have to do it again.

The Script

This script in Perl will embed a Folder.jpg and a Folder_back.jpg to files for use in Itunes. It’s partially based on another script I saw. As soon as I found that again, I’ll add the attribution back in here.

#!/usr/bin/perl -w
# mp3_add_art
# Max Baker 
# 4/5/09
 
use File::Glob qw(:globally :glob);
use Audio::TagLib;
use Getopt::Long;
GetOptions (\%Args, "h|help", "f|front=s", 'b|back=s');
 
$Cover_Front = $Args{f} || "Folder.jpg";
$Cover_Back  = $Args{b} || "Folder_back.jpg";
 
die &usage if (! scalar @ARGV or $Args{h});
 
foreach my $d (@ARGV) {
    recurse_dir($d);
}
 
exit;
 
sub recurse_dir {
    my $root = shift;
 
    print "Entering $root\n";
 
    # bsd_glob handles spaces in file names/paths
    my @files = bsd_glob("$root/*",GLOB_QUOTE);
    foreach my $f (@files) {
        #print "'$f'\n";
        next if $f eq '.';
        next if $f eq '..';
 
        if (-d $f) {
            recurse_dir($f);
            next;
        }
        if (-r $f and $f =~ /\.mp3$/) {
            add_image($f,"$root/$Cover_Front","FrontCover","Cover (front)") if -r "$root/$Cover_Front";
            add_image($f,"$root/$Cover_Back", "BackCover", "Cover (back)")  if -r "$root/$Cover_Back";
        }
    }
}
sub add_image {
    my ($f,$img,$type,$desc) = @_;
 
    print "add_image($type) $img -> $f\n";
 
    my $mp3 = Audio::TagLib::MPEG::File->new($f) or die;
    my $id3v2 = $mp3->ID3v2Tag(1);
    open(PICFILE, "< $img") or die "Can't open image $img. $!\n";
 
    my $imgdata;
    my $filesize = -s PICFILE;
    binmode(PICFILE);
    read(PICFILE, $imgdata, $filesize);
    close(PICFILE);
 
    my $imgbv = Audio::TagLib::ByteVector->new();
    $imgbv->setData($imgdata,$filesize);
    my $bv = Audio::TagLib::ByteVector->new("APIC");
    my $field = Audio::TagLib::ID3v2::AttachedPictureFrame->new($bv, "UTF8");
    $field->setPicture($imgbv);
    $field->setTextEncoding("UTF8");
    $field->setMimeType(Audio::TagLib::String->new("image/jpeg"));
    $field->setType($type);
    $field->setDescription(Audio::TagLib::String->new($desc));
    $id3v2->addFrame($field);
    $mp3->save();
}
 
sub usage {
    return < < "end_usage";
 
mp3addart 
 
Max Baker max><max \@warped.org> 4/6/2009
 
This script recursively goes through a directory and imbeds album
art into MP3 Files. It uses taglib and Audio::TagLib.
 
USAGE: $0  [-f $Cover_Front] [-b $Cover_Back]
 
    -f - The name of the image to look for in each dir to embed front-covers
    -b - The name of the image to look for in each dir to embed back-covers
 
 
end_usage
}
dir>max>

Prerequisites

You’ll notice in the prerequisites a Perl module you can get off of CPAN : Audio::Taglib.
For which you’ll need the TagLib library.

You should install the TagLib library using packages. For me using Fedora/Mythdora 10 I used this command :

yum install taglib-devel

The only problem is that TagLib has moved on to version 1.5 and Audio::TagLib hasn’t quite caught up yet. So you need to modify one line in Audio::TagLib before installing it. The file you are editing is
Makefile.PL.

BEGIN {
    # a simple work around to perform the neccessary pre-check
    # instead of overloading subs of MakeMaker or other wrapper
    print STDERR "ONLY support TagLib version 1.4.*\n";
    require Carp;
	# FIXME
	# openned for FreeBSD, OS X (darwin) and Cygwin
    Carp::croak("$^O is not supported currently") 
		unless $^O eq 'linux' or $^O eq 'freebsd' or $^O eq 'darwin' or 
		    $^O eq 'cygwin';
	Carp::croak("Please install taglib C++ package first") unless 
		system("taglib-config --version") == 0;
	our $libver = qx(taglib-config --version);
	chomp($libver);
	Carp::croak("Please install taglib ver 1.4.*") unless 
		$libver =~ m/^1\.4/io;
	our $libs = qx(taglib-config --libs);
	our $inc  = ' -I/usr/include -I./include -I. '. qx(taglib-config --cflags);
}

BECOMES :

BEGIN {
    # a simple work around to perform the neccessary pre-check
    # instead of overloading subs of MakeMaker or other wrapper
    print STDERR "ONLY support TagLib version 1.4.*\n";
    require Carp;
	# FIXME
	# openned for FreeBSD, OS X (darwin) and Cygwin
    Carp::croak("$^O is not supported currently") 
		unless $^O eq 'linux' or $^O eq 'freebsd' or $^O eq 'darwin' or 
		    $^O eq 'cygwin';
	Carp::croak("Please install taglib C++ package first") unless 
		system("taglib-config --version") == 0;
	our $libver = qx(taglib-config --version);
	chomp($libver);
	Carp::croak("Please install taglib ver >1.4.*") unless 
		$libver =~ m/^1\.[45]/io;
	our $libs = qx(taglib-config --libs);
	our $inc  = ' -I/usr/include -I./include -I. '. qx(taglib-config --cflags);
}

So that Version 1.4 and 1.5 are OK. Some tests fail, but otherwise it seems to work fine for me.

Next up : Setting the compilation Flag from a script.