MusicBrainz Tagger 0.10.2

The 0.10.2 version of the tagger fixed a number of problems from the 0.10.1 version.

This version fixes a few important bugs from the 0.10.1 version.  Files that were
tagged by clicking on the tag icon may have incomplete artist sortname and artist id
tags.  The saved tab can now be sorted by clicking on the header fields, and the
filename in the tabs will never be cut off — now it gets reasonably truncated
and the most important info should always be visible.  Finally FLAC tagging had
some bugs where tags were getting cleared or not written to disk.

Bugs and RFEs Closed

Robert Kaye

Server Updates

Moderation Search; Add Album gets “Guess” buttons; a new “moderation suggestions” report.

Changes mainly of interest to MusicBrainz Users

Moderation Search

Previously it was only possible to list moderations using one of a number of
fixed means: for example, “New Mods”, “FreeDB Mods”, “Artist Mods”
etc.  Now, all of these have been replaced a rather flexible
Moderation Search facility.

Moderation Search allows you to find moderations according to any
combination of the following criteria: moderation status, automod flag,
moderation type, moderator, vote cast (by you or anyone else),
artist (including “my subscribed artists”), and moderation ID (range).
You can also query by album, or by track.
Finally you can choose whether to show them oldest to newest, or the other
way round.  The number of possible combinations is
simply astronomical.

The old, fixed search types (“New”, “FreeDB” etc) now simply pre-fill the
search form with the appropriate values.  So for example, you can run
one of the preset searches (say, “My Failed Mods”), and then click “Advanced
Search” to customise your current search in whatever way you please.
There’s a new page which lists
the presets.  If you like you can set a new
preference
to cause the “Moderate” link in the top navigation bar to
go to that page instead of running the “New Mods” query.

Some other points of note:

  • Many more queries than before are possible.  For example, show me
    moderations by (some moderator name) which I haven’t voted on yet; or, show
    me (some moderator name)’s automods only.
  • Many of the moderation URLs have now moved.  Hopefully all the links on
    the site have been updated, but if you do hit an old link (e.g. in an old
    “subscriptions” e-mail) you should get redirected.
  • The “subscriptions” e-mails now contain an extra link, which is
    effectively like “New Mods”, but for your subscribed artists only.
  • There’s now a page where you
    can search for moderators
    (so you can include them in your
    search).  Interestingly this is currently the only place in the whole
    site where you can effectively “browse moderators”.  No doubt a page
    dedicated to doing just that will be added some time in a future release.
  • Sometimes your moderation searches may “time out” – just like normal
    searches (for tracks, etc) the search is cancelled if it’s still running
    after 30 seconds.  If this happens, try narrowing down your search,
    maybe by using the “moderation ID” filter (e.g. only where the ID is at
    least 530000).

Add Album

The manual “Add Album” pages now have “Guess Case” and “Guess Sortname”
buttons.

Other Changes

Previously only two statistics were recorded for each moderator; a count of
“accepted moderations”, and one of “failed moderations”.
Now the “accepted” count has been split into two, one for auto-moderations,
and one for the rest; and the “failed” count has also been split into two,
one for “failed vote” moderations, and one for the other types of
failure.  For example, see your own profile page.

When moving an album to another artist, the original artist is no
longer shown in the search results (bug #576354).

Each moderation type has a name, and just to ensure that the name of each
type is unique, two of the types have been renamed.
Previously there were two types of “Add Track” (one used up to
17th August 2001, and one used thereafter); now the former is called
“Add Track (old version)”.
Additionally there are in fact two types both known as “Merge Albums” (one
for single-artist albums, and one for Various Artists).
The latter is now called “Merge Albums (Various Artists)”.

The “auto-notes” added by the Album Editor (e.g. “The first of a set
of 3 moderations”) were previously recorded against the moderator’s own
name; now, they are added by the ModBot.

If you use the “compact” album listing, then manually switch to a “full”
listing, the expand/collapse links now work, instead of switching you back
to a “compact” listing.

There is now a new moderation suggestions report, called “Superfluous Data
Tracks”.  Thanks to our script/report writer,
Matthias Friedrich, for
this.  This report lists albums which include a final “data track”,
but have no Disc ID.

Also in the are of suggestions reports: the “bad entries” report
now does HTML-escaping properly.  The “unknown” report also now does
this; it also runs much more efficiently, shows counts of how many tracks
and artists it found, and correctly includes the page footer.

Voting more than once on a moderation sometimes caused that moderation to
show up twice when it should not – this is now fixed (bug #829524).

New and Changed Documentation

Changes mainly of interest to MusicBrainz Server Programmers

Added help text to the INSTALL file and to MBImport.pl, stating that
the current live SQL scripts must be used to import a live dataset.

RDFDump – the RDF dump file (link) is now valid XML. Previously it tried to
put long lines of hyphens (“—–” etc) within a comment (bug #829181).

Bugs and RFEs Closed

Dave Evans

MusicBrainz Tagger 0.10.1

The 0.10.1 version of the tagger fixed a number of problems from the 0.10.0 version.

This version fixes a number of bugs from the 0.10.0 version.  Some MP3s
would have corrupted ID3 tags after being tagged with the tagger – this is now fixed. 
If you have any files that got corrupted by the tagger, download and install this new
version, and then enable the ‘clear tags before writing’ option.  Then re-identify all of
the corrupt files and write new tags.

Also, tagging Ogg Vorbis files would crash fairly often, and tagging via proxy was also broken.  Both of these are now fixed.

Bugs and RFEs Closed

Robert Kaye

Server Updates

The “Album Editor” has landed! Plus a bunch of other bug fixes and updates.

Changes mainly of interest to MusicBrainz Users

Album Editor

The Album Editor lets you edit all sorts of aspects of an album on (almost)
one screen.  Currently this means you can edit the album name and
attributes, and the track names and numbers (and yes, there are lots of “Guess
Case” buttons to play with).  You can also add and remove tracks. 
The Album Editor is found under a link called “Edit All” on each album.

So far there are a few limitations which you should know about:

  1. It only works for single artist albums
    (don’t worry, there will be a multiple-artists version).
  2. When you click the “Enter Moderations” button when you’re done,
    you still get the same moderations we currently have – for
    example, 1 x “Edit Album Name” + 10 x “Edit Track Name” + 1 x “Edit Album
    Attributes”.  A future version will probably enter a single
    “Modify Album” moderation encompassing all of these things, in order to
    (hopefully) make voting easier. 
    See bug #816269.
  3. You can’t use the Album Editor on [non-album tracks].

Other Changes

If you choose to show the whole album when reviewing “Add Album” mods,
there is now an extra preference which, when enabled, causes the “Edit” links
to be shown on those albums.  This saves a page load when you want to
edit the album, at the expense of making the moderation pages a bit bigger.

“Merge Artists” mods now merge by artist ID, not name.  This means that
if the target artist is renamed whilst the merge is open, then the merge
should still succeed.  Also, both the source and destination artists are
marked as “mod pending”.

“Remove TRM Id” mods were previously problematic if they had to be undone
(e.g. if they failed the vote).  This has now been fixed.  If the
TRM cannot be re-added then the ModBot may note “Unable to re-insert
TRM”.  This will only happen on “Remove TRM Id” mods inserted before this
server update, but closed after; mods inserted after the update will be OK.

When the ModBot added a note to your moderations the e-mail used to say:
“Unfortunately moderator ‘ModBot’ has not supplied their e-mail address,
so you can’t reply to them.”.  This message has been removed.

The “page selector”, used on the moderation pages and the browse artists /
browse albums pages, now appears both above and below the things you’re
browsing.

When moving a Disc ID, [non-album tracks] releases are now not offered as a
possible place to move it to.

“Guess Case” now also knows about the following words:
album original single (lower case, if inside brackets);
ft. (becomes feat.); and finally, LP EP BWV and the Roman numerals I to X.

Changes mainly of interest to MusicBrainz Programmers

Nothing new in this release.

Changes mainly of interest to MusicBrainz Server Programmers

When DBDefs::DB_STAGING_SERVER is set, a “Debug” link appears in the nav
bar.  This takes you to /debug.html, a page which displays your session
data etc.  Currently the debug.html page can be accessed even on the live
server, but this may change in future.

Bugs and RFEs Closed

Dave Evans

Server Updates

Various improvements to the tagger lookup pages, the voting system, data accuracy and all sorts of other things.

Changes mainly of interest to MusicBrainz Users

Album “Meta” Counts

The count of tracks, disc ids and TRMs held for each album (the “albummeta”
data) was often inaccurate.  Additionally, some albums didn’t have an
“albummeta” row, which actually caused them to disappear entirely from their
respective artists’ pages!  These bugs have now been fixed.

The “compact” display mode of the “show artist” page displays these counts; if
one of the counts is zero it now just leaves a blank space, instead of showing
a zero and the relevant icon.  This makes it easier to spot which albums
have no disc ids or no TRMs.

Like the “compact” display mode, these meta counts are now also shown when you
perform an album search.

Non-Album Tracks

The album name “Non-album tracks” is now changed to “[non-album tracks]”, in
keeping with the style of using “[…]” to signify special meaning within
MusicBrainz (e.g. [silence], [data track] etc).

As new N.A.T. albums are created, they (i.e. the album name itself) won’t be
added to the search indices (although the tracks within them will be).  The
existing N.A.T. album names are staying in the indices, for now, but may be
removed soon.

If two artists, both with N.A.T. albums, are merged, then the two N.A.T.
albums are merged together, keeping all the tracks.

Previously if the track numbers of non-album tracks for an artist were not
continuous (if there were “gaps”, e.g. 1, 2, 4, 5) then adding a N.A.T. would
fail.  This is now fixed.

N.A.T. albums are automatically deleted when their last track is removed.

The “show track” page no longer shows the (meaningless) track sequence number
for non-album tracks.

The Tagger

The %-relevance values shown in the lookup page now use the same more detailed
algorithm (weighted similarity calculation) that the Tagger itself
uses.  This should make the overall matching process more accurate.

When showing a list of matching tracks, the track length is highlighted
according to how well it matches the length of the track you’re trying to
tag.  Green indicates a good match, red represents a very bad match, and
blue is somewhere in the middle.  If insufficient information is
available, it’s black.

Also when showing match tracks, a “tag” link is included on that page, so you
don’t need to click through to the next page in order to tag.

The main lookup page (/taglookup.html) now moves the input focus into the form
when the page loads.

The sidebar search panel now works when used within the Tagger.

Voting

You can now vote more than once on each moderation.  Only your most recent
vote counts.  In other words, you can change your mind.  Because of this, you
must now wait until the moderation closes before you can see a list of all
votes for a moderation (on /showmod.html).  If it’s your moderation you can
always see the votes, of course.

Also on the “show moderation” page (/showmod.html) you can now see the date
and time at which each vote was cast.  If someone votes more than once (and
changes their mind), then the old, ignored votes are shown in grey.

It’s now also possible to have a “No Vote” button” – go to your preferences
page to enable it.  This makes it much easier to vote on a whole page of
moderations, but not vote on some of them (in which case, those moderations
will keep on showing up in your list of things to vote on).  This is
controlled by two new preferences: “Abstain by default” and “Show the ‘No
Vote’ option”.  Try out the four possible combinations to see how they work.

Miscellaneous

A “Search Google” link has been added to the “show album” and “show track”
pages.  These Google links now search for exact phrases, hopefully making it
easier to find what you want more quickly.  So for example if you click the
“search” link from this track, the search query used is “Alice in Chains” “Love, Hate, Love”.

Clicking on the album attributes link (which normally pops up the attributes
guide) now works without Javascript too.

“Remove Track” mods now show both the track name (with link) and the album
name (with link) – as long as the track still exists, anyway.

In the “batch operation” page (where you select what you want to do to the
albums you just tagged), if fewer than 2 albums are tagged, then we now show a
disabled “Select” button, instead of the message “Merge album not
available”.  This is more consistent with how such user interfaces
usually work.

“Guess Case” now knows to keep these abbreviations in upper case: DJ, MC, TV,
MTV.

The “top moderators” page now shows the top 25 moderators, not just the top
10.

There was a problem with anonymously adding albums; this is now believed to be
fixed.

Some moderators have proven that they can’t be trusted with the ability to
“automod” case-changes, because they make many case changes which go against
the style guide for no valid reason.  To handle this, a new “privilege” has
been created, dubbed the “Untrusted” bit.  Moderators given this bit cannot
automod anything, except for “Add TRMs”.

Incomplete home page URLs entered in moderators’ profiles are now “guessed”,
so for example http://www.example.com becomes http://www.example.com/

On the “create new login” page, a few paragraphs of help text have been added
about what we will and won’t do with your e-mail address.

You must be logged in to send a message to another moderator.

Changes mainly of interest to MusicBrainz Programmers

Some TRMs were associated with some tracks more than once.  This caused some
RDF queries to return duplicate results.  These duplicates have now been
removed, and the “insert” code has been modified to prevent them from
reappearing.

The “FindDistinctTRMID” RDF query was failing because returning TRMs as
results wasn’t properly handled.  This has now been fixed.

Changes mainly of interest to MusicBrainz Server Programmers

Mail is now generated using MIME::Lite instead of “hand-crafting” the headers
etc.  As well as making it much more likely that this is done correctly, it
also means that it will be much easier to use more advanced MIME capabilities
(e.g. HTML e-mail, attachments) in the future.

Unique database indices have been added to trmjoin (trm, track) and albumjoin
(album, track).  A primary key “id” column has been added to both
moderator_preference and moderator_subscribe_artist.

Tagger sessions are now automatically recognised by the web server, and an
“mbt=1” is written into the session data (even before the user has logged
in).  This is done by detecting the request to “/tagger/intro.html?mbt=1”,
which is the first page loaded by the Tagger, and which nothing else would
normally use.  This makes it possible to more reliably detect when the web
session is within the Tagger, and adjust accordingly (e.g. the sidebar search
panel).

Bugs and RFEs Closed

Dave Evans

MusicBrainz Tagger 0.10.0

The 0.10.0 version of the tagger sports a new cross platform core with many new features, bugfixes and general stability enhancements.

libtunepimp: new MB Tagger core

The tagger has undergone many changes since 0.9.0 — the most
important difference is that the core tagging features now
reside in the libtunepimp library and the MB Tagger is nothing
more than a glorified shell around libtunepimp. libtunepimp
compiles on Win32, Linux and Mac OS X and will be released
seperately in the next few days.

New/Improved Features

New features/changes include:

  • Uses new ID3 library for better stability.
  • FLAC audio format support (http://flac.sourceforge.net)
  • Better stability in Windows XP
  • Improved track recognition rates
  • Improved TRM collision support
  • User controllable TRM collision match threshold
  • User configurable Autosave threshold allows user to automatically
    save files with a similarity above the autosave threshold. This
    feature combined with a watch directory makes it convenient
    to automatically tag and cleanup incoming files.
  • File naming specifications have been improved to be more flexible. New format
    specifiers include: %sortname, $abc, $abc2, %abc3, %0num, %format
  • A separate various artist naming specifcation for naming
  • compilation albums differently from single artist albums

  • A new ‘Saved’ tab where saved files appear
  • User controllable Analyzer thread priority
  • Support for reading/tagging iTunes mp3 files

Bugs and RFEs Closed

Fixed TunePimp Bugs

Robert Kaye

Server Updates

Changes mainly of interest to MusicBrainz Users

  • The Style Guide has been updated.
  • When moderations fail the ModBot user now adds a note
    to the moderation stating the reason for the failure; for
    example, “This album has already been renamed” or “This track has been
    deleted”. 
  • While moderations remain open, the system now checks periodically to see
    if the moderations prerequisites and dependencies are still valid. 
    If they are not, then the moderation is immediately closed, and the ModBot
    adds a note to explain what happened.  So far this has been
    implemented for the most common moderation types; it will of course be
    extended to include all moderations in future releases.  This change
    should help to solve most of the problems relating to dependencies between
    moderations.
  • Moderation notes can now be longer than 255 characters.
  • The page formerly known as “Browse ‘Various Artist’ Albums” is now known
    as “Browse Releases”, and it can also browse single-artist releases
    too.  For example, you can now browse
    all soundtracks, regardless of artist.
  • When modifying your profile, it is now possible to remove your e-mail
    address from the system.
  • Forgot your password?  We can
    e-mail it to you
    (as long as you know your login name, and you’ve
    previously entered and confirmed your e-mail address).
  • When entering track names, the input fields are now limited to 255
    characters, to match the limitation on the underlying database. 
    Previously sometimes people would enter moderations to change the track
    name to something longer than 255 characters, but the moderation would
    then always fail.
  • When viewing a moderation in detail, you
    can now see votes cast on your own moderations.
  • A “Merge this album” link has been added to the main album display page
    (showalbum.html).  If you get to the “Batch Operation” page with
    fewer than two albums tagged (i.e. “merge” is not available yet), then
    now a “Select more albums” link is also shown.  Hopefully these two
    changes together make it more obvious how to merge albums.
  • The statistics page now includes a breakdown
    of open moderations by moderation type.
  • Your profile page has moved. 
    The “view” and “edit” profile pages are now separate. 
    The “view” page now shows some voting statistics. 
    You can now list other moderators’ votes –
    Try it!
    (Having said that though I’m not really happy with this feature yet,
    since it shows the other user’s vote as being “your” vote,
    and then doesn’t let you vote as a result.  Caveat emptor.)

Specific changes to particular moderations:

  • When adding an artist alias, the system checks that the alias name
    does not already exist (for this, or any other, artist). 
    MusicBrainz does not support duplicate aliases (yet).
  • “Add Artist Alias” mods will fail (possibly before voting is over) if
    the alias name is seen to already exist, or the referenced artist is deleted.
  • “Change Track Artist” mods will fail (possibly before voting is over)
    if the track is deleted or merged away,
    or the track’s artist is changed by some other mod.
  • “Edit Album Name” mods will fail (possibly before voting is over)
    if the album is deleted or merged away,
    or the album’s name is changed by some other mod.
  • “Edit Artist Name” mods will fail (possibly before voting is over)
    if the artist is deleted or merged away,
    or the artists’s name is changed by some other mod,
    or an artist with exactly the same “new” name is found to exist.
  • “Edit Track Name” mods will fail (possibly before voting is over)
    if the track is deleted or merged away,
    or the track’s name is changed by some other mod.
  • “Convert Album to Single Artist” mods will fail (possibly before voting is over)
    if the album is deleted or merged away,
    or the album is moved to another artist (i.e. not “Various Artists”).
  • “Merge Artists” mods will fail (possibly before voting is over)
    if the old artist is deleted or merged away,
    or the old artist’s name is changed by some other mod,
    or the old and new artist are somehow the same,
    or the old artist is “Various Artists” or the “Deleted Artist”,
    or no artist with the “new” name is found to exist,
    or the new artist is the “Deleted Artist”.
  • “Convert Album to Multiple Artists” mods will fail (possibly before voting is over)
    if the album is deleted or merged away,
    or the album is already “Various Artists” (changed by some other mod),
    or the album’s artist is changed by some other mod.

Changes mainly of interest to MusicBrainz Programmers

  • The ‘showtrack.html’ page now also accepts a ‘?mbid=GUID‘ argument,
    like the artist and album pages already did. 
    Try it.
  • Certain URLs can now be used to retrieve both the RDF and the HTML
    versions of the data; which is retrieved depends on the “Accept” HTTP
    header.  Alternatively, the “?content-type” parameter can be
    specified to force the selection of a particular variant.  For
    example:

    The URLs that can be used in this way are:

    • /artist/GUID
    • /album/GUID
    • /track/GUID
    • /trm/GUID
    • /discid/GUID
  • New documentation has been added.
  • Documentation has been updated.

Changes mainly of interest to MusicBrainz Server Programmers

  • When
    InitDb.pl
    runs the various SQL scripts, it now timestamps the
    script output.  By also adding the “–echo” argument (e.g.
    ./admin/InitDb.pl --createdb --echo --import *.tar.bz2)
    the SQL commands are echoed too.  These changes are intended to make
    it easier to see how the import is progressing, and to see why it’s
    taking so damn long 😉
    Also it no longer attempts to create the database user if it already
    exists.
  • The “ModBot” code now lives in its own module, namely
    MusicBrainz/Server/ModBot.pm
    It (via the
    ./admin/CheckVotes.pl
    script) now accepts command line arguments such as “–verbose”. 
    Sadly this doesn’t include “–help” (yet), so just take a peek at the code
    to see what’s on offer.
  • The code which merges artists has moved from
    MOD_MERGE_ARTIST.pm
    into
    Artist.pm
  • The
    FreeDB.pm
    code has been tidied up a little.
  • Sql.pm
    now complains if your use of “AutoCommit”, “Begin”, “Commit” and
    “Rollback” isn’t to its liking.
  • When a change is made to one of the style sheets, just run
    ./admin/UpdateStyleSheetLinks
    to force all clients to reload the style sheets next time around.
  • A bug in
    comp/topmodsbox
    has been fixed whereby if there have been no
    moderations recently (e.g. on a development box), then the cache code
    failed, causing the component to (expensively) re-query the data on every
    request.
  • &DBDefs::DB_STAGING_SERVER is no longer just true or false. 
    If it’s true, it should be set to the name of the type of server this is,
    e.g. “development”, “test”, etc.

Dave Evans