Schema change release tomorrow 15 May, 1300UTC

Things have been quiet at MusicBrainz in the past few weeks, but don’t let this fool you! We’ve been working hard on getting the schema change release put together. We’re on schedule for releasing this tomorrow at 13:00 UTC, 15 May, 2013.

We’re going to start the release process at 1300UTC, but the site may not go down just yet then. We’ll get started once we have all of our ducks in a row — to get more updates from us before we start, please follow @musicbrainz on Twitter or join us in IRC at #musicbrainz on irc.freenode.net.

Thanks, and wish us luck for a smooth schema change tomorrow!

Server Update 2013-04-22 and a Notice Regarding Passwords

We’ve just finished deploying a new update to the MusicBrainz website, but before covering release notes we’d like to clarify a few points regarding the recent password leak.

There have been a few reports suggesting that MusicBrainz was attacked or compromised, but we can assure that this is not the case. As stated in our original blog post, we accidentally included private information in our otherwise routine public backups. As the majority of MusicBrainz data is available under the Creative Commons BY-NC-SA or CC0, these backups are intended to be public – the mistake was the human error in accidentally including password hashes.

A few of you also mentioned that we didn’t respond in a timely fashion in alerting users via emails. We completely agree with these comments, and apologise for not being able to respond quicker. Unfortunately, we did not have the infrastructure to do such mass mailing, and as we didn’t want to rush this out to the point of making yet more errors, it took us a little longer than we all would have liked.

With that out of the way, here’s what we’ve done in the last fortnight. Many thanks to Michael Wiencek, Nicolás Tamargo, and the rest of the MusicBrainz team for their work on this release.

Bug

  • [MBS-4277] – Guess Case: Keep uppercase option should be clearer
  • [MBS-4468] – “Enter vote” button incorrectly also adds edit note
  • [MBS-5597] – Funky Caps inConsisTency in Edit search paGes (presets or not)
  • [MBS-5832] – Rating not showing on Merge Recordings page
  • [MBS-5967] – No feedback after editing a user
  • [MBS-5998] – Barcodes incorrectly represented in mo RDF
  • [MBS-6077] – Reorder tracks edit not working
  • [MBS-6081] – Viewing MusicBrainz Events and Cover Art information makes the CAA launch event appear to the left of the actual graph
  • [MBS-6082] – “Remove Label” edit page has broken documentation link
  • [MBS-6100] – Internal server error with webservice requests which require authentication
  • [MBS-6111] – Amazon taking precedence over CAA after merging releases
  • [MBS-6121] – Logging in with non-ascii password throws exception
  • [MBS-6122] – Unable to merge release groups when cover art is set
  • [MBS-6169] – Check for edit user uses the wrong sub

Improvement

  • [MBS-4632] – Link to archive.org item from cover art tab
  • [MBS-4658] – Report: duplicate ISWCs
  • [MBS-5261] – Link to How to Add Disc IDs from the Disc ID tab of releases
  • [MBS-5667] – Rename “Other release groups”
  • [MBS-5800] – Remove restriction on entering standalone recordings
  • [MBS-6001] – Make the autoeditor election overview more useful
  • [MBS-6034] – label search is missing country column
  • [MBS-6086] – Setting cover art type (from nothing to something) should be an autoedit
  • [MBS-6109] – Work search doesn’t show type
  • [MBS-6110] – Relate To URL should auto-identify audiojelly.com as “can be purchased for download” relation.
  • [MBS-6119] – Seeing vote counts on closed elections shouldn’t require log in

New Feature

  • [MBS-1891] – Anchors/Permalinks on Edit Notes
  • [MBS-5737] – Notification when RE has created a release

Task

  • [MBS-6096] – Add soundtrackcollector.com to the Other Databases whitelist

The Git tag for this release is v-2013-04-11.

Server Update, 2013-04-08

We’ve just finished pushing out another fortnight of work to the main MusicBrainz servers. While work continues on the forthcoming schema change release, we have fixed a few bugs and added a few improvements. Thanks to Lukáš Lalinský and the rest of the MusicBrainz team for their work on this release! Here’s what’s changed:

Bug

  • [MBS-5524] – Edit relationship type edits are missing information for identifying the relationship type
  • [MBS-5830] – Attributes are not shown in relationship type edits
  • [MBS-5964] – Artist credit’s sort name tooltip doesn’t update after edit
  • [MBS-5980] – Cover art comments can make the cover art page look very unstructured
  • [MBS-5993] – name variation checks happen after HTML entity conversion
  • [MBS-6019] – Some FreeDB data getting wrongly imported from the dumps
  • [MBS-6021] – Track count search in Add Disc uses full release count for multi-disc releases
  • [MBS-6038] – "See all {num} {entity}" is just wrong i18n-wise
  • [MBS-6042] – Release country field in edit search breaks after doing a search
  • [MBS-6043] – In front page "Recent Additions" the text for the cover art pop-up labels (HTML title attribute) is wronlgy escaped
  • [MBS-6075] – An error occured while loading this edit

Improvement

  • [MBS-5613] – Set cover art page does not show enough information
  • [MBS-6039] – Make it possible to display attributes after the link phrase

Sub-task

  • [MBS-4258] – Make dates translatable

The Git tag for this release is v-2013-04-08.

Search server fixes released

Last week’s search server release had some bugs that we decided should be fixed sooner than later. Paul Taylor rose to the challenge and fixed 4 important bugs and we just finished releasing the updated code. Thanks for your efforts, Paul!

Release Notes – MusicBrainz Search Server – Version 2013-04-04

Bug

  • [SEARCH-279] – Seach server returning wrong results
  • [SEARCH-280] – Artist search DAVID BOWIE → FRANZ SCHUBERT (score 100) !? Bowie (score 0)
  • [SEARCH-281] – If set explain=true option with dismax search it actually does a non-indexed search

Improvement

  • [SEARCH-267] – Create new rewrite method for Dismax FuzzySearch

Picard 1.2 released

Version 1.2 of Picard has been released today, with some notable features and bug fixes.

As announced recently, PUID support is being removed from MusicBrainz on October 15. This release of Picard has followed suit by removing all support for AmpliFIND/PUID scanning and submission. AcoustID is now the default (and only) method of scanning files. If you’re currently using AmpliFIND as your fingerprinting system, then after installing Picard 1.2 you must enable AcoustID in your options, under the “Fingerprinting” section.

Those who have the Picard cover art plugin installed will likely want to remove it. Picard 1.2 has built-in support for downloading cover images from a variety of sources, without the need for a plugin. Please see the new configuration under Options -> Cover Art.

Something important to note for people who build/package Picard is that Python 2.6 is now the minimum required version.

Special thanks to Wieland Hoffmann, Laurent Monin, Lukáš Lalinský, and everyone who’s helped contribute/report bugs for this release!

Picard 1.2 can be downloaded at:
http://musicbrainz.org/doc/MusicBrainz_Picard

Changes since 1.1:

  • Picard now requires at least Python 2.6
  • Removed support for AmpliFIND/PUIDs
  • Add support for the Ogg Opus file format
  • It’s now possible to download cover images without any plugin. Cover Art Archive images can be downloaded by image type
  • Improved directory scanning performance
  • Prefer already-loaded releases of the same RG when matching files
  • Allow dropping new files onto specific targets
  • Add basic collections management support (PICARD-84)
  • Allow adding custom tags in the tag editing dialog (PICARD-349)
  • Fix replacing of Windows-incompatible characters (PICARD-393)
  • Save both primary and secondary release types (PICARD-240)
  • Handle errors from the AcoustID service better (PICARD-391)
  • Accept HTTPS URLs on drag-and-drop (PICARD-378)

Updated search server now live

We’ve just updated our search servers to the latest version. Thanks to Paul Taylor for his long hard work porting our code to Lucene 4.1. Big thanks also to Murdos and Nikki for helping with this release!

Also, we’ve installed a small gigabit ethernet switch for our search server cluster so that we can move new search indexes around much faster. Hopefully we will see indexes updating in just over 2 hours from now on.

Read on for all the details of this release:

Release Notes – MusicBrainz Search Server – Version 2013-03-29

Bug

  • [SEARCH-239] – Search updater doesn’t update the index last-updated value returned by SEARCH-232
  • [SEARCH-244] – Since the October Schema Change Release, search server is now returning empty join phrases when once doesnt exist , whereas before it didn’t display it all
  • [SEARCH-247] – Runtime Exception: The property or field count on the class org.musicbrainz.mmd2.Medium$TrackList is required to be included in the propOrder element of the XmlType annotation.
  • [SEARCH-263] – Search server applications do not gracefully disconnect from PostgreSQL on termination

Improvement

  • [SEARCH-217] – Allow searching and displaying of folksnomy tags for the release entity
  • [SEARCH-246] – Extend support for searching for blank parameters to ISWC and ISRC

New Feature

  • [SEARCH-228] – Let Dismax Search for Labels search Label Code

Task

Server update 2013-03-25

We’ve just finished deploying changes from the last fortnight. This release is mostly bug fixes, but we also have a bit more validation when entering label URLs and some improvements to reports. Many thanks to Alastair Porter, Frederik “Freso” S. Olesen, Lukáš Lalinský, Nicolás Tamargo, Paul Taylor, Pavan Chander and the MusicBrainz team for their work on this release. Detailed changes follow:

Bug

  • [MBS-4364] – Various Artists should not have a gender (and other attributes)
  • [MBS-4868] – Regression : « → view aliases » link disappeared from alias edits
  • [MBS-5947] – Changed AC display doesn’t detect unchanged gaps
  • [MBS-5953] – oauth: web application reauthorization creates table spam
  • [MBS-5958] – Release editor did something very very wrong
  • [MBS-5979] – Automatic redirect to beta clear release editor seeding
  • [MBS-5996] – Release and work level relationships getting mixed up in release pages
  • [MBS-6012] – Internal server error in Wikipedia extract
  • [MBS-6016] – browse works by invalid artist id causes an error

Improvement

  • [MBS-2535] – Lookup labels based on Label Code when entering releases
  • [MBS-4894] – Reject non-BBC Music URLs when using the BBC Music relationship
  • [MBS-5491] – Check for “vs.” and “feat.” in PossibleCollaborations report
  • [MBS-5912] – Report of releases with cover art relationships

Task

  • [MBS-5975] – Add Anime News Network Encyclopedia to “Other Databases” whitelist
  • [MBS-5976] – Add Generasia.com to the “other databases” whitelist

The Git tag for this release is v-2013-03-25.

Official schema change notification for 15 May, 2013

We’re nearly done implementing the SQL portions of our tickets for the upcoming schema change on 15 May, 2013. We’ve settled on the following tickets that we plan to release:

  • MBS-5861: Dynamic work attributes
  • MBS-3978: Support more than one barcode on same release
  • MBS-4756: Move the wiki transclusion index to the database
  • MBS-799: Location, venue and event support
  • MBS-3985: Support multiple artist countries
  • MBS-4925: Add country of birth and country of death to Artist (person)
  • MBS-4115: Cover art archive: Support .png SQL changes
  • MBS-1839: Track MBID SQL changes
  • MBS-5809: Add a “description” field to collections
  • MBS-5314: Drop the work.artist_credit column
  • MBS-5302: Store International Standard Name Identifier (ISNI, ISO 27729) for artists and labels
  • MBS-5528: Change short_link_phrase to long_link_phrase
  • MBS-2229: Allow multiple release events per release
  • MBS-2417: Support multiple countries/regions on a single release
  • MBS-5772: Generate relationship documentation (semi-)automatically
  • MBS-5848: Instrument credits

Each of the tickets above will give you a complete idea of how we plan to change our schema on May 15th. Questions? Post a question in the comments and we will answer it.

Finally, we are going to require that Postgres 9.1 will be the minimum version of Postgres going forward. I’ve spoken to many people about this and it seems that a large percentage of people are already using Postgres 9.1, so this should not be a major change.

Thanks!

Server Update, 2013-03-11

Thanks to work from Nicolás Tamargo, nikki, Lukáš Lalinský, Paul Taylor, and the MusicBrainz team, we’ve just released a new version of the MusicBrainz website. As usual, this is mostly a bug fix release, but we do have one shiny new feature once again… OAuth2! It is now possible to authenticate with MusicBrainz using this, rather than the old digest auth system. For more details, see the Development/OAuth2 documentation page. This feature is new, so if you encounter any problems (here or elsewhere), please be sure to let us know!

Here’s a full list of what’s changed:

Bug

  • [MBS-4155] – Clicking twice the same relationship link → Internal Server Error
  • [MBS-4419] – Memcached should not be used for persistent data
  • [MBS-5358] – Can’t enter fuzzy ending date in the same year as the start date
  • [MBS-5829] – Internal server error when requesting /tracklist/ with an invalid ID
  • [MBS-5856] – Reorder medium edits use “Disc”
  • [MBS-5866] – “Direct database search” for a new artist is missing at least Gender and Country
  • [MBS-5873] – Modbot recommending to merge label with an artist
  • [MBS-5875] – Internal server error approving an edit with no votes
  • [MBS-5877] – Internal server error when adding a release with a non-existent release group MBID
  • [MBS-5878] – Internal server error when doing tag lookup
  • [MBS-5884] – Internal server error when viewing editing history
  • [MBS-5896] – Error in Spanish even though the interface language is German
  • [MBS-5908] – Some Wikipedia extracts not appearing on translated MB
  • [MBS-5914] – Tagger icons are not showing up in tables
  • [MBS-5915] – Add ISWC/IPI buttons display incorrectly
  • [MBS-5938] – sever-side warnings generated on a proper client request on /ws/2/
  • [MBS-5939] – User applications page shows empty tables when there’s nothing to display
  • [MBS-5945] – oauth2: entering an invalid URI then switching to “Installed Application” fails to submit (silently)
  • [MBS-5946] – oauth: web applications don’t remember authorizations for the same scope
  • [MBS-5950] – Crappy-written multiple-artist paragraph on FreeDB import
  • [MBS-5951] – Display the actions column for applications the same as elsewhere on the site
  • [MBS-5954] – Confirm revoking OAuth access

Improvement

  • [MBS-950] – Only allow permitted sites for some relationships
  • [MBS-5020] – Report:: recordings linked to same work more than once
  • [MBS-5218] – Report: Duplicate dated/undated relationships
  • [MBS-5839] – Relate To URL should auto-identify beatport as “can be purchased for download” relation.
  • [MBS-5940] – Remove fref=ts from Facebook URLs
  • [MBS-5949] – Update the wording about deleting accounts

New Feature

Sub-task

  • [MBS-2917] – Report:Releases with unknown track times

Server Update, 2013-02-25

Thanks to work from Ben Ockmore, Frederik “Freso” S. Olesen, Michael Wiencek, Nicolás Tamargo, nikki, Sean Burke, and the MusicBrainz team, we’ve just released a new version of the MusicBrainz website. As usual, this is mostly a bug fix release, but we do have one shiny new feature… collection subscriptions! It is now possible to subscribe to your own collections, or other public collections, and receive daily emails summarizing edits recently made that might affect releases in these collections. This feature is new, so if you encounter any problems, please be sure to let us know!

Here’s a full list of what’s changed:

Bug

  • [MBS-3514] – Part of an edit was applied but not shown in preview nor in edit history
  • [MBS-3952] – Last Updated time is wrong on the Statistics page
  • [MBS-4543] – Seeding the create relationship page ignores some parameters
  • [MBS-4774] – Edit to swap two recordings creates a blank edit
  • [MBS-4947] – /edit/open won’t load
  • [MBS-5016] – Buttons misaligned in Firefox
  • [MBS-5309] – Not all artist credit changes are shown in tracklist edits
  • [MBS-5388] – Relationship editor allows linking an entity to itself
  • [MBS-5397] – Edit medium’s diff (insert track) : shows track duration change where there are none
  • [MBS-5402] – Country (and language) dropdown is sorted by English alphabet
  • [MBS-5461] – No space between releases in collection and button to remove them
  • [MBS-5520] – Translation problem on disc IDs page
  • [MBS-5547] – Relationship Editor: Can’t unselect orchestra type
  • [MBS-5560] – Internal server error (after creating recording-work relationship via relation-editor)
  • [MBS-5565] – Link to add new label is missing when there are results
  • [MBS-5677] – URL MBIDs missing from the webservice
  • [MBS-5726] – Internal server error when requesting /ws/2/discid in JSON
  • [MBS-5765] – Very long releases have bad release length parameters
  • [MBS-5787] – i18n: “This beta test server allows testing of new features with the live database” is untranslatable
  • [MBS-5799] – Relationship editor doesn’t allow adding multiple relationships with different attributes
  • [MBS-5815] – Use “Died” in edit artist page like on sidebar
  • [MBS-5819] – Instrument select in relat. editor requires accents
  • [MBS-5821] – i18n: work types are untranslatable inside the relationship editor
  • [MBS-5824] – Internal server error loading Wikipedia extract for page name containing &
  • [MBS-5825] – Internal server error when requesting an artist with a really large ID
  • [MBS-5828] – Internal server error on /chrome_frame
  • [MBS-5836] – Relationship editor accepts POST data containing mismatched entity/link type combos
  • [MBS-5842] – “Position” is untranslatable in add_cover_art.tt
  • [MBS-5880] – Internal server error for Wikipedia extract when Wikipedia page is a redirect
  • [MBS-5889] – Subscription summary test fails, does not check collection subscriptions

Improvement

  • [MBS-1955] – Sort relationship types tree
  • [MBS-2225] – Subscribe to collection
  • [MBS-3990] – Add a user preference for using beta version of MB
  • [MBS-4094] – Make artist credits more compact in edits
  • [MBS-5568] – Work types list should be sorted
  • [MBS-5644] – relationship editor : check all/several recordings and batch-add relationship to same work
  • [MBS-5759] – Make reorder cover art an auto-edit
  • [MBS-5823] – Work alias page doesn’t allow to select the guess case options

New Feature

  • [MBS-5833] – Show off the latest releases on the homepage

Task

  • [MBS-3856] – Revert MBS-1052 “Amazon should lookup cover art by barcode too”
  • [MBS-5802] – Add autoselect + sidebar links to VIAF
  • [MBS-5849] – Adding lyricsnmusic.com to the lyrics whitelist

Sub-task

  • [MBS-4270] – Release editor JS strings should be in text.js or similar so they are translatable
  • [MBS-4997] – Add lookup url to webservice
  • [MBS-5490] – CAA coverart over SSL

The Git tag for this release is v-2013-02-25.