Server update, 2013-11-11

Another fortnight, another release; thanks to Freso, warp, bitmap, reosarevok, and the MusicBrainz team for their work!

The tag for this release is v-2013-11-11. We had some small problems during release; sorry to anyone who ran into an error during the short period before we reverted things to get our server configurations in order!

Bug

  • [MBS-4438] – Release editor: Track durations are not loaded the first time you access the recordings tab
  • [MBS-5592] – Relationship editor permits multiple identical relationships
  • [MBS-6066] – Random internal server errors when searching
  • [MBS-6298] – ‘View all relationships’ links to a tab that’s not in the list of tabs
  • [MBS-6449] – Logic for showing “at least” in the edit search for the number of results is wrong
  • [MBS-6661] – work_attribute check is wrong
  • [MBS-6673] – Cover art uploading not working in IE
  • [MBS-6689] – Pasting an MBID initiates a search
  • [MBS-6769] – Inline search shows sort name even when identical to name
  • [MBS-6785] – Tagger button broken in Opera
  • [MBS-6851] – Can’t relate recordings to places in the relationship editor
  • [MBS-6858] – Relationship type documentation not accessible
  • [MBS-6872] – Tags page does not show places
  • [MBS-6873] – delete_unused_url and delete_orphaned_recordings don’t account for places
  • [MBS-6878] – Inline search check for non-latin characters treats Vietnamese characters as non-latin
  • [MBS-6883] – Relationship editor fails to load existing relationships
  • [MBS-6884] – Guess case treats “studio” in place names as extra title information
  • [MBS-6892] – Relationship editor needs “(more documentation)” link after relationship type description
  • [MBS-6900] – Cannot edit places with empty coordinates
  • [MBS-6901] – Places lat/long parser does not understand »+55° 54′ 14.49″, +8° 31′ 51.64″«
  • [MBS-6905] – beta: Comma shown in coordinates field when editing places with no coordinates
  • [MBS-6907] – beta: Coordinates parsing should not require seconds
  • [MBS-6908] – Internal server error searching for multiple editor flags in the edit search
  • [MBS-6909] – “Editor flag is not” in edit search does not work
  • [MBS-6914] – beta: Clicking result in inline search hides popup instead of selecting result
  • [MBS-6916] – beta: No dropdown in inline search when there are no results
  • [MBS-6921] – Artist Credit join phrase not displayed in tracklist

Improvement

  • [MBS-1421] – Require an edit note for all destructive edits
  • [MBS-2985] – Report: download relationships in non-digital releases.
  • [MBS-6239] – Use Wikidata URLs to fetch interwiki links
  • [MBS-6353] – Display on release group merge edit the same info displayed on merge preview page (mainly release group types)
  • [MBS-6394] – Automatically cut out hyphens during ISRC addition
  • [MBS-6456] – Show country and subdivision when displaying areas in sidebar and on profile pages
  • [MBS-6554] – Uppercase letters when entering ISRCs instead of rejecting lowercase ones
  • [MBS-6771] – Use localised aliases in the inline search where possible
  • [MBS-6824] – Coordinate fields should understand and convert degree minute second format
  • [MBS-6828] – Coordinates should be editable as one field
  • [MBS-6830] – Coordinate fields should strip degrees signs
  • [MBS-6831] – Coordinate fields should understand directions
  • [MBS-6832] – Coordinates should be presented better
  • [MBS-6838] – Release group dropdown in add release does not contain sufficient info
  • [MBS-6839] – Video attribute should be shown in merge recording edits
  • [MBS-6846] – Strip excessive digits in coordinates
  • [MBS-6859] – Inline search for places should show localised aliases
  • [MBS-6882] – Titles for video pages should say “Video”
  • [MBS-6911] – Make MB.Control.ArtistCredit a view model for knockout, use $.widget for MB.Control.Autocomplete

Task

  • [MBS-6729] – Add whosampled to the Other databases whitelist
  • [MBS-6893] – Add “Rockens Danmarkskort” to “Other databases” whitelist for Places

The BBC unveils a service that tweets to artists when their music is played…

… and it is built using MusicBrainz data! Michael Smethurst, a good friend of MusicBrainz, hacked up this service in the space of 2 days and writes:

The original idea came from a friend whose music occasionally gets played on Radio 1, 1xtra and 6Music. Almost always he missed this and either found out later from a friend or never found out at all. But he does use various bits of social media (including Twitter) to make contact with fans and promote his releases and live appearances.
. . .
To power online music services such as BBC iPlayer Radio, Playlister and /music the BBC uses metadata provided by MusicBrainz, a community maintained music encyclopedia. If you use Twitter and you’re a music artist or an agent or a publicist or similar and would like now playing notifications you need to check that your Twitter account handle is in MusicBrainz.

Thanks for creating such an awesome service, Michael. I know MusicBrainz contributors love how the BBC uses their data — I wish more people made such creative use of our data!

Fire damages the Internet Archive

A fire at the Internet Archive (our friends!) has caused $600,000 in damage. Fortunately no one was harmed and no data was lost:

A fire at the Internet Archive’s San Francisco scanning center has destroyed an estimated $600,000 of digitization and scanning equipment. Fortunately no one was injured in the blaze, but the property damage has ruined “some physical materials” that were yet to be digitized, and restricted the nonprofit organization’s ability to record the history of the web.

MusicBrainz just donated $50 to the Internet Archive and asks you to consider making a donation as well.

VMWare image of 2013-10-14 release available

I’ve released the VMWare version of the 2013-10-14 schema change release:

This VM is 8.7GB large and is built on the latest version of VMWare (Fusion in my case). If you’re using a VMWare product, then use this image.

The documentation for this VM has been updated to reflect the latest changes. Please make sure to read this page while you wait for your download!

New VirtualBox image of MusicBrainz server 2013-10-14 available

I’ve released a new Virtual Machine of the MusicBrainz server, based on the recent 2013-10-14 schema change. You can download the updated virtual machine here:

This VM is 10GB large and is built on the latest version of VirtualBox. Due to continuing incompatibilities between VMWare Fusion and VirtualBox, I am going to create a separate VMWare base virtual machine soon. I’m waiting for a vagrant-vmware-fusion license key and once I have that I will build the VMWare version and upload that as well.

The documentation for this VM has been updated to reflect the latest changes. Please make sure to read this page while you wait for your download!

Server update 2013-10-28

With the schema change well past us, we’re finally back into normal development mode. This release contains more bug fixes to new features from the schema change, as well as an assortment of improvements and general bug fixes to the rest of the site. Many thanks to Nicolás Tamargo and the MusicBrainz team for their work on this release. Here’s what’s changed:

Bug

  • [MBS-5439] – ISE: Adding a release with a track of 0 length
  • [MBS-5658] – Various Artists used for track artists when adding release via disc ID lookup
  • [MBS-5926] – Collection names are shown for subscribed private collections
  • [MBS-6810] – add work alias (not ended) error
  • [MBS-6813] – can’t see these recordings edit history (Internal Server Error)
  • [MBS-6816] – Place type stats display is broken
  • [MBS-6818] – Cannot cancel edit (Internal Server Error)
  • [MBS-6821] – ISE when searching video:true
  • [MBS-6823] – Report title for SingleMediumReleasesWithMediumTitles is wrong
  • [MBS-6826] – Deprecated status is not shown in the relationship documentation
  • [MBS-6836] – Area disambiguation comments don’t show up in the inline direct search
  • [MBS-6847] – Internal server error when adding search hint for places
  • [MBS-6850] – Internal server error adding a second place alias as primary
  • [MBS-6853] – Add a new place : missing AREA link after inline search lookup
  • [MBS-6857] – Guess Case doesn’t seem to work on places

Improvement

  • [MBS-2664] – Filter by editor flags (bot, limited user, AE, etc)
  • [MBS-3661] – Indexes score out of 100, direct search scores out of 10
  • [MBS-3880] – Display the last date/time a replicated server was updated
  • [MBS-4250] – Edit search : « ID is between X and Y » = « ID is between Y and X »
  • [MBS-6746] – Only ask for confirmation to leave the relationship editor if any change has been made
  • [MBS-6848] – Add URL matching for places for Discogs and IMDb
  • [MBS-6849] – Auto-select image/logo types for Commons URLs
  • [MBS-6861] – Show relationship type ID to relationship editors

New Feature

  • [MBS-2352] – Add a report highlighting artist credits with the same artist appearing multiple times
  • [MBS-3418] – Report: single medium releases with medium titles
  • [MBS-6730] – Autoselect social network for VK

Task

  • [MBS-6805] – Change Twitter autoselect to social network
  • [MBS-6809] – Add autoselect for place rels

The Git tag for this release is v-2013-10-28.

Search server jar/war files

We’ve been asked to provide instructions for how to upgrade a search server installation. We’ve got two answers for you:

  1. Short answer: Use the jar/war files linked below. Deploy these into whatever setup you’re currently using.
  2. Long answer: Check out the source (svn rev 13728) of the search server and follow the install instructions to build your own jar/war files.

Links: indexer jar, servlet war

Search server update for 2013-10-14 release

In conjunction with our main server release we’ve released a new search server. Thanks for your hard work on this release, Paul!

This release contains changes to match the Autumn 2013 database schema changes plus some bug fixes and improvements mostly to do with artist credits and aliases. See the detailed list of issues that are fixed in this version:

Bug

  • [SEARCH-46] – Searching for a release by releasename and artists english name will give no matches
  • [SEARCH-122] – Recording Search only adds release artist credit if different to recording artist credit and VA release
  • [SEARCH-304] – Webservice Json output for aliases when searching is inconsistent for boolean values
  • [SEARCH-311] – Recording, release and releasegroup search results incomplete artist aliases
  • [SEARCH-324] – Release search should return catalog numbers in ascending order

Improvement

  • [SEARCH-132] – Allow to filter release search by quality
  • [SEARCH-242] – The searcher can’t guess that the artist name one’s looking for is alias or artist name ☞ look for both
  • [SEARCH-288] – Include alias sortnames when searching works

Task

2013-10-14 schema change release update instructions

As promised, here are the instructions for updating any instances of MusicBrainz you might have. You will need to perform these steps to upgrade to the new version:

  1. Take down the web server running MusicBrainz, if you’re running a web server.
  2. Turn off cron jobs if you are automatically updating the database via cron jobs.
  3. Make sure your REPLICATION_TYPE setting is RT_SLAVE
  4. Switch to the new code with git fetch origin followed by git checkout v-2013-10-14
  5. Run carton exec -Ilib — ./upgrade.sh (or simply ./upgrade.sh if you aren’t using carton, such as for VM users or fairly new installs).
  6. Set DB_SCHEMA_SEQUENCE to 19 in lib/DBDefs.pm
  7. Turn cron jobs back on, if needed.
  8. Restart the MusicBrainz web server, if needed.

If your server fails to start or cron is having issues, it may be a missing perl module problem. To check for any missing perl modules, follow the instructions in INSTALL.md.

October 14 schema change complete

We’ve just finished rolling out the fall schema change release. Apart from the /place/create endpoint failing, the site is back up in full read-write mode now.

Read on for the changes in this release — our next blog post will give instructions on how to upgrade your instances of MusicBrainz.

Thanks to everyone who worked on this release!

Bug

  • [MBS-2301] – Attach TOC to new release – TOC/DiscId is lost when based on existing release/tracklist
  • [MBS-4453] – Duplicate artist credits
  • [MBS-5624] – Release groups don’t show the yellow removal warning when empty
  • [MBS-5647] – Release header of a different release appears on the release duplicates tab of the release editor
  • [MBS-6067] – Internal server error when using query parameter with a lookup in the webservice
  • [MBS-6211] – Aliases are missing the “ended” flag
  • [MBS-6373] – Area names being incorrectly translated
  • [MBS-6518] – Wikidocs pages keep 404ing
  • [MBS-6703] – Type displays as (none) on remove cover art edits.
  • [MBS-6715] – Internal server error looking up non-existing ISWC
  • [MBS-6717] – Some false reports of possible Artist collaborations
  • [MBS-6736] – ISE when giving a non-integer to entity/mbid/annotation/
  • [MBS-6748] – Internal server error loading some edit relationship edits
  • [MBS-6765] – Documentation search doesn’t work over https in recent Firefox/Chrome
  • [MBS-6782] – Artist overview page still displaying release date that was removed
  • [MBS-6787] – edit search merge works edits : ISWC are duplicated

Improvement

  • [MBS-631] – Add support for deprecating a relationship
  • [MBS-6068] – Remove the _name tables
  • [MBS-6069] – Track MBID webservice changes
  • [MBS-6182] – Deleted editors should be marked in a real way, not just designated by lack of password/well-known username
  • [MBS-6392] – Display ISNIs with spaces
  • [MBS-6543] – Highlight specified edit note when using edit note fragment in URL
  • [MBS-6564] – Add disambiguation comments to areas
  • [MBS-6706] – Improve the relationship type documentation display
  • [MBS-6713] – Ensure IMDB links are added at the right level
  • [MBS-6767] – Remove the Creative Commons download relationships report
  • [MBS-6779] – INSTALL.md doesn’t mention that you need to apt-get install cpanminus before trying to run cpanm.

New Feature

  • [MBS-5701] – Add a way to mark recordings as containing video
  • [MBS-6200] – Add a “place” entity
  • [MBS-6683] – Add autoselect for ReverbNation URLs

Task

  • [MBS-6046] – Remove PUID support
  • [MBS-6669] – Update the Allmusic logo used in the sidebar
  • [MBS-6732] – Add neyzen.com to score whitelist
  • [MBS-6766] – Delete unused root/release/full.tt

You can check out this release with the following tag: v-2013-10-14 .