Server update, 2013-12-23

Another two weeks and once again, a nice pile of fixed bugs! Thanks to uk/chirlu and reosarevok for fixing a few bugs along with the MetaBrainz team.

Some bits that might interest you:

  • It’s now possible to get an add-entity dialog right from the inline search fields. This should make it much easier to add relationships, especially, as well as creating new artists and labels where needed in the release editor. This also ends up improving the already-existing dialog for creating works in the relationship editor, to include the full functionality of the add work page. We’re hoping to get a fuller blog post on this feature up in the coming days.
  • The artist overview now filters out many release groups by default, for a less cluttered view that should more reliably include only the main discography of bigger artists, rather than including a lot of bootlegs, concert recordings, and other releases that aren’t always useful to see. Of course, there’s still a button to see all release groups.
  • Perhaps less obvious than other changes, but a lot of colors and some other minor styles have changed slightly on the site, as part of a reorganization of our CSS files.

… and, of course, the usual crop of bugs and small improvements. There’s a full list below. The tag for this release is v-2013-12-23.

Bug

  • [MBS-5876] – Internal server error requesting a non-existent collection via the webservice
  • [MBS-6547] – Relationship editor popups go out of the screen if titles are too long
  • [MBS-6556] – Pressing enter doesn’t submit create work dialog in relationship editor
  • [MBS-6572] – label/edit_form claims /Label_Comment is a guideline
  • [MBS-6772] – regression : can’t reorder more than one cover art in the same edit
  • [MBS-6867] – Incorrect help text ‘You must select an existing release group. If you wish to move this release, use the “change release group” action from the sidebar.’
  • [MBS-6928] – Creating release via CD TOC is broken (for Various Artists releases)
  • [MBS-6977] – Relationship editor regression: track artists no longer displayed
  • [MBS-6990] – beta : clicking in a release opens a recording in a new window
  • [MBS-7025] – Labels not being shown in merge releases edits
  • [MBS-7057] – Internal server error when attempting to do merges with different entities simultaneously
  • [MBS-7058] – /relationship-editor endpoint ISEs if you don’t include “ended” fields
  • [MBS-7061] – The tracklistings are gone in the release view.
  • [MBS-7069] – beta: Buttons wrongly positioned on edit note tab of release editor
  • [MBS-7077] – beta: sizing issues with dialogs/autocompletes in relationship editor

Improvement

  • [MBS-1467] – Allow new artists to be created directly from the “Relate to…” search box
  • [MBS-3420] – Allow creating new release groups when editing existing releases via the release editor
  • [MBS-5313] – Add official (default) and unofficial displays for Overview
  • [MBS-5446] – The work creation widget should have a “Guess Case” part
  • [MBS-5515] – Allow adding artists in the relationship editor
  • [MBS-6428] – Move to LESS for more structure in the stylesheets
  • [MBS-6437] – button :active state only fires for <a> elements
  • [MBS-6583] – Make cache prefix names for types more obvious
  • [MBS-6879] – Add reports of entities with deprecated relationships
  • [MBS-6926] – Remove %E2%80%8E from the end of URLs
  • [MBS-7052] – Set cover art page says “No releases have cover art” when it’s not true
  • [MBS-7066] – Load area codes in initial load, instead of separately.
  • [MBS-7067] – Use rel=nofollow on external links.

New Feature

  • [MBS-5442] – The work creation widget should allow to create a work with an ISWC

Task

  • [MBS-7055] – Fix the spelling of eligble_for_cleanup

MusicBrainz Read Only Between 2PM – 3PM UTC

We need to do essential maintainance on the main MusicBrainz database server today (specifically upgrading to Ubuntu 12.04 LTS). We’re aiming to get this work completed within an hour, and will require MusicBrainz to be in read-only mode for the duration of the upgrade. We’re going to go read-only from 2PM UTC (6AM PST, 9AM EST, 3PM CEST) to begin this work.

Sorry for the inconvenience!

Server update, 2013-12-09

Hello! It’s been another two weeks and it’s time for another release of musicbrainz-server. Thanks to intgr, Freso, and bitmap for their contributions to this release alongside ocharles and I. Congratulations also to bitmap, who becomes part of the official MetaBrainz team today.

This release is primarily bug fixes and small tweaks, though perhaps the most visible change is that Places and Works now have custom entity icons like most of our other entities already did.

The git tag for this release is v-2013-12-09.

Bug

  • [MBS-6932] – Wikipedia extracts lack licensing information
  • [MBS-6949] – Empty edits being submitted
  • [MBS-6954] – Artist disambiguation comments not always shown within tracklists
  • [MBS-6970] – Internal Server Error (ISE) on overview with wikipedia/wikidata ARs
  • [MBS-6978] – can’t close inline search
  • [MBS-6983] – Merge release edit produces incorrect UI display
  • [MBS-6984] – “Need an edit note” on merge deselects target entity
  • [MBS-6987] – regression: <span class=”name-variation”> has disappeared from tracklists
  • [MBS-6996] – RG merge edit shows disambiguation twice
  • [MBS-7000] – On /edits page, “merge release groups” table displays incorrectly
  • [MBS-7005] – Place disambiguation not being shown in the inline search
  • [MBS-7024] – Some recent replication packet breaks slave servers with collate indexes
  • [MBS-7026] – Wikipedia abstract is incorrectly in Chinese

Improvement

  • [MBS-2713] – Work has no musicbrainz style icon
  • [MBS-6710] – Match Mora and Recochoku URLs with “purchase for download” relationship type
  • [MBS-7036] – Improve alignment of old/new fields in some edit diffs

Important Update on Replication

We’ve been informed that some people have noticed their MusicBrainz slave servers have stopped applying replication packets. We’ve tracked the problem down and now have a fix for this problem.

How Do I Tell If I’m Affected?

To determine if you are affected, connect to the MusicBrainz PostgreSQL database (we recommend using ./admin/psql from your musicbrainz-server checkout) and run the following:

SELECT now() - last_replication_date FROM replication_control;

If you see a date that is larger than a few days, there’s a good chance you are affected by this bug and should upgrade.

How Do I Fix This?

Fixing this is easy, you simply need to update your Git checkout. We suggest the following:

cd musicbrainz-server
git fetch --tags origin
git checkout v-2013-10-14-replication-fix-2

EDIT: formerly used a different (broken) tag and recommended a different method of fetching tags.

When replication next runs, the data that cannot be applied will be rewritten and replication will continue as normal.

Server update, 2013-11-25

Hello again! We’ve got another freshly-pressed release of musicbrainz-server, just sent out to our agents in the field. Thanks to JesseW, Freso, and nikki for supplementing my and ollie’s work this round.

Some things you might be excited about this release:

  • For artists with only standalone recordings, they’ll now be shown on the overview tab, similar to artists with only VA releases (thanks JesseW!)
  • The newly-added Bandcamp relationship for artists and labels should now clean up and autoselect the type (thanks Freso)
  • Images in Wikimedia Commons will now appear on artist and place pages (thanks nikki!)
  • Place coordinates now support a few more formats, to support comma as a decimal separator and to support the format used on the Japanese Wikipedia.
  • You can now provide a list of statistics to the timeline graph by separating the raw statistic names with ‘+’. For example, showing the pace of addition of geonames URLs to areas: https://musicbrainz.org/statistics/timeline/count.area+count.ar.links.l_area_url.geonames#+r-

Otherwise, a variety of bug fixes and small improvements. We hope you like it! The tag for this release is v-2013-11-25, which this week I’ve remembered to push to both github and bitbucket.

Bug

  • [MBS-6529] – “An error occured while loading this edit” for an old edit
  • [MBS-6888] – XML Web Service omits ASINs in output for Releases which have ASINs assigned
  • [MBS-6902] – ISE: Caught exception in MusicBrainz::Server::Controller::Artist->edits “Can’t call method “id” on an undefined value at lib/MusicBrainz/Server/Data/Utils.pm line 410, line 3.”
  • [MBS-6924] – Merging places does not copy the address to the target
  • [MBS-6925] – IMDb artist autoselect shouldn’t block company
  • [MBS-6935] – Cover art uploader incorrectly falls back to old uploader in Safari
  • [MBS-6947] – Release inline credits broken for recording-recording relationships when both recordings are in the release
  • [MBS-6951] – tracks with recording pending edits are not marked as edit pending any more in release pages
  • [MBS-6956] – Medium title(s) not shown on release pages
  • [MBS-6960] – AC bubble not linking to the artists
  • [MBS-6961] – AC not shown on tracks even though it differs from release AC
  • [MBS-6963] – Release editor incorrectly claims Various Artists has been used for tracks
  • [MBS-6966] – Edit/remove relationship links shown on release page when not logged in
  • [MBS-6980] – inline search : oversized width outside of screen
  • [MBS-6986] – Match recordings by MBID not working any more

Improvement

  • [MBS-1754] – Display standalone recordings on overview if artist has no release groups
  • [MBS-6400] – Display on release merge edit the same info displayed on merge preview page (release events/labels/catalog numbers etc)
  • [MBS-6755] – Create whitelist and display images in the sidebar
  • [MBS-6891] – “Add Label”/”Add Event” links/buttons need cursor:pointer
  • [MBS-6899] – Accept coordinates using a comma as a decimal point
  • [MBS-6929] – Support coordinates from the Japanese Wikipedia
  • [MBS-7011] – Allow specifying a list of arbitrary lines to graph in the timeline graph.

New Feature

  • [MBS-6998] – Add autoselect for Bandcamp URLs for Labels and Artists

Task

  • [MBS-6920] – Add muzikum.eu to the lyrics whitelist

Update: an earlier version of this post failed to include MBS-6755

Server update, 2013-11-11

Another fortnight, another release; thanks to Freso, warp, bitmap, reosarevok, and the MusicBrainz team for their work!

The tag for this release is v-2013-11-11. We had some small problems during release; sorry to anyone who ran into an error during the short period before we reverted things to get our server configurations in order!

Bug

  • [MBS-4438] – Release editor: Track durations are not loaded the first time you access the recordings tab
  • [MBS-5592] – Relationship editor permits multiple identical relationships
  • [MBS-6066] – Random internal server errors when searching
  • [MBS-6298] – ‘View all relationships’ links to a tab that’s not in the list of tabs
  • [MBS-6449] – Logic for showing “at least” in the edit search for the number of results is wrong
  • [MBS-6661] – work_attribute check is wrong
  • [MBS-6673] – Cover art uploading not working in IE
  • [MBS-6689] – Pasting an MBID initiates a search
  • [MBS-6769] – Inline search shows sort name even when identical to name
  • [MBS-6785] – Tagger button broken in Opera
  • [MBS-6851] – Can’t relate recordings to places in the relationship editor
  • [MBS-6858] – Relationship type documentation not accessible
  • [MBS-6872] – Tags page does not show places
  • [MBS-6873] – delete_unused_url and delete_orphaned_recordings don’t account for places
  • [MBS-6878] – Inline search check for non-latin characters treats Vietnamese characters as non-latin
  • [MBS-6883] – Relationship editor fails to load existing relationships
  • [MBS-6884] – Guess case treats “studio” in place names as extra title information
  • [MBS-6892] – Relationship editor needs “(more documentation)” link after relationship type description
  • [MBS-6900] – Cannot edit places with empty coordinates
  • [MBS-6901] – Places lat/long parser does not understand »+55° 54′ 14.49″, +8° 31′ 51.64″«
  • [MBS-6905] – beta: Comma shown in coordinates field when editing places with no coordinates
  • [MBS-6907] – beta: Coordinates parsing should not require seconds
  • [MBS-6908] – Internal server error searching for multiple editor flags in the edit search
  • [MBS-6909] – “Editor flag is not” in edit search does not work
  • [MBS-6914] – beta: Clicking result in inline search hides popup instead of selecting result
  • [MBS-6916] – beta: No dropdown in inline search when there are no results
  • [MBS-6921] – Artist Credit join phrase not displayed in tracklist

Improvement

  • [MBS-1421] – Require an edit note for all destructive edits
  • [MBS-2985] – Report: download relationships in non-digital releases.
  • [MBS-6239] – Use Wikidata URLs to fetch interwiki links
  • [MBS-6353] – Display on release group merge edit the same info displayed on merge preview page (mainly release group types)
  • [MBS-6394] – Automatically cut out hyphens during ISRC addition
  • [MBS-6456] – Show country and subdivision when displaying areas in sidebar and on profile pages
  • [MBS-6554] – Uppercase letters when entering ISRCs instead of rejecting lowercase ones
  • [MBS-6771] – Use localised aliases in the inline search where possible
  • [MBS-6824] – Coordinate fields should understand and convert degree minute second format
  • [MBS-6828] – Coordinates should be editable as one field
  • [MBS-6830] – Coordinate fields should strip degrees signs
  • [MBS-6831] – Coordinate fields should understand directions
  • [MBS-6832] – Coordinates should be presented better
  • [MBS-6838] – Release group dropdown in add release does not contain sufficient info
  • [MBS-6839] – Video attribute should be shown in merge recording edits
  • [MBS-6846] – Strip excessive digits in coordinates
  • [MBS-6859] – Inline search for places should show localised aliases
  • [MBS-6882] – Titles for video pages should say “Video”
  • [MBS-6911] – Make MB.Control.ArtistCredit a view model for knockout, use $.widget for MB.Control.Autocomplete

Task

  • [MBS-6729] – Add whosampled to the Other databases whitelist
  • [MBS-6893] – Add “Rockens Danmarkskort” to “Other databases” whitelist for Places

Server update 2013-10-28

With the schema change well past us, we’re finally back into normal development mode. This release contains more bug fixes to new features from the schema change, as well as an assortment of improvements and general bug fixes to the rest of the site. Many thanks to Nicolás Tamargo and the MusicBrainz team for their work on this release. Here’s what’s changed:

Bug

  • [MBS-5439] – ISE: Adding a release with a track of 0 length
  • [MBS-5658] – Various Artists used for track artists when adding release via disc ID lookup
  • [MBS-5926] – Collection names are shown for subscribed private collections
  • [MBS-6810] – add work alias (not ended) error
  • [MBS-6813] – can’t see these recordings edit history (Internal Server Error)
  • [MBS-6816] – Place type stats display is broken
  • [MBS-6818] – Cannot cancel edit (Internal Server Error)
  • [MBS-6821] – ISE when searching video:true
  • [MBS-6823] – Report title for SingleMediumReleasesWithMediumTitles is wrong
  • [MBS-6826] – Deprecated status is not shown in the relationship documentation
  • [MBS-6836] – Area disambiguation comments don’t show up in the inline direct search
  • [MBS-6847] – Internal server error when adding search hint for places
  • [MBS-6850] – Internal server error adding a second place alias as primary
  • [MBS-6853] – Add a new place : missing AREA link after inline search lookup
  • [MBS-6857] – Guess Case doesn’t seem to work on places

Improvement

  • [MBS-2664] – Filter by editor flags (bot, limited user, AE, etc)
  • [MBS-3661] – Indexes score out of 100, direct search scores out of 10
  • [MBS-3880] – Display the last date/time a replicated server was updated
  • [MBS-4250] – Edit search : « ID is between X and Y » = « ID is between Y and X »
  • [MBS-6746] – Only ask for confirmation to leave the relationship editor if any change has been made
  • [MBS-6848] – Add URL matching for places for Discogs and IMDb
  • [MBS-6849] – Auto-select image/logo types for Commons URLs
  • [MBS-6861] – Show relationship type ID to relationship editors

New Feature

  • [MBS-2352] – Add a report highlighting artist credits with the same artist appearing multiple times
  • [MBS-3418] – Report: single medium releases with medium titles
  • [MBS-6730] – Autoselect social network for VK

Task

  • [MBS-6805] – Change Twitter autoselect to social network
  • [MBS-6809] – Add autoselect for place rels

The Git tag for this release is v-2013-10-28.

Search server jar/war files

We’ve been asked to provide instructions for how to upgrade a search server installation. We’ve got two answers for you:

  1. Short answer: Use the jar/war files linked below. Deploy these into whatever setup you’re currently using.
  2. Long answer: Check out the source (svn rev 13728) of the search server and follow the install instructions to build your own jar/war files.

Links: indexer jar, servlet war

Search server update for 2013-10-14 release

In conjunction with our main server release we’ve released a new search server. Thanks for your hard work on this release, Paul!

This release contains changes to match the Autumn 2013 database schema changes plus some bug fixes and improvements mostly to do with artist credits and aliases. See the detailed list of issues that are fixed in this version:

Bug

  • [SEARCH-46] – Searching for a release by releasename and artists english name will give no matches
  • [SEARCH-122] – Recording Search only adds release artist credit if different to recording artist credit and VA release
  • [SEARCH-304] – Webservice Json output for aliases when searching is inconsistent for boolean values
  • [SEARCH-311] – Recording, release and releasegroup search results incomplete artist aliases
  • [SEARCH-324] – Release search should return catalog numbers in ascending order

Improvement

  • [SEARCH-132] – Allow to filter release search by quality
  • [SEARCH-242] – The searcher can’t guess that the artist name one’s looking for is alias or artist name ☞ look for both
  • [SEARCH-288] – Include alias sortnames when searching works

Task

2013-10-14 schema change release update instructions

As promised, here are the instructions for updating any instances of MusicBrainz you might have. You will need to perform these steps to upgrade to the new version:

  1. Take down the web server running MusicBrainz, if you’re running a web server.
  2. Turn off cron jobs if you are automatically updating the database via cron jobs.
  3. Make sure your REPLICATION_TYPE setting is RT_SLAVE
  4. Switch to the new code with git fetch origin followed by git checkout v-2013-10-14
  5. Run carton exec -Ilib — ./upgrade.sh (or simply ./upgrade.sh if you aren’t using carton, such as for VM users or fairly new installs).
  6. Set DB_SCHEMA_SEQUENCE to 19 in lib/DBDefs.pm
  7. Turn cron jobs back on, if needed.
  8. Restart the MusicBrainz web server, if needed.

If your server fails to start or cron is having issues, it may be a missing perl module problem. To check for any missing perl modules, follow the instructions in INSTALL.md.