NGS Bug fixes 2011-09-21 and the New "Split Artist" Feature

Apologies for being a few days late here, but we’ve just finished updating the servers with the latest set of bug fixes and new features. This release brings a new feature that people have been asking for since NGS – the ability to “split” an artist into artist credits.

Split Artist

With NGS, we had the ability to link multiple artists to recordings/releases/etc. While our migration script handled most cases, there are some cases when it was unclear how to automatically split artists, and we opted to leave that artist unchanged. While it was possible to manually edit references to this artist, it was painful. We now have a convenient way to make this process easier. In the sidebar of artists there is now a “split into separate artists” link:

The new "split into separate artists" feature
The new "split into separate artists" feature

Clicking this link will present you with a form where you can choose the new set of artists. For example, here’s me splitting the single “Alix Perez & SpetraSoul” artist into the correct separate artists:

The "split artists" form
The "split artists" form

As with the other types of editing in MusicBrainz, this edit has to be voted on by other editors before it is applied.

The split artists edit type can only be used on artists that have no relationships, other than “collaboration” relationships. If the artist does have collaboration relationships, edits to remove all collaboration relationships will be entered at the same time. Note also that this will not remove the now empty artist entirely – that will happen when ModBot does its daily cleanup.

Bugs

We’ve continued working through the bugs as well, and here are the tickets that have been closed in this release.

  • [MBS-1133] – Don’t try to delete relationship types that are still in use
  • [MBS-1343] – Add AR instrument search function has problems with accented letters
  • [MBS-1380] – An URL ending in closing parenthesis gets broken when listed in edit notes
  • [MBS-1396] – Allow for URLs longer than 255 chars
  • [MBS-1411] – Don’t lowercase relationship attributes
  • [MBS-1520] – Tag lookup page has odd search results
  • [MBS-1879] – Remove the non-functional /search/plugins page
  • [MBS-1934] – Inconsistency: “see other versions of this release” vs. “see release group”
  • [MBS-1936] – Historic MusicBrainz::Server::Edit::Historic::EditArtist incorrect: doesn’t include artist names, always use “[removed]”
  • [MBS-1950] – Artist Sortname is shown instead of Artist Name in historic edits
  • [MBS-2047] – Email sender addresses have regressed
  • [MBS-2195] – Don’t allow submitting relationships where the relationship type has no description
  • [MBS-2335] – Other Lookup ISWC search should strip spaces
  • [MBS-2495] – Auto-edit status in edit documentation is misleading
  • [MBS-2529] – Orphaned release group and recordings after rejecting or cancelling a release/medium
  • [MBS-2911] – URL decoding should not decode non-utf-8 strings
  • [MBS-2934] – “Change release group” edit doesn’t appear in artist’s edits
  • [MBS-2944] – Vote on all edits control should only be shown to auto-editors
  • [MBS-3226] – Multi-artist credits with no artist selected produce very confusing behavior
  • [MBS-3227] – Lookup TOC page incomplete for logged out users.
  • [MBS-3269] – Track #s get automatically added to track titles every time the tracklist tab is opened
  • [MBS-3274] – Editing track names using with the basic editor removes track artists and disassociates recordings
  • [MBS-3278] – Warning about using various artists as track artist flashes on screen
  • [MBS-3347] – When trying to add cover art from disallowed sites, no error is shown
  • [MBS-3351] – ws/2 stacktrace browsing release by label
  • [MBS-3358] – “Open Edits” and “All Edits” tabs not marked as open
  • [MBS-3373] – URL cleanup stuff doesn’t always run in time
  • [MBS-3381] – Orphaned release groups/recordings created by release editor should be automatically removed
  • [MBS-3391] – Don’t allow to enter “performs instrument” without instrument
  • [MBS-3399] – No edit links for relationships in the appearances section on the artist relationships tab
  • [MBS-3402] – Do not allow subscriptions to “Various Artists” or “Deleted Artist”
  • [MBS-3403] – “Change release group” edit doesn’t show up in edit history / open edits of target release group
  • [MBS-3405] – Remove leading / trailing / double spaces in titles
  • [MBS-3434] – High DQ Release allows Auto-edits + incorrect edit conditions for merge
  • [MBS-3436] – “Wiki Version” column on transclusion page shows ERROR
  • [MBS-3443] – Inconsistency in sorting of “Edits by subscribed editors” ≠ “Edits for subscribed entities”
  • [MBS-3445] – Cannot search edits by editor name
  • [MBS-3453] – “Related works” on recordings page shows same work and AR set twice if there are two work<->recording ARs for the same work/recording pair
  • [MBS-3464] – Do not redirect http://www.musicbrainz.org to musicbrainz.org for /ws requests

Task

  • [MBS-1914] – Run script to remove “later/earlier release of” ARs

Improvement

  • [MBS-2669] – Filter edits by language
  • [MBS-2670] – Filter edits by artist country

The Git tag for this release is v-2011-09-21-ngs-bug-fixes. Happy editing!

NGS Bug fixes, 2011-08-22

Here’s what we got fixed in the last week!

Bug

  • [MBS-1928] – Missing artist roles in works page
  • [MBS-2035] – Cancelling/rejecting a medium will leave release in an unkown state
  • [MBS-2600] – Spurious "artist credit field is required" errors with recording edits
  • [MBS-2756] – ‘Guess Case’ too aggressive on word ‘Trance’
  • [MBS-2881] – Editing CD Baby URLs behaves weirdly
  • [MBS-2973] – Edit Medium can re-associate recordings behind your back
  • [MBS-2976] – Edit tracklist edit doesn’t link to new recordings
  • [MBS-3002] – Edit search crashes if any arguments are removed
  • [MBS-3009] – View transclusion edit history link is broken
  • [MBS-3012] – Exception trying to submit a decimal rating
  • [MBS-3017] – Edit failed dependency by MotBot for no obvious reason
  • [MBS-3071] – Edit search crashes with no search conditions
  • [MBS-3141] – Can’t select criterias in edit search
  • [MBS-3199] – Changing an artist on a tracklist to an artist with the same (credited) name is an auto-edit
  • [MBS-3213] – When removing tracks from a release, artist credits are erroneously listed as part of the edit
  • [MBS-3214] – ModBot failed dependency because of a non-existing artist but the artist was not edited
  • [MBS-3231] – When entering a CD stub there are no checks for field length
  • [MBS-3244] – Errors submitting data via the web service to test.musicbrainz.org
  • [MBS-3245] – 500 Internal Server Error when submitting release ratings via the web service
  • [MBS-3247] – Show recording artist in Remove ISRC edits
  • [MBS-3252] – Internal Server Error in edit search (Artist is in my subscriptions / Status Open)
  • [MBS-3253] – Edit search displays the same edit multiple times
  • [MBS-3254] – Internal Server Error in edit search when "My vote" is unselected
  • [MBS-3256] – Unable to move a disc id between CDs in the same release
  • [MBS-3257] – Searching by TOC fails for mediums which have no format
  • [MBS-3258] – column width in opera too small
  • [MBS-3262] – ws/2 returning invalid xml
  • [MBS-3265] – Webservice not escaping "<<" properly

Improvement

  • [MBS-2232] – Auto-approve Add Medium and Add Release Label edits for new releases
  • [MBS-2839] – Artist work list > Better design: don’t split by "categories" (composer, lyricist, …) and indicates artist role for each artist related to work

NGS bug fixes, 2011-08-08

Apologies for the day late release, but here’s the latest installment of bug fixes and improvements now live on the main website:

Bug

  • [MBS-1847] – Work aliases not included in XML
  • [MBS-1849] – Alias locales not included in the XML
  • [MBS-1977] – ModBot is unable to close some edits
  • [MBS-2140] – Recordings automatically changed when editing release with CD+DVD with same track names
  • [MBS-2193] – "Failed" total on a user page includes edits canceled after NGS
  • [MBS-2246] – Cannot use "Change track artists" checkbox to change all track artists to same as release artist
  • [MBS-2306] – ws2 implementation doesn’t return discids with discid queries
  • [MBS-2365] – Adding a release as Various Artist it dosen’t add ask for adding new artists
  • [MBS-2632] – Ratelimit should cover all of /ws
  • [MBS-2819] – Edit URL edits have incorrect links
  • [MBS-2886] – WebService Internal error on inc parameter
  • [MBS-3043] – Release editor allows "null" as recording id in tracklist edits
  • [MBS-3103] – Changing alias locales is an auto-edit for regular editors
  • [MBS-3115] – Server error during submission of CD Stub for which there is already a disc ID
  • [MBS-3129] – Some set track lengths edits have no lengths shown
  • [MBS-3133] – inc=release-groups+type with release lookup throws error
  • [MBS-3137] – Label country not shown on relationships page
  • [MBS-3147] – Cover art script not working properly
  • [MBS-3162] – Direct Search is unable to find artists, even when exactly matched
  • [MBS-3166] – Error messages (from RE in particular) could be more helpful for users and developers
  • [MBS-3172] – POSTs are getting cancelled for taking more than 30 seconds of time
  • [MBS-3190] – "Remove work" edit type doesn’t apply

Improvement

  • [MBS-3013] – Guess Case should capitalize some words that are usually lowercase if they are followed by punctuation.
  • [MBS-3015] – ModBot’s "Remove Work" edits should be autoedits.

New Feature

Sub-task

  • [MBS-2772] – Filter by vote cast
  • [MBS-3004] – Search for subscribed artists (has been currently dropped)

Schema change release, 2011-07-11

Today we released our first schema change update since NGS. This change is quite a radical one, as it merges both of our databases (“READWRITE” and “RAWDATA”) into a single database. For most users of the database, this probably won’t affect you, but you’re encouraged to run the upgrade process anyway. Here’s what you need to do:

  1. Take down the web server running MusicBrainz, if you’re running a web server.
  2. Turn off cron jobs if you are automatically updating the database via cron jobs.
  3. Set DB_SCHEMA_SEQUENCE to 13 in lib/DBDefs.pm
  4. Make sure your REPLICATION_TYPE setting is RT_SLAVE
  5. Switch to the new code with git fetch origin followed by git checkout v-20110711-schema-change
  6. Run ./upgrade.sh from the top of the source directory.
  7. Install the perl modules Algorithm::Merge and Algorithm::Diff
  8. Turn cron jobs back on, if needed.
  9. Restart the MusicBrainz web server, if needed.

This process may take a while, as it has to dump one database into another, and download a few extra changes to ensure slaves aren’t missing any data. The RAWDATA database should no longer be in use and you should be able to drop it, but waiting to see that everything is working well might be a good idea.

This schema change does not introduce any new data. For everyone else, here’s a list of what got fixed since the last release!

Bug

  • [MBS-1977] – ModBot is unable to close some edits
  • [MBS-1979] – Unable to edit a “later translated versions” relationship with change direction
  • [MBS-2026] – Subscribed artists open edits won’t load for editors with large amounts of subscriptions
  • [MBS-2442] – MB postgres unaccent extension overwrites unaccent.so library shipped with postgres-contrib
  • [MBS-2689] – Timeline isn’t working in Opera 10
  • [MBS-2698] – Some tables are not replicated through Live data feed
  • [MBS-2812] – Adding track times has caused a failed dependency for an edit which changed the track titles.
  • [MBS-2826] – Web service returns malformed XML (not escaped properly)
  • [MBS-2831] – “Edit medium” edit display: Artist credits changes are incorrect
  • [MBS-2974] – I don’t receive e-mail when someone votes no to my edit any more
  • [MBS-2981] – Changing the case of recording comments should be auto-edits
  • [MBS-2986] – tracklist_index was not populated during NGS
  • [MBS-2995] – Caught exception in MusicBrainz::Server::Controller::WS::2::ReleaseGroup->release_group_browse “Can’t call method “format”

Improvement

  • [MBS-1500] – Remove tracklist_index.tracks
  • [MBS-1707] – Advanced tracklist in RE: “Title” to “Disc title”
  • [MBS-2242] – Disable editing of Medium title when there’s only one medium
  • [MBS-2434] – Combine READWRITE and RAWDATA
  • [MBS-2462] – Other edit types that don’t highlight what has changed between old and new values
  • [MBS-2583] – “Edit Medium” should show you which medium is being edited with respect to the overall release
  • [MBS-2767] – Release-group XML result should include first release date

NGS bug fixes, 2011-07-05

The wheels of change are slowly starting back up again, now that we have all our employees back 🙂 Here’s what we’ve got done since the last release:

Bug

  • [MBS-1849] – Alias locales not included in the XML
  • [MBS-2223] – Length not shown in edit when adding a standalone recording
  • [MBS-2586] – Search results do not show standalone recordings
  • [MBS-2807] – Stack trace requesting /ws/2/collection when user has no collections
  • [MBS-2846] – Internal Server Error on lot of editing histories
  • [MBS-2880] – Error viewing release group/URL
  • [MBS-2882] – Merge recording edit display incorrectly once applied
  • [MBS-2898] – Search indices aren’t updating, haven’t updated in over 20 hours

Improvement

  • [MBS-777] – Make cancelling take effect sooner
  • [MBS-1508] – Should release browse request allow inc=recordings
  • [MBS-2767] – Release-group XML result should include first release date

NGS bug fixes for 2011-06-14

Another week, another set of bug fixes! Here’s what we’ve addressed since the last release:

Bug

  • [MBS-1231] – Age information for a person looks weird
  • [MBS-1924] – Allowed merge direction for "Merge mediums and recordings" strategy seems non-intuitive
  • [MBS-1995] – Time from TOC is calculated incorrectly
  • [MBS-2000] – CC URL relationship does not allow selection of license
  • [MBS-2049] – Docs not in the transclusion table seem to be perma-cached
  • [MBS-2062] – Menu link ‘About->Auto-editor elections’ is invalid.
  • [MBS-2169] – Label entered regardless of clearing text
  • [MBS-2261] – Release group is listed twice on an artist page
  • [MBS-2347] – Seed particular release after clicking on the recording tabs it comes back with Frequent 502 Bad Gateway
  • [MBS-2376] – Inline search results disappear when clicking on the little arrows two times
  • [MBS-2391] – You should not be able to add the same CDTOC multiple times on the same medium
  • [MBS-2399] – Problems with mediums having duplicate CD TOCs
  • [MBS-2408] – Guess Case deletes volume and part numbers
  • [MBS-2447] – "Charter Member" thing no longer shown
  • [MBS-2483] – Edit URL edit for a removed URL displays wrong
  • [MBS-2485] – no way to merge a various artist clone into the default "Various Artists" artist
  • [MBS-2529] – Orphaned release group and recordings after rejecting or cancelling a release/medium
  • [MBS-2550] – Re-add the "Subscribe to artists I add" option
  • [MBS-2552] – Allow removing a RG that has relationships
  • [MBS-2560] – Internal Server Error when removing medium from a release
  • [MBS-2644] – Internal server error while trying to add a disc ID
  • [MBS-2645] – Error in the message when trying to relate works to recordings
  • [MBS-2651] – Edit shows up in unrelated artists’ edit history
  • [MBS-2658] – Edit URL edits cannot close if the URL being edited has since been merged
  • [MBS-2659] – Edit relationship fails if the relationship has since been edited into the same relationship
  • [MBS-2705] – Adding a note to an edit which has an existing note w/o timestamp gets presented out of order
  • [MBS-2724] – IPIs don’t appear when added in Add artist edits
  • [MBS-2744] – Track removals not shown in tracklist diff

Improvement

  • [MBS-1395] – Put relationship attributes descriptions inside of an HTML "label" tag
  • [MBS-1449] – Inline Search: relate to recordings and/or works on releases
  • [MBS-1982] – Add twitter link to home page
  • [MBS-2007] – Lack of spacing between the top nav search and the dropdown to accompany it
  • [MBS-2269] – Release editor > When new disc is added, check if the last disc is empty and replace it
  • [MBS-2299] – Display one-line TOC on discId page
  • [MBS-2430] – Tagger button for standalone recordings
  • [MBS-2459] – Timeline graph needs copyable URLs
  • [MBS-2697] – Could use a link to add a VA release group
  • [MBS-2721] – Sort recordings by comment

New Feature

  • [MBS-2567] – Statistics about artist countries

Sub-task

  • [MBS-1916] – Edit release label edit doesn’t display properly

NGS bug fixes for 2011-06-01

We’ve now slowed down a bit from the hot fixes and are starting to roll out weekly releases. To kick things off, here’s what we’ve just pushed out to the main servers:

Bug

  • [MBS-1071] – Relationships with pending edits should be highlighted
  • [MBS-1937] – Subscriptions email is not sorted
  • [MBS-1960] – Historic add release group edits have an invalid data section for artist credits
  • [MBS-2046] – Global ratelimits are not applied
  • [MBS-2055] – Add release/add disc: cannot add tracks or edit track lengths; leaving the tracklist tab loses tracklists; other problems
  • [MBS-2080] – Tracks times not being shown in release editor when DiscID is present
  • [MBS-2187] – IPIs from ASCAP not accepted
  • [MBS-2239] – Newly created work does not appear on the author’s list of works
  • [MBS-2247] – ModBot shouldn’t remove artists which were recently added
  • [MBS-2305] – Release groups shown twice on tag overview page for tag with releases and release groups.
  • [MBS-2316] – Broken link in "edits for your subscription" email
  • [MBS-2339] – Editing tracklist -> error
  • [MBS-2340] – Release tags do not show up in user’s created tags
  • [MBS-2375] – Label codes on label pages don’t have leading zeros anymore
  • [MBS-2380] – file error – work/relate.tt: not found
  • [MBS-2393] – Error when searching works for certain strings.
  • [MBS-2395] – Use the link type name in /ws/2/ XML
  • [MBS-2397] – can’t watch an artist
  • [MBS-2457] – Multiple Entries of the Same DiscID, not editable
  • [MBS-2464] – "Remove recording" edit is not displaying recording

Improvement

  • [MBS-1966] – Open edits list now backwards, showing newest edits first
  • [MBS-2074] – Change the label of the button at the bottom of the page from "Vote on All Edits" to "Save Changes"
  • [MBS-2290] – Replace letter x with multiplication sign.
  • [MBS-2379] – Wording in subscriptions email is inaccurate
  • [MBS-2396] – Make it possible to return recording and work level ARs from /ws/2/release

Task

  • [MBS-2063] – Detail ws/2 ISRC submission process

Ian McEwan, one of this years Google Summer of Code students, now has his first bit of work in MusicBrainz as well:

I have created a basic graph with a subset of the core entities and some limited interactivity.

This is essentially a stripped down version of the old MusicBrainz timeline. Lots more interesting features to come with this project, and it’s showing great potential!

The Git tag for this release is v-2011-06-01-ngs-bugfixes.

NGS hotfixes for 2011-05-27

A small set of fixes to finish the week. The next release after this is currently scheduled for Wednesday. Thanks for sticking with us through the NGS launch week! Please keep the bug reports coming in, no matter how insignificant you think the issue may be, your reporting has been tremendously helpful. The Git tag for this version is ocharles/v-2011-05-27-ngs-hotfixes – the official tag will be out late Monday (I don’t have a key to sign the tag with).

One note about the Sound Juicer/RhythmBox issues – this is actually a problem with programs being compiled against libmusicbrainz2, instead of libmusicbrainz3 and there’s nothing we can do about these problems. If you are experiencing problems we recommend you compile from source, or wait/pester your distribution to update their packages.

Bug

  • [MBS-2249] – Sound Juicer no longer works with NGS
  • [MBS-2274] – Sort names being returned incorrectly for multiple artist credits on /ws/1
  • [MBS-2295] – UX: Add Missing Entities loses your selections for artists if you forget to select (or add new artist sort-name for) one of them
  • [MBS-2296] – FixTrackLength script (aka modbot automatically setting track lengths) checks are wrong
  • [MBS-2328] – When seed release editor with recording ids for tracks the Release Editor associates them with the wrong tracks unless recording ids have been allocated for every track
  • [MBS-2332] – Error trying to edit tracklist of a release to remove excesive quoting
  • [MBS-2350] – Subscribe link doesn’t work (missing id)

Improvement

  • [MBS-2353] – Update javascript code for relationships so Wikipedia URL are recognized automatically for works

NGS hot fixes for 2011-05-24

More bug fixes for the NGS release, keeping up with our promise of daily hot fixes! A lot of work today, but a good whack of it is still in review, so that will be coming tomorrow. Here’s what you should see on the servers:

Bug

  • [MBS-1896] – Editing Artist/Label Name capitalisation results with "Possible Duplicate Artists" warning
  • [MBS-2106] – Unable to add new release using FreeDB import: process freezes when clicking "Add disc" radio button
  • [MBS-2163] – Internal Server Error attempting to assign a title to a medium
  • [MBS-2171] – Expand Disc does not result in the correct action
  • [MBS-2179] – Remove disc in release editor tracklist pane does nothing
  • [MBS-2181] – Internal Server Error when submitting edit to remove and add disc
  • [MBS-2203] – Internal server error when importing VA release from freedb via freedb search > import
  • [MBS-2206] – Advanced editor: Can’t add tracks to new mediums
  • [MBS-2254] – Viewing the page for a tag which is only present on works gives a internal server error for template
  • [MBS-2261] – Release group is listed twice on an artist page
  • [MBS-2267] – Number of mediums doubled on ‘Disc IDs’ page
  • [MBS-2279] – Medium heading displayed twice in list of disc IDs
  • [MBS-2280] – [ws/1] release-group search returns invalid xml
  • [MBS-2284] – Disc IDs shown with duplicate CD1/CD2 headings

Improvement

  • [MBS-1717] – Allow selecting the release group of a release in the release editor

Please feel free to make use of these, if you want to do more testing, remember our test servers are also up to date! The tag for this version in Git is v-2011-05-24-ngs-hotfixes