Mini-Summit Session Notes

Yesterday we held our mini-summit in London to great success. The MusicBrainz team huddled up in a hotel last night and finished writing up notes of everything we covered, and you can now have a look at them on the wiki at MusicBrainz Summit/2012-Mini_Summit/Notes. In general, we provided an update of what’s been happening at MusicBrainz, what’s coming up in the future, and heard how each company are using MusicBrainz. Discussions have started with respect to classical support, but don’t expect anything concrete any time soon!

Many thanks to everyone who came along to this summit and helped make it work – it was great seeing you all!

2012-01-12 Schema change fix for replicated slaves

Sadly, our testing for replication failed to catch a problem with the instructions we posted yesterday. If, when running the replication scripts you encountered the below error, please read on!

Attribute (conn) does not pass the type constraint because: Validation
failed for 'DBIx::Connector' with value DBI::db=HASH(0x9e957d0)
(not isa DBIx::Connector)

We made some changes to our database connection routines recently, and the replication scripts were not correctly migrated. We’ve got these changes in now though, so to fix this problem, repeat the instructions in our previous post, but use the v-2012-01-12-schema-change-2 tag. This should correspond to commit eb89c2b51f79..., which you can verify by running git rev-parse HEAD.

Sorry about these problems!

Schema change, 2012-01-12

We’ve just finished pushing out the scheduled schema change update today. A slightly rocky experience, but we’ve managed to get everything ironed out now and our servers are back to their normal selves. Before, I get into release notes, a few notes for people who’d like to upgrade their non-replicated servers. For replicated servers, please see this post.

  1. First, update your repository to the v-2012-01-12-schema-change tag.
  2. Next, disable any MusicBrainz cron jobs you might have scheduled to run
  3. Run ./upgrade.sh provided in the root directory of your musicbrainz-server checkout.
  4. Update your DBDefs DB_SCHEMA_SEQUENCE configuration option to 14.
  5. Turn any cron jobs back on

And onto the release notes!

Bug

  • [MBS-2121] – Deleting track/row in advanced tracklist editor while artist credits "dialog" is open leaves it stuck
  • [MBS-2390] – It’s not really possible to assign a track to a recording because cannot see length of track in either tracklist or proposal list
  • [MBS-2620] – Most ‘edit’ edits do not check for conflicts
  • [MBS-3393] – App keeps DB connections open and doesn’t reconnect upon DB restart.
  • [MBS-3696] – Using Jamendo as License Relationship fails due to Javascript change to Cover Art relationship
  • [MBS-3972] – ISWC column on works page should be nowrap
  • [MBS-4046] – Releases with pending edits are not marked as such in label page
  • [MBS-4099] – The server should give a good error message when it can’t connect to the DB
  • [MBS-4103] – Problems building database extensions with Ubuntu 11.10
  • [MBS-4129] – "Edit artist" doesn’t change artist credit for credits that were unchecked by default but checked manually
  • [MBS-4132] – Rate limited pages send HTML as text/plain
  • [MBS-4134] – Javascript sorting broken on Country statistics page since comma has been introduced
  • [MBS-4136] – beta.mb: recording edits generated by release editor when updating recording information from track changes are not auto-edits
  • [MBS-4138] – Language-Script page in statistics broke
  • [MBS-4146] – Track times deleted if using tab key
  • [MBS-4149] – The added referrer stuff breaks Amazon UK links
  • [MBS-4157] – beta.mb: Edit recording edits seem to create a ‘edit release’ edit too
  • [MBS-4169] – CDToc page shows blank/empty catalog numbers separated by commas

Improvement

  • [MBS-1482] – Report: no language, no script
  • [MBS-2439] – Releases with multiple catalog numbers are shown multiple times on the Label page.
  • [MBS-2513] – Allow updating recording information when track information changes via the release editor
  • [MBS-3288] – Release group type isn’t shown when looking up a release group
  • [MBS-4105] – Warn when merging releases with track artists that don’t match

New Feature

  • [MBS-4147] – Display AcoustIDs using JavaScript

Task

  • [MBS-3672] – Remove the deprecated Live Sound Engineer relationship

Sub-task

  • [MBS-2676] – Filter by relationship type

Server update, 2012-01-05

With Christmas, New Year, and all that fuss out of the way, I’ve finally been able to get a new release out. We’re only 2 weeks behind on this one I think… oops. Hopefully, we make up for it with these fixes. Also, just a quick reminder that our little scheduling website is open, and needs your feedback to help us decide what will make it into future versions. Happy editing!

Bug

  • [MBS-1117] – Show relationship attributes on artist relationship pages
  • [MBS-1169] – Musicbrainz website is missing HTML escaping on user entered data
  • [MBS-1391] – Relate to… box stays up until you click cancel
  • [MBS-2022] – Amazon referrer stuff not included in Amazon links
  • [MBS-2770] – Inline Search: problems changing from indexed to direct
  • [MBS-3352] – Typing "57" in length field should become "0:57"
  • [MBS-3357] – In Release Editor Recordings tab there direct search doesnt seem to consider the artist when showing matches.
  • [MBS-3512] – Release editor added a track duration out of the blue
  • [MBS-3790] – Error (foreign key constraint violation) when editing URL
  • [MBS-3832] – Clicking one "vote on all edits" button doesn’t unselect other
  • [MBS-3941] – Can’t unselect an entity in Add Missing Entities
  • [MBS-3942] – Proposer and seconders can’t see voting tally in autoeditor elections
  • [MBS-3953] – /ws/2/release/mbid with ‘recordings’ inc parameter crashes if the release doesn’t have any tracks
  • [MBS-3970] – Admin menu in menu bar not displayed anymore
  • [MBS-4012] – Track times without colons are no longer guessed
  • [MBS-4015] – Edit Relationship page is missing some css
  • [MBS-4042] – Disambiguation field is still labelled as "comment" on some pages
  • [MBS-4086] – Data dumps don’t import using master

Improvement

  • [MBS-801] – Display release relationships on release page
  • [MBS-1362] – Add Range-checkbox-checking to site
  • [MBS-1368] – Inline Search: focus on a field
  • [MBS-1627] – Transcluded documentation should have hierarchy links
  • [MBS-1904] – Background no longer changes colour when voting
  • [MBS-1911] – Cryptic warning when merging works.
  • [MBS-2409] – Allow removing recording-PUID links from the /puid pages
  • [MBS-2465] – RE: Add Guess Sortname to the Add Missing Entities tab
  • [MBS-2531] – Add IPI lookup to the lookup page
  • [MBS-2890] – Show artist comment in Edit / Add medium edits
  • [MBS-3042] – Add the possibility to update artist credits when renaming an artist
  • [MBS-3277] – Make menus go away when I stop hovering
  • [MBS-3447] – Releases should show how many people have it in their collection
  • [MBS-3494] – Allow "Edit artist credit" to rename artist credits
  • [MBS-3520] – Rename "quality" to "data quality"
  • [MBS-3604] – Use tooltip to inform users on tracklist editor why they cannot edit track lengths
  • [MBS-3854] – Annotation history page is confusing
  • [MBS-3896] – "Change RG" page says nothing if search finds no results
  • [MBS-3999] – Add user panel display for limited accounts
  • [MBS-4011] – Allow kasi-time.com URLs for lyrics

Task

  • [MBS-3779] – Products menu needs to link to client libraries

Sub-task

  • [MBS-3973] – Filter by label country

Scheduling opened to all unscheduled tickets

We finished making some decisions on a few tickets in IRC today regarding scheduling stuff that was in the Scheduling Game. After this, we decided that it was time to open the game up to all issues that we weren’t sure when to schedule. This means that scheduling.ocharles.org.uk now has approx. 700 issues that we need help scheduling!

For more information on the scheduling game, see the introductory blog post.

It’s a lot to get through, but over time, the critical issues should gradually rise to the top, and our core developers can help solve these as quickly as possible. Happy voting, and thanks for all your help so far!

Server update 2011-12-05

Another update has just gone out, a few days later than planned. This is mostly a bug fix and minor improvement release. Sadly, when deploying the update we broke the release editor for anyone who was editing during the server switches – something we didn’t anticipate. Sorry! Here’s what’s changed:

Bug

  • [MBS-2371] – Can’t type in the basic tracklist editor
  • [MBS-2785] – Release Editor messes up release artist multi-artist credits
  • [MBS-3152] – Tracklist duplication with sub-second track duration differences
  • [MBS-3428] – If seed new release with track artist ids it doesnt properly resolve the artist ids
  • [MBS-3471] – Wrong display of RG in the Edit Note tab of the RE
  • [MBS-3498] – Editing tracklists on any release which has been through an artist split fails.
  • [MBS-3601] – Incorrect "Artist as credited" displayed and impossible to edit track artist in release editor
  • [MBS-3804] – Entering "Edit barcodes" edit should not be possible if nothing is being changed
  • [MBS-3808] – Internal server error searching for edits
  • [MBS-3813] – Release editor gets stuck on tracklist tab saying there are errors when there are none
  • [MBS-3814] – Guess case broken in the RE
  • [MBS-3816] – Track parser displays "This is placeholder text" instead of instructions (or nothing)
  • [MBS-3831] – "There were one or more errors, please check the following fields: " after changing the capitalization of one letter
  • [MBS-3836] – Tracklist tab showing only the first track when importing a CD stub
  • [MBS-3849] – RE: Can’t import FreeDB releases through Add Disc
  • [MBS-3858] – Tracklist duplication with equal sub-second track durations
  • [MBS-3864] – importing a cd stub only gives you the first track in the track editor
  • [MBS-3908] – Edit numbers in edit notes should not be parsed when they are on different lines

Improvement

  • [MBS-89] – Subscribed artist e-mails should be optional
  • [MBS-2924] – timeline.js should use MB.html
  • [MBS-3239] – Subscription emails > Option to receive weekly
  • [MBS-3356] – Seeded add release (copied from existing release) doesnt link tracks to recordings of copied release
  • [MBS-3684] – Improve sorting of the "Releases with superfluous data tracks" report
  • [MBS-3743] – Move the trackparser (basic view) on the tracklist tab to the "Add Disc" dialog.
  • [MBS-3892] – Display artist disambiguation comments on mouse over

New Feature

  • [MBS-3899] – Report: Discogs pages attached to multiple release groups

Task

  • [MBS-3911] – Remove all "DeferredUpdate" code

Sub-task

  • [MBS-3733] – Add create/get session logging to release editor, to debug MBS-3379 / MBS-3590.

Have Your Say In Scheduling

In an effort to bring the community into our development process more, I (ocharles) have built a new little application to help the MusicBrainz community decide exactly what we should focus on. I present to you, the Scheduling Game!

The Scheduling Game
The Scheduling Game

The idea behind this little application is to let the community quickly scan through open issues and decide when they believe they should be fixed. Each editor is presented with 3 options:

  1. Within 3 months. This ticket must absolutely be fixed within 3 months from now.
  2. Within 12 months. This ticket should be fixed within a year from now. This means the ticket should be fixed within the year, but is not critical for the next 3 months
  3. Unscheduled. This issue is not pressing and can be fixed much later.

Later, when issues have been voted on by enough people, the developers will try and decide how to schedule work to best fit the needs of the community.

A few disclaimers… Firstly, this is just an experiment! We don’t know how well it will work, though initial testing has shown it to already be quite useful. Secondly, it’s not really much of a game, but I wanted to give it a cute name (I know how picky everyone can be!). Currently only a subset of open tickets are available for voting on – specifically tickets in the “NGS + 1” and “Post NGS” milestones on JIRA, as these milestones are in need of a sorting.

The scheduling game is currently live on my server at http://scheduling.ocharles.org.uk/. You can have a look at the current (anonymous) votes at http://scheduling.ocharles.org.uk/results. If you have any questions or comments, you can reach me in IRC as ocharles or email oliver@musicbrainz.org. Happy voting!

Server update 2011-11-21

A few days behind on this one, but we’ve got this release out. This release has one controversial change, which I want to discuss in this blog post.

Displaying Relationships on Release Pages

A lot of people want this, and we’ve shipped something that adds this functionality. However, a lot of people think this is too verbose, and to a point I agree – there’s a lot of information there that can be displayed better. However, work on this issue has been on and off for almost the past 2 years. We’ve got a solution here that while far from ideal will get this ball rolling.

This is an unpopular move on my half, but I’m asking users to please try and bear with us until the next release (scheduled in for 5th December), which is just over a week away. Hopefully having this fairly messy display so open will raise enough discussion on how exactly to move forward. If you really must see it gone, you can use AdBlock or user styles in your browser to hide the dl.ars element.

Changes in this Release

  • [MBS-2067] – CDStub not displayed in the "Matching CDs" section on CDTOC lookup page
  • [MBS-3668] – all edits including "Auto-edits" are being tallied as "Accepted" edits in editor profile
  • [MBS-3688] – Wrong coverart on all-zeros barcodes
  • [MBS-3718] – Inline search has problems with search terms with " (double quotes) and colons in them (and maybe others)
  • [MBS-3734] – Google indexes MusicBrainz search result (and some other) pages it shouldn’t
  • [MBS-3754] – Splitting an artist shouldn’t be an auto-edit
  • [MBS-3755] – Importing from FreeDB puts the artist name in the wrong field
  • [MBS-3759] – Auto-editor election isn’t showing own vote (instead: private)
  • [MBS-3764] – Typo on artist merge page
  • [MBS-3768] – Error when editing URL into one that already exists
  • [MBS-3777] – Musicbrainz breaks https://secure.wikimedia.org link in edit notes
  • [MBS-3786] – Entities with tag count on top of tag view page is incorrect

Improvement

  • [MBS-2979] – Enable CORS (Cross-Origin Resource Sharing)
  • [MBS-3105] – Country/Language/Script statistics should include a statistic for those with none set.
  • [MBS-3752] – Making edit note for "Add release" mandatory
  • [MBS-3767] – Distinguish between Discogs master and release URLs on release pages
  • [MBS-3778] – Separate release group links from release links on release pages

New Feature

  • [MBS-496] – Display recording relationships on a release page
  • [MBS-3761] – Add songfacts to the sideboard

Server update 2011-11-14

It’s been a while, but we’ve finally got a new server release out! This one didn’t go perfectly smoothly, and we had (more, i’m afraid) troubles with the release editor. We’ve got a fix for this out, so editing should be at least as stable as it was before. As always, please do continue to report any bugs you find. Here’s what’s changed:

Bug

  • [MBS-761] – Release has ASIN but no cover art ("No cover image available.")
  • [MBS-1169] – Musicbrainz website is missing HTML escaping on user entered data
  • [MBS-2529] – Orphaned release group and recordings after rejecting or cancelling a release/medium
  • [MBS-2590] – Unused URLs not being removed
  • [MBS-2847] – Merging artists moves the comment from the old artist to the new one
  • [MBS-3102] – Changing release artists automatically changes all track artists
  • [MBS-3305] – Artist missing in edit medium edit
  • [MBS-3451] – Unterminated link on CD Stub page causes "Overview" and "Edit" tabs to display incorrectly
  • [MBS-3466] – otherlookup for non-existent MBID throws ISE
  • [MBS-3522] – Bad gateway errors in Add Missing Entities trying to add large VA releases without locking down artists
  • [MBS-3656] – Clicking text (Yes/No/Abstain/None) on the most recent open edit changes votes on all edits in that page.
  • [MBS-3657] – Medium order not allowed when merging releases
  • [MBS-3675] – Modbot failing edit relationship edits with "This relationship has already been deleted"
  • [MBS-3677] – Recording page doesn’t highlight releases with pending edits or show disambiguation comments
  • [MBS-3689] – Tagger button on tag lookup for recordings confusingly leads to "non-album tracks"
  • [MBS-3715] – Fix the wording for YouTube videos on the sidebar
  • [MBS-3719] – Format/display of recording search results is broken for standalone recordings
  • [MBS-3741] – Incorrect artist_credit.name

Improvement

  • [MBS-1766] – Display lyrics and score links in work sidebar (in the External link section)
  • [MBS-2478] – Pages for releases should also show ARs from the release group they are contained within.
  • [MBS-2942] – Warn users that FreeDB indexes are only updated monthly
  • [MBS-3192] – Display release group URLs also on release pages
  • [MBS-3495] – Make IMSLP links look like the Wikipedia ones
  • [MBS-3508] – Indicate if a release group contains only one release in release group
  • [MBS-3713] – Add JS autoselect for the SoundCloud relationships
  • [MBS-3714] – Add cleanup for YouTube video URLs
  • [MBS-3747] – Create script to split arranger relationships

New Feature

  • [MBS-71] – Add auto-editor elections

Task

  • [MBS-3697] – MusicBrainz needs to comply with new changes of Amazon Product Advertising API taking effect on October 25, 2011
  • [MBS-3710] – Tranclude "People" instead of "MusicBrainz_Bio"

Server update, 2011-10-10

With the summit arrangements this release has become delayed, but we’re happy to announce that we have just finished releasing this version (live from the summit!). Here’s what’s been fixed in this release:

Bug

  • [MBS-1868] – Historic move disc id appears oddly
  • [MBS-2001] – Some AddReleaseLabel edits have no entity_id
  • [MBS-2196] – Can’t delete unused relationship type
  • [MBS-2429] – External links don’t appear for last.fm URLs
  • [MBS-2467] – RE: Add Missing Entities problems with caps
  • [MBS-2539] – Inline tag edit : forbidden characters are not removed form the edit box
  • [MBS-2682] – [ws/1] track-list offset is incorrect
  • [MBS-2699] – Merging works always add titles of merged works as aliases of target work
  • [MBS-2938] – Cannot import/seed 99-track releases from FreeDB
  • [MBS-3034] – Immediately remove PUID
  • [MBS-3070] – Release editor cannot be seeded with >99 for array-like elements
  • [MBS-3223] – Work relationships not available in web service recording requests
  • [MBS-3336] – NGS /ws/1 doesn’t include some relationships
  • [MBS-3350] – ws/2 browsing release by track artist
  • [MBS-3372] – Add relationship not linking to the URL entity
  • [MBS-3442] – WS/2: Can’t browse work by artist (ws/2/work?artist=MBID)
  • [MBS-3456] – Selecting recording from search results in work "Relate to…" doesn’t close results
  • [MBS-3463] – Remove ISRC edits are not shown pending on recording page
  • [MBS-3477] – Crash when trying to edit a release to create a new release group
  • [MBS-3483] – Release editor > Importing a Various Artists CDStub doesn’t import track artists
  • [MBS-3509] – Change release group via release editor doesn’t show up in edit history / open edits of target release group
  • [MBS-3523] – Entity not being selected for relationship
  • [MBS-3528] – Internal Server Error – Couldn’t render template "undef error – Can’t call method "value" on an undefined value at /usr/local/share/perl/5.10.1/HTML/FormHandler/Field.pm line 89. "
  • [MBS-3564] – Cover arts from ozon.ru are not diplayed
  • [MBS-3570] – change direction not working when no relationship type was selected first.
  • [MBS-3573] – Got Internal Server Error while updating info for ‘Mob Hits [Disc 2]’
  • [MBS-3577] – Release editor converts unicode characters to HTML quotations
  • [MBS-3584] – amazon.es is not recognized as ASIN in "Add URL Reference"
  • [MBS-3591] – Finding some labels in AJAX search is impossible
  • [MBS-3592] – Artist aliases have extremely low priority when doing a simple search
  • [MBS-3622] – Internal Server Error during import of freedb release that cannot be found
  • [MBS-3623] – Edit relationship fails with internal error when attempting to move credits between recordings
  • [MBS-3625] – The FreeDB page throws an exception if you try and view it when the disc doesn’t exist

Improvement

  • [MBS-962] – Allow more characters in tags
  • [MBS-2276] – Report: released before 1982 but has DiscID attached or CD medium
  • [MBS-3234] – Report: deprecated use of "(feat."
  • [MBS-3295] – Report: releases with an ASIN as catalogue number
  • [MBS-3382] – Report: releases with only some mediums with format
  • [MBS-3582] – Amazon-Links should state country like Wikipedia links do
  • [MBS-3620] – Improve the search results for autocompleted editor searches

New Feature

  • [MBS-3363] – Report: same ASINs attached to multiple releases
  • [MBS-3364] – Report: Discogs pages attached to multiple releases

Sub-task

  • [MBS-3315] – Add the ‘Possibly duplicate artists’ report
  • [MBS-3316] – Add the ‘Release Groups that might need to be merged’ report
  • [MBS-3317] – Add the ‘Releases with duplicated or missing track numbers’ report
  • [MBS-3318] – Add the ‘Releases with superfluous data tracks’ report
  • [MBS-3319] – Add the ‘Tracks whose names include their sequence numbers’ report