Next server release: April Fools Day

April 1st may not be the best date to release a new server, but scheduling would have it that way: The next server update is officially scheduled for April 1st, 2007. To prevent the next release from becoming a bad April Fools joke, we will need your help to test the new features on the … Continue reading “Next server release: April Fools Day”

April 1st may not be the best date to release a new server, but scheduling would have it that way: The next server update is officially scheduled for April 1st, 2007.

To prevent the next release from becoming a bad April Fools joke, we will need your help to test the new features on the server. Recently we’ve asked people to come check out the new Labels support and the Data Quality support. Now that we’re coming to a close on this new release (there are still bugs to be fixed, but major functionality changes are done) we’d like people to come check it out again and help us test on the staging server.

The following features will be included in the next release:

  1. Improved cover art support: A new release-url Advanced Relationship link type has been created. By linking a release to a cover art JPG file at CD Baby or at the Internet Archive, editors will now able to deep link to cover art on sites other than Amazon.com. For more information on this feature, see CoverArtSites. See an example here and here.
  2. Data quality: Based on the first round of feedback, we’ve narrowed the data quality levels down to 3 from 4. The staging server has also been loaded with recent data and the ModBot is now running for a more complete test. See below for more comments on this.
  3. Label support: Label support has been around and a number of bugs have been fixed. For more info see Labels.
  4. Lookup nagging: Nagging tagger users who look up their files at MusicBrainz but who have not donated. If you go to to the taglookup page, you will be constantly nagged if you’re not logged in. If you log in, you will only be nagged every 5th lookup (I suspect that most people will be logged in). If you’ve donated to MusicBrainz, you wont be nagged at all. Designed to be not terrible right off the bat, I am curious to see what people think of this solution. Please point your tagger to http://test.musicbrainz.org and do some lookups to see if you think the current nagging approach will work ok.
  5. Bug fixes: Lots of them — see our milestone info for more details.

I have some more comments regarding the DataQuality feature — based on blog feedback I’ve changed the data quality levels to:

  1. Low
  2. Unknown
  3. High

I’m not certain if these are the best levels, but I wanted to throw out some thoughts that go with choosing these names/levels. First, the existing data and all new data that editors have not vouched for needs to have a name attached to it that makes sense. Just applying low data quality to all data by default will be unfair to large swatches of our data. I think one level needs to indicate that no human has vouched for the data and the other levels needs to indicate that someone has looked at the data and given it a thumbs up or thumbs down. Second, I like Low and High, but I am not a big fan of Unknown. What other word can we use that suggests that no human has vouched for this data?

Other suggestions I’ve tried for level names:

  • bad, unknown, good
  • unverified, unknown, verified

I tend to dislike these levels since labeling our data as bad seems like a poor idea. And verified is questionable as well — what do you verify the data against? So, please take the staging server for another spin and let us know what you think now. We still have nearly three weeks to try and figure our the best way of handling this.

Finally, the change artist/release quality edits are currently still auto edits for everyone — this will be changed before the release.

Thanks!

Headed to SXSW?

I’m leaving for SXSW in Austin in a few minutes. Are you going? If so, if you care to meet up and have a coffee/beer, please post a comment below and I’ll get in touch and arrange for a time to meet up.

I’m leaving for SXSW in Austin in a few minutes. Are you going? If so, if you care to meet up and have a coffee/beer, please post a comment below and I’ll get in touch and arrange for a time to meet up.

Data quality: We want your feedback!

The release locking concept has been around for quite some time and has been debated at great lengths. After a couple of long calls Don and I reworked the concept into the data quality concept. The idea is relatively simple: Each artist and each release in MusicBrainz now has a quality indicator that shows the … Continue reading “Data quality: We want your feedback!”

The release locking concept has been around for quite some time and has been debated at great lengths. After a couple of long calls Don and I reworked the concept into the data quality concept. The idea is relatively simple:

  • Each artist and each release in MusicBrainz now has a quality indicator that shows the quality of the data: Unknown, low, normal or high.
  • Data that is marked with low quality should be easy to change.
  • Data with normal quality should take about the same amount of effort to change as it takes now.
  • Data with high quality should be harder to change, to avoid incorrect changes to good data.
  • Each edit type will define the number of votes required to pass, the duration votes stay open, what to do if an edit receives no votes, and if a vote is an auto edit.

This new feature will allow us to edit sloppy data faster, tune the editing system to fit better with how people use it and it will allow us to prevent accidental edits to good data. Now we need to your help in testing this system and giving us feedback about the various edit levels.

If you would like to help, please read the data quality wiki page, view the new edit information page and then test the new features on the staging server. Each artist and release page now has a Change Quality link that will allow you to change the quality of the artist/release. Once those are changed, the edit system will behave according to the values set forth in the edit information page. Please note that the change artist/release quality edits are currently autoedits, which will be changed once we’re done testing the bulk of this new system. For right now we’re making it easy to change the data quality for testing purposes.

To start testing, head over to the staging server. Add any bugs you find to the bug tracker. Or post your feedback in the comments.

Direct bank transfers now possible!

Back in December I posted about donations to MusicBrainz and a number of people requested a way to do direct bank transfers. Unfortunately our bank wasn’t well set up for this purpose and I began seeking a new bank that could help us accept direct bank transfers without having to pay huge amounts of fees. … Continue reading “Direct bank transfers now possible!”

Back in December I posted about donations to MusicBrainz and a number of people requested a way to do direct bank transfers. Unfortunately our bank wasn’t well set up for this purpose and I began seeking a new bank that could help us accept direct bank transfers without having to pay huge amounts of fees. I’m pleased to announce that we are in the process of switching all of our banking over to Washington Mutual (WaMu)! WaMu has very kindly agreed to waive the incoming wire transfer fees (which are normally $10 per transaction) since we are a non-profit. With their support we can now offer direct bank transfers to all of our supporters.

If you’ve been wanting to make a donation to MetaBrainz, but weren’t able to do it previously, please consider sending us a donation now! To get our bank information, please contact us.

Also, I wanted to thank Jessica Rynerson of WaMu for her excellent help getting us set up and arranging for our wire transfer fees to be waived. Thanks very much!

UPDATE: I’ve removed our bank information since people immediately started to pass fake checks trying to rip us off. Fortunately the bank has caught all of these bogus checks!

Hardware wishlist

Our previous hardware wishlist is now fully checked off — thanks to Minor Ventures and Sun Microsystems for making that happen! But, as we grow we will always need more hardware, so I want to post a new wishlist for 2007. Here are the things that MusicBrainz needs: A 24, 32 or 48 port Gigabit … Continue reading “Hardware wishlist”

Our previous hardware wishlist is now fully checked off — thanks to Minor Ventures and Sun Microsystems for making that happen!

But, as we grow we will always need more hardware, so I want to post a new wishlist for 2007. Here are the things that MusicBrainz needs:

If you work for a company (or have a friend who does) that makes switches or hard drives, please consider hitting up the company for a donation to the MetaBrainz Foundation. Equipment donations are tax-deductible and I would be happy to give the donating company a tax-write off receipt!

UPDATE: James points out that Cisco has a program that makes donations to orgs like us. Could I convince anyone to volunteer to contract Cisco and apply for a grant on behalf of MetaBrainz??

Jaikoz MP3 Tag Editor and our new affiliate program

Jaikoz MP3 Tag Editor is the newest member of our tagger affiliate program! Paul Taylor has recently released a new version of his tagger and has agreed to join our affiliate program. With Jaikoz joining, I’ve laid down the details of the affiliate program so that others can participate in this program. If you are … Continue reading “Jaikoz MP3 Tag Editor and our new affiliate program”

Jaikoz MP3 Tag Editor is the newest member of our tagger affiliate program!

Paul Taylor has recently released a new version of his tagger and has agreed to join our affiliate program. With Jaikoz joining, I’ve laid down the details of the affiliate program so that others can participate in this program. If you are interested in finding out more about the program, please read our Tagger Affiliate Program page.

Welcome aboard Paul!

UPDATE: Paul points out that he has been paying 10% for a couple of years now and that taggers should kick down 10% was his idea in the first place.

MetaBrainz Foundation Annual Report 2006 available now

I’ve just completed the MetaBrainz Foundation Annual Report for 2006!

The report provides a close look at our finances, traffic, community and provides a general review of 2006. Some interesting tidbits from the report:

In 2006, the Foundation spent $10,758.67 on hosting and hardware costs and served out 614 million web hits and 352 million web service hits. Calculating a cost per hit, we find that we spent $17.56 per one million web hits and $30.58 per one million web service hits.

. . .

The balance sheet for 2006 shows that the MetaBrainz Foundation closed out the year with retained earnings of $7,984.50, net income of $6,338.95 and total cash assets of $14,423.45.

. . .

Mudcrow, our top editor and voter (peer reviewer) of 2006 made an astounding 100,998 changes to the database and voted on 38,347 edits from other editors! Thank you for all of your efforts mudcrow!

The report is full of other details about MusicBrainz and MetaBrainz. Go take a look!

Technorati Tags:

Ailing server replaced!

After 9 days of frustrating work to replace our failing main web server, we’ve implemented plan K (plans A – J failed!). Plan K involved making a previously unreliable server (lingling) reliable again by installing software RAID and then moving all of the services onto this machine. We just finished with that and the new … Continue reading “Ailing server replaced!”

After 9 days of frustrating work to replace our failing main web server, we’ve implemented plan K (plans A – J failed!). Plan K involved making a previously unreliable server (lingling) reliable again by installing software RAID and then moving all of the services onto this machine. We just finished with that and the new web server seems to be handling the load well so far.

Now its up to Dell to fix our server — fortunately, much to my surprise, we still have a service contract on that machine. So, its up to Dell to diagnose and fix the box and then we’ll put it back into rotation. Also, Steve Wyles (inhouseuk) has agreed to lend a hand in diagnosing the issues on moose, the new Sun Server — we’re suspecting a copy of Solaris that is too old to handle this new architecture.

So, expect more downtime in the future as we shuffle fixed machines back into rotation. Hopefully we’ll be able to proceed with a more sane pace from here on out.

Once again, giant kudos to Dave Evans for all his hard work! Thanks Dave!

MusicBrainz downtime redux

The attempt to switch the database to the new Sun server has failed and we’re still running with the old set of hardware. For some reason Postgres refuses to run with any kind of acceptable level of performance on this new machine. Thus, we’re setting aside this server for the time being and instead working … Continue reading “MusicBrainz downtime redux”

The attempt to switch the database to the new Sun server has failed and we’re still running with the old set of hardware. For some reason Postgres refuses to run with any kind of acceptable level of performance on this new machine. Thus, we’re setting aside this server for the time being and instead working to bring a replacement server online as soon as possible.

We’re also working with Dell to determine what the problem on the server is, and luckily the servers still have an extended warranty covering them with 4 hour on-site service. However, it appears that we need to diagnose the problem before Dell is willing to send someone out. I’ve run a memory test on the server and it passed all of its tests.

I’m out of ideas. I’m frustrated with Sun and Dell and will no longer waste time on their hardware trying to solve this problem. Instead I will work with whatever hardware I can scrounge up and get the service moved over to our spare server and then we’ll sort out the issues with our glorious servers.

It looks like it will at least be Friday before we can make the next attempt to fix this. Again, sorry for the inconvenience — we’re doing our best to fix this problem ASAP.

MusicBrainz downtime: January 17th, Noon PST

Tomorrow January 17th MusicBrainz will be unavailable starting at Noon PST, 15:00 EST, 20:00 UK, 21:00 CET, for at about 1 hour. The recent problems with certain artists not being found are being caused by a failing motherboard (specific guess: failing DMA controller). Fortunately the database server is still working well and the database has … Continue reading “MusicBrainz downtime: January 17th, Noon PST”

Tomorrow January 17th MusicBrainz will be unavailable starting at Noon PST, 15:00 EST, 20:00 UK, 21:00 CET, for at about 1 hour.

The recent problems with certain artists not being found are being caused by a failing motherboard (specific guess: failing DMA controller). Fortunately the database server is still working well and the database has not been affected by this hardware malfunction.

Tomorrow Dave Evans and myself will bring moose, our newly donated Sun Server, online and swap it out for the current database server. Once the new database server is up and running, we will want to monitor it for a while to make sure its doing its job properly. Once we’re convinced that it is doing its job, we will take the site down again and swap the drives in our then-to-be obsoleted database server with our ailing web server and bring the site back up.

After that we can remove the failing server and purchase a replacement motherboard — if you’d like to make a donation to help us cover the cost of the new motherboard (est: $800), we would greatly appreciate your support!

Thanks to Sun for the spiffy server that will get us out of a this bind and a big thanks to Dave Evans for his hard work getting our servers stable again.

I apologize for the inconvenience all this may have caused you.