Addressing MusicBrainz' growing problems: part 2

In part 1 I set the groundwork for how we arrived at our current situation of me being overloaded, and in part 2 I would like to start looking at long term solutions to issues from part 1. Part 3 will look at more short term solutions. I know there are a number of people … Continue reading “Addressing MusicBrainz' growing problems: part 2”

In part 1 I set the groundwork for how we arrived at our current situation of me being overloaded, and in part 2 I would like to start looking at long term solutions to issues from part 1. Part 3 will look at more short term solutions.

I know there are a number of people who do not like the fact that MusicBrainz is a business. But we have to realize that MusicBrainz and its legal parent the MetaBrainz Foundation is a non-profit business and that it would not really be possible to grow such a project without it being a business. (Before we started the non-profit everything was owned by myself, which IMHO is a much less desirable way of doing this.) We are still an open source project. We’re also an open data project.

Something is working: We have users, editors, peer reviewers and loads of traffic. We even have $$$ money flowing into the non-profit. The community is constantly asking for more features to expand the database and to improve the service.

However, something is not working: We’re dreadfully short on server developers. The number of people who have made serious contributions to the mb_server project can be counted on one hand (or pretty close to that). In order to work on mb_server you need to have a linux box, with free disk space, a fair amount of RAM and you have to have the skills to deal with the long INSTALL process. Some people simply do not own a machine that is capable of doing this!

And even those people who can deal with technical requirements are not necessarily up for the social issues that come with the job. The community can be very demanding and quite harsh at times — no one wants to work long hours for free only to have their work insulted. Compared to ordinary open source projects, mb_server is quite challenging to work on. No doubt about it, its a tough and harsh job that people have been doing for free.

Going forward I will be working very hard to raise funds in order to hire a full time mb_server developer. We’ve passed the point where we can handle all of the mb_server development tasks with volunteer labor. Programming a project towards self-sustainabilty is quite different from programming to scratch an itch. We still have many itches that I hope volunteers will take on, but managing and coding towards sustainability will soon need to be handled by a full time paid developer.

How do we accomplish such a thing? Ever since the last summit where we hammered out the Next Generation Schema I’ve been talking to potential sponsors about donating money towards the development of this next version of MusicBrainz. Finally we have a concrete task to focus on, rather than just trying to make the basics work. Various companies have been receptive to this idea and I will continue to look for sponsors for this task.

My goal is to raise $100k – $200k in hopes of being able to secure a salary for an engineer for one year. The hope is to sell enough data licenses in the course of that year to keep the developer on and pay for this person’s salary. Once this engineer is on staff, I would expect to see 2-4 releases over the this year to prepare for and roll out the Next Generation Schema.

I expect that my time will continue to be taken by running the business development aspects of Musicbrainz and interacting with the community and partners. However, please don’t take this as me no longer participating in the development process. I will still be involved — certainly to manage the process and also to hack out my personal itches. I just don’t think its viable for me to be the official maintainer of any major pieces of code.

Please keep in mind that this is long term planning. I have no schedule for when this will happen. Please don’t mail me in two weeks asking to be hired or to have Next Generation Schema working.

Technorati Tags: , ,

Addressing MusicBrainz' growing problems: part 1 of many

I’m finally back from being on the road. I’ve caught up on much needed sleep and am now working regular hours again. This means its time to address the various issues that we left to ponder before I went on vacation and my trip to Europe. While I was in Europe and in IRC while … Continue reading “Addressing MusicBrainz' growing problems: part 1 of many”

I’m finally back from being on the road. I’ve caught up on much needed sleep and am now working regular hours again. This means its time to address the various issues that we left to ponder before I went on vacation and my trip to Europe. While I was in Europe and in IRC while I was rebooting our database server, inhouseuk said the following:

inhouseuk: you need to start behaving more like a sort of CEO rather than a one man band ๐Ÿ™‚

I agree. But then, what exactly is this sort of CEO (or rather sort of Executive Director) supposed to do? And what isn’t he supposed to do? Thats a really tough question that I would like to pose to the community at large. If you have any thoughts on this, please speak up.

The first thing that I want to do is to describe the job I have been performing for the last two years since the non-profit has been running. Then, with help from the community I would like to come up with my job description going forward. That way we can all be on the same page about I should and should not be doing.

Things that I should probably not be doing any longer are in bold.

Executive Director of the MetaBrainz Foundation

Server maintenance

  • Hardware purchasing/acquistion of used hardware
  • Colocation issues/contracts/maintenance
  • Managing hardware costs and future planning
  • Manage off-site servers (nl., test.)

Business Development

  • Conferences/tradeshows/schmoozing/maintaining contacts for MusicBrainz
  • Meetings with potential partners/licensees
  • New licenses sales
  • Managing and soliciting sponsors
  • Raise funds for further server development

Development

  • mb_server (and too little of it)
  • lucene searching

Legal Department

  • Licenses for data/software/web services
  • Contracts for data/licenses/web services
  • Interacting with lawyers
  • Find pro bono lawyers

Community Relations

  • Answering questions in IRC/mail/blog/mailing lists
  • Conflict resolution
  • Managing developers

Foundation Issues

  • metabrainz.org web site/donation tracking
  • State/federal filing requirements
  • Board of directors management/meetings

Accounting

  • Keep general books, manage invoices, pay bills
  • File tax reports/manage accountants
  • Post monthly financial results
  • Manage bank accounts/investments

Support

  • Answer support@ emails, with help from Wolfsong
  • Help partners/licensees (at least have support@ team help

Please note that not all of these tasks are things I do every week. But should something come up, I have to rise to the task. If a server tips over, I go to fix it. If a customer has a question I ask it. I may just go for weeks without dealing with a tipping server.

Do you agree or disagree with the items I’ve identified as things that I should not handle any more?

Technorati Tags: ,

Temporary MusicBrainz outage

MusicBrainz will not be reachable for about 5 minutes starting tomorrow Sept 20th at midnight, PDT. Digital West is reconfiguring their network during this time. Sorry for the inconvenience. Technorati Tags: musicbrainz

MusicBrainz will not be reachable for about 5 minutes starting tomorrow Sept 20th at midnight, PDT. Digital West is reconfiguring their network during this time. Sorry for the inconvenience.

Technorati Tags:

Magic MP3 Tagger: Results from the first month

Matthias the author of Magic MP3 Tagger suggested that I post about the first month’s take, since it exceeded both of our expectations. With the new links to his tagger added to the MusicBrainz site, his registrations increased significantly so that he paid us 401.02 Euro (514.75 Dollars) for the month of August alone! This … Continue reading “Magic MP3 Tagger: Results from the first month”

Matthias the author of Magic MP3 Tagger suggested that I post about the first month’s take, since it exceeded both of our expectations.

With the new links to his tagger added to the MusicBrainz site, his registrations increased significantly so that he paid us 401.02 Euro (514.75 Dollars) for the month of August alone! This is far from spare change — this nearly covers the cost of our bandwidth bill!

As our costs for hosting are increasing, I’m quite pleased to see that more money is coming in to keep our costs covered. Thanks much for pestering me about this Matthias! Three cheers to many more months of cooperation!

Returning to the land of MusicBrainz

After a much needed break and an extensive camping trip, I’ve finally returned to the land of MusicBrainz. However, instead of returning to San Luis Obispo to tackle new challenges, I’m in London this week. The BBC invited me for a few days to explore the possibilities how MusicBrainz and the BBC can work together. … Continue reading “Returning to the land of MusicBrainz”

After a much needed break and an extensive camping trip, I’ve finally returned to the land of MusicBrainz. However, instead of returning to San Luis Obispo to tackle new challenges, I’m in London this week. The BBC invited me for a few days to explore the possibilities how MusicBrainz and the BBC can work together.

While I am in London I am checking mail and catching up on the happenings of the past couple of weeks. I am also starting to think about how to solve the various growing pains that MusicBrainz is experiencing at the moment. After my break I have a much clearer view of the world and a much better head space.

Stay tuned for some thoughts on how to tackle our current set of challenges!

Technorati Tags:

TRM server outage

The TRM server hardware has been giving us some issues in the last week. We’re having to reboot the TRM server a lot more frequently than I care for, so I will take the TRM server down tomorrow and have a look to see what the issue might be. The TRM server will be offline … Continue reading “TRM server outage”

The TRM server hardware has been giving us some issues in the last week. We’re having to reboot the TRM server a lot more frequently than I care for, so I will take the TRM server down tomorrow and have a look to see what the issue might be.

The TRM server will be offline for about 1-2 hours tomorrow Wednesday August 23rd, at Noon PST/2000 BST/2100 CEST.

UPDATE: The outage is now over — I could not find any problems with the server, so the random lock-ups go unexplained. ๐Ÿ™

Technorati Tags: ,

Final call for testing

After passing on the release last weekend, I think we’re ready to try again. This is the last call for bugs for this release! If you find a serious bug, please enter it into trac and I’ll see about getting it fixed. Please don’t enter any enhancements requests for this release — I’m only fixing … Continue reading “Final call for testing”

After passing on the release last weekend, I think we’re ready to try again. This is the last call for bugs for this release! If you find a serious bug, please enter it into trac and I’ll see about getting it fixed. Please don’t enter any enhancements requests for this release — I’m only fixing bugs at this point and will do no enhancements right now.

The bug fix update release is scheduled for this Sunday. Go test on the staging server and report bugs or look at the list of closed bugs.

Technorati Tags: ,

New staging server up!

Over the past few weeks I’ve taken our venerable first server zim and given him a bit of an overhaul. A new motherboard, with 2GBs of RAM and a RAID SATA controller have given Zim a new lease on life as our test server. Now that the test server is no longer at my house, … Continue reading “New staging server up!”

Over the past few weeks I’ve taken our venerable first server zim and given him a bit of an overhaul. A new motherboard, with 2GBs of RAM and a RAID SATA controller have given Zim a new lease on life as our test server. Now that the test server is no longer at my house, I can stop paying for the expensive net connection with the static IPs. Yay!

The staging server is currently called zim2.musicbrainz.org, but this should be fixed some time tomorrow.

I would like to give a big-fat thanks to Cliff Skolnick, Apache contributor and the leading force behing RightRound. Cliff is hosting our new staging server in his personal hosting setup as a favor to MusicBrainz. Thanks Cliff and the team at RightRound — we appreciate your support!

Technorati Tags: , ,

Developer changes

As many of you may have noticed, we’ve had a number of conflicts surrounding the development of the MusicBrainz server source code. Open source developers must work to foster the community of their projects and work towards creating a consensus towards new/improved features. After an increasing number of conflicts with the community Stefan was warned … Continue reading “Developer changes”

As many of you may have noticed, we’ve had a number of conflicts surrounding the development of the MusicBrainz server source code. Open source developers must work to foster the community of their projects and work towards creating a consensus towards new/improved features.

After an increasing number of conflicts with the community Stefan was warned that his actions as a developer were not acceptable. After countless emails and a number of Skype calls I warned Stefan that the next time he participated in an escalation with one of the community members that I would remove his developer privileges.

Today another one of these escalations took place and I removed Stefan’s developer privileges.

As of right now, I will assume all duties of the MusicBrainz server developer. I will fix any remaining bugs, settle remaining conflicts and work to get the next bug update done as soon as possible. Fortunately now that I can devote all my time to MusicBrainz, I will have more time to devote to getting new server features coded.

With a heavy heart,

Evil Overlord

Technorati Tags: ,