After many more months of hacking on core infrastructure and improving our codebase, we’re finally ready to have more people come and help us test the latest beta version of ListenBrainz. Also, we’ve recently reached a milestone of the 100th million listen in our database!
We’ve made a some internal changes to the project (that took quite a bit of effort):
- Improve hosting setup that allows us to run both the production and beta version of the site at the same time. This means that any data submitted to the beta site will be submitted to the master listens database and will be available in the BigQuery data set as well. We are mimicking the setup that MusicBrainz has — the beta site use a live database so that testing the service can work with live data.
- Improve internal container setup to allow for both dumping the listen data and private data for complete backups.
- Improve the speed with which we process incoming listens.
These internal changes will allows us to move to more frequent updates of ListenBrainz in the future! More important are the changes to the site that are user visible:
- Statistic infrastructure: We’ve created an infrastructure for creating graphs of user’s listening behaviour. So far we’ve only got an all-time top-artists graph to illustrate our setup, but soon we will work to create more graphs. Currently graphs will be generated every Monday starting at 0:00 UTC, if you logged in into your LB account during the last 30 days. If you haven’t logged in recently, you can request the calculation of your stats from your profile page.
- Automatic data dumps: Now the ListenBrainz data will be dumped and synced to our FTP site twice a month. Currently this is scheduled for the 1st and the 15th of every month. The dumps will start being generated at 04:00 UTC and then copied to our FTP site and it will take a number of hours for the data dumps to appear on the FTP sites. Our documentation details how this data dump can be consumed.
- Documentation improvements: Quite a few documentation bits have been improved since our last release, including better documentation on the Last.fm compatible API that ListenBrainz exposes.
- Static page improvements: We’ve done some rearranging of our static pages and navigation bar to reflect the latest changes, including updating the data page and our roadmap page.
- Listen count on home page: The home page now shows the current listen count.
If you’re interested in helping us test, please use the beta site and test everything you can see. See if anything misbehaves and if you do spot any problems, please report them to our bug tracker! Hopefully we can push this live next week.
NB: The beta site is connected to the live database, so any listens you submit to it, will be part of your official ListenBrainz listen history!
2 thoughts on “ListenBrainz winter 2018 beta testing”
Fantastic update! It’s great to see things moving along and the data being put to use.
I’m hoping that ListenBrainz can get around the commercial-centric ideas of Last.fm by allowing top artists to be displayed by time rather than play counts. As it stands, the current format favours genres and artists who produce “radio-friendly” tracks 3-4 minutes long. It doesn’t give a true picture of listening habits as genres which produce more long form pieces like Jazz, Classical, and Electronic end up with smaller counts.