Testing the NGS live data feed

If anyone would like to test out the NGS replication, which I’ve setup from the test server, follow these instructions:

  • Download and install the mb_server source code from SVN trunk. Follow these instructions.
  • Set your server type in DBDefs.pm to RT_SLAVE
  • Download and import this dataset.
  • Insert this required row into the database, using our psql program:
    cd /admin
    ./psql READWRITE
    insert into replication_control values (1, 12, 36169, '2010-01-23 00:00:02.604674+00');
    
  • Now run admin/replication/LoadReplicationChanges a few minutes after the hour to keep up to date with the data on the test server. Please note that this system may not be stable yet and that we will occaisionally load new data on our test server, which will require you to reload the data on your server.

Good luck!

3 thoughts on “Testing the NGS live data feed”

  1. -bash-3.2$ ./admin/replication/LoadReplicationChanges
    Failed query:
    ‘SELECT COUNT(*) FROM “Pending”‘
    ()
    DBD::Pg::st execute failed: ERROR: relation “Pending” does not exist at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 371.

    at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 382
    Sql::_select_list(‘Sql=HASH(0x547c1c0)’, ‘SELECT COUNT(*) FROM “Pending”‘, ‘ARRAY(0x6556d20)’, ‘arrayref’, ‘CODE(0x6545f20)’) called at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 404
    Sql::select_list_of_lists(‘Sql=HASH(0x547c1c0)’, ‘SELECT COUNT(*) FROM “Pending”‘) called at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 339
    Sql::select_single_column_array(‘Sql=HASH(0x547c1c0)’, ‘SELECT COUNT(*) FROM “Pending”‘) called at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 354
    Sql::select_single_value(‘Sql=HASH(0x547c1c0)’, ‘SELECT COUNT(*) FROM “Pending”‘) called at ./admin/replication/LoadReplicationChanges line 133
    DBD::Pg::st execute failed: ERROR: relation “Pending” does not exist at /var/www/musicbrainz/mb_server-trunk/admin/replication/../../lib/Sql.pm line 371.
    at ./admin/replication/LoadReplicationChanges line 133

  2. Nick:

    I suspect foul play on your server — the Pending table isn’t removed/readded in the course of normal replication. And my replication stream is still working fine:

    Fri Feb 5 10:41:44 2010 : ProcessReplicationChanges complete
    Fri Feb 5 10:41:44 2010 : Downloading http://test.musicbrainz.org:82/pub/musicbrainz/data/replication/replication-36198.tar.bz2 to /tmp/replication-36198.tar.bz2
    Fri Feb 5 10:41:44 2010 : Replication packet #36198 not available

    Perhaps this can be salvaged by doing this:

    cd admin
    ./psql READWRITE < sql/ReplicationSetup.sql

    and then LoadReplicationChanges

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.