New Feature: Improved Text Searching

I’ve always been a bit dissatisfied with how I set up the Artist field in music4dance.  A free text field for the artist generally works, but it doesn’t capture everything I’d like.  But since the core functionality of music4dance is to associate songs with dance styles, keeping the rest of the system simple is a sound decision, and I stand by it.

However, something comes up every few years that makes me want to at least incrementally improve the text search part of the system.  When Prince left us, I broke down and created artist pages based on the text of the artist field.  This was a significant improvement, and I returned to that when writing my DWTS Taylor Swift/Whitney Houston post.  In that post, I listed a few things that I thought could be improved with artist search and then let things rattle around in my brain for a few months.

Last week, I decided to spend a little while seeing what I could do to make a worthwhile improvement in a short time.  What came out was a pair of changes.  The more visible change is an addition to the advanced search page

I’ve added some additional controls to explicitly search each of the three primary text fields in the music4dance database – Title, Artist, and Albums.  This enables a more direct way to get to all of the songs by an artist.  It also allows the inverse.  While adding the artist page let you get to all of the songs by “Prince,” it didn’t let you find all of the songs with “Prince” in the Title without also seeing the Prince and Prince Royce songs or, for that matter, songs with Prince in album names.  That is, if you can find one song with Prince as the artist you can click on the link to get to the artist page.

One side effect of this change is that if you search for Prince in the artist field, you also get Prince Royce songs, although they end up at the end of the list.  While that’s not great in the case of Prince, you now have a fast way to get to a link that will send you to the Prince artist page, which does only list Prince songs.  The good part of this quirk is that if you’re looking for songs by Benny Goodman, you’ll get a list containing not just songs with exactly “Benny Goodman” in the artist field.  You also get songs by “Benny Goodman Sextet,” “Benny Goodman Quartet,” “Benny Goodman and Charlie Christian,” “Peggy Lee and Benny Goodman,” etc.

The other more subtle improvement is that I dug into how the underlying database ranks the results of a search.  With my new understanding, I decided to weight the Title and Artist fields considerably higher than the other fields, including the Albums fields.  This helps more than one would think because I grab as many albums as I can associate with a song, and there may be a word in several of those album titles that doesn’t show up in the title or artist. Since the database uses the frequency of a word in the text as part of the weighting, those songs will show up high in the ranking, while it’s not obvious why that song showed up at all since you have to click through to the song details page to see the album names.

Give it a whirl and tell me what you think.  I will probably still do an artist index and possibly figure out a way to do some cleaning up of the database.  There are still songs where the title contains a featured artist, and that artist isn’t represented in the artist field at all, for instance.

As always, I’m very interested in your feedback, so please share any thoughts and ideas about this post or the site by commenting below or using other feedback mechanisms listed here. In addition, if you enjoy the site or the blog (or both), please consider contributing in whatever way makes sense for you.

What are your favorite Prince songs for partner dancing?

I, like many, am mourning and listening to Prince’s music. Over and over again. Since I’ve been thinking a lot about music and partner dancing recently, this lead me to think about what I would dance to each song.  Especially when Leader of the Band popped up in my playlist and screamed Cha-Cha at me. …

Keep reading

Ballroom Dancing to Whitney Houston and Taylor Swift

The recent Dancing With the Stars episodes featuring Whitney Houston and Taylor Swift’s music caused a significant spike in traffic at music4dance.net, with dancers looking for music by those artists. I find this exciting for many reasons.  There’s the obvious reason that more traffic means more people showing interest in this project.  It also reinforces…

Keep reading

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.