Song of the Year lyrics trends

Some interesting trends in the lyrics of the Grammy Song of the year winners and nominees.

Language

Musixmatch automatically analyzes the language of the lyrics of every song in its database. Volare by Domenico Modugno, performed in Italian, is the only non English song to ever win this award. La Bamba by Los Lobos, performed in Spanish, is the only other non English song to be nominated. The other songs are mainly in English or instrumental.

Word counts

The wordiest song (total words and unique words) to win the Song of the Year is The Battle of New Orleans by Johnny Horton. The wordiest nominee is I'd Do Anything For Love (But I Won't Do That) by Meatloaf but if we count unique words Lose Yourself by Eminem comes out on the top.

The total word count rises by almost 4 words every year.

The unique word count rises by almost 1 word every year.

Profanity

Rolling In the Deep by Adele is the only song with a profanity (shit) to win this award. 17 other nominated songs contain profanity.

Instrumentals

Musixmatch automatically analyzes whether a song is instrumental or not. Only 6 instrumental songs have been nominated for Song of the year and of them only one, Theme of Exodus by Ernest Gold (1961), has won the award.

Deep learning model of lyrics

Doc2Vec, a deep learning model by Google, automatically infers the semantics in pieces of text and places each text in an n-dimensional space, such that texts which are similar are located closer.

We trained this model (Doc2Vec by Google) using 150k lyrics and n = 100. This model outputs 100 lyrics metrics (apart from the ones above), for the nominees and winners, which we used for training the award prediction model.

It is difficult to explain which characteristic of the text corresponds to each of the metric output by this Doc2Vec model but a more detailed explanation can be found here.

Song of the Year music trends

Echonest, a music intelligence platform, provides many interesting musical metrics calculated from the audio signal of a song. We scanned the Grammy Song of the Year nominees and winners in the Echonest database and these are some of the interesting musical trends.

Key

In music theory, the key of a piece is the tonic note and chord that provides a subjective sense of arrival and rest. Other notes and chords in the piece create varying degrees of tension, resolved when the tonic note or chord returns - Wikipedia

Generally, popular music has a well defined key and the songs studied here as well.

Winners

A major is the key most used by the winners followed by D major, C major and F major.

Nominees

C major is used most by the nominees followed by G major and F major.

Loudness

Echonest averages loudness across the whole song and returns a negative number with 0 being the loudest level possible.

The loudest song to win this award is Rehab by Amy Winehouse while the quietest one is Don't Worry Be Happy by Bobby McFerrin. The quietest song overall is Feel Like Makin' Love by Roberta Flack while the loudest one is also Rehab.

Across the nominees and winners, a steady increase of 0.17 unit/year of loudness is observed.

This increase is termed by experts as loudness wars. For the curious readers, there is a very detailed website dedicated to this.

Duration in seconds

We Are the World by USA for Africa is the longest song (427 seconds) to win the award. I'd Do Anything For Love (But I Won't Do That) by Meatloaf is the longest song (721 seconds) to be nominated, it is also the song with the highest word count.

We see a steady rise in the duration till the mid 90s and then a decline. This could perhaps be due to the increase in Hiphop/Dance songs (shorter than other genres) getting nominated.

Overlaying the duration trend with the total word count trend we can see a decrease in the duration but an increase in the word count after the 90s. This could be because of more Hiphop songs and songs containing Rap verses getting nominated.

Danceability

Describes how suitable a track is for dancing using a number of musical elements (the more suitable for dancing, the closer to 1.0 the value). The combination of musical elements that best characterize danceability include tempo, rhythm stability, beat strength, and overall regularity - Echonest

It is an interesting metric even though not decisive in choosing the winner (according to our model as discussed later).

The danceability of Song of the Year nominees and winners has been rising (.0007 unit/year).

This means that the nominees and winners have become more danceable over the years.

Predicting a winner

A Machine learning classifier - r2d3.us

We trained a model similar to the above illustration, at each node of the tree a decision is made depending on the value of a lyric or audio metric. For those wanting to dig deeper, we recommend this visual introduction to machine learning.

These are the steps involved in making our prediction process.

• Analyse lyrics and audio metrics for all the nominees and winners.
• Use the above metrics for the winners and nominees till 2015, train a machine learning classifier (random forest classifier).
• Input the metrics for the 2016 nominees into this classifier to get the probable winners.

Lyrics more important than music in predicting a winner

Apart from making a prediction, the above model can also tell us the relative importance of the metrics (feature importances).

For example - It can say whether total word count is more important in predicting a winner compared to the unique word count or the key of the song.

Summing the importances of the 17 most important lyrics and audio metrics, lyrics are twice as decisive as music in predicting the winner for Song of the Year.

Importance in deciding a winner