Co
nf
11 id
e
98 n
73 tia
38 l
Please ensure that you are using the latest version of the guidelines from BaseLine, which are
found in the upper right corner of every task.
Guidelines for Search - HomePod Classifier
Table of Contents
Guidelines for Search - HomePod Classifier ................................................................. 1
Siri Music (End to End) Classifier Guidelines ............................................................... 2
Classification Process ...................................................................................................... 3
Intent Classification .................................................................................................................................................. 3
Language Selection .................................................................................................................................................. 8
Spelling ........................................................................................................................................................................ 9
Translation ................................................................................................................................................................ 10
Intent Disambiguation ............................................................................................................................................ 10
Additional notes ...................................................................................................................................................... 11
Co
nf
11 id
e
98 n
73 tia
38 l
Siri Music (End to End) Classifier
Guidelines
Updated:
7.06.2023 Added additional examples for Language Selection.
9.28.2022 Ambiguous queries split into “Ambiguous – Multiple Classifications” and “Ambiguous –
Intent Unclear” & “Genre” queries are now called “Genre/Category”
5.20.2022 For queries containing multiple artists: Determine the most likely intent and classify
accordingly.
5.9.2022 Added new soundtrack classification type, updated album classification.
4.27.2022 Added new radio classification types.
1.28.2022 Don’t put anything in the additional notes. Capture all your research notes in the
disambiguation field.
Classification Process
Co
nf
11 id
e
98 n
73 tia
38 l
Intent Classification
You should select the query type that is MOST relevant to the query. Below are the main types of
queries in Apple Music:
Song: Intent is for a specific song.
• [play pink's latest single]
• [play the beautiful people]
• [jolene miley cyrus]
• [sia chandelier]
• [turn on godzilla by eminem]
• [teardrop by massive attack]
• [play never surrender by dj khaled]
• [play drivers license on repeat]
• [cardi b and megan thee stallion] → For queries containing multiple artists: Do research to
determine the most likely intent and classify accordingly. Add the intent in the disambiguation
field. For this example, the most likely intent is the song WAP, therefore this query is classified
as Song Navigational even know the query consists of artist names.
• [play home] → the intent could be multiple songs: "Home" by Phillip Phillips, Edward Sharpe,
Topic, and Michael Bublé. Even if we can't tell which one the user is looking for, the query
should still be categorized as Song Navigational.
Artist: Intent is for an artist/band, this includes utterances requesting song(s) by the artist/band.
• [taylor swift]
• [songs by the weeknd]
• [l devo]
• [some sam smith]
• [music by zedd]
• [shuffle drake]
• [max martin] - songwriter
• [play mozart]
• [a song by post malone]
• [michael jackson greatest hits]
• [ed sheeran radio] → Any utterance that includes [Artist] + “radio” in the string.
Album: Intent is for album.
• [play rumors by fleetwood Mac] → album Rumours by Fleetwood Mac (note that the content
title is mistranscribed)
• [sour by olivia rodrigo] → album Sour by Olivia Rodrigo
• [play chromatica] → album Chromatica by Lady Gaga
• [turn on nine track mind by charlie puth] → album Nine Track Mind by Charlie Puth
• [put on madonna's latest album] → album Madame X by Madonna
• [taylor swift lover] → album Lover by Taylor Swift
• [play taylor swift's album] → any Taylor Swift's albums
Co
nf
11 id
e
98 n
73 tia
38 l
Soundtrack: Intent is for music for visual content, such as soundtracks and theme songs of movies,
tv shows, and games. This includes music created for the visual content, as well as existing music
played in the visual content.
• [play frozen soundtrack] → soundtrack and songs from the movies “Frozen” or “Frozen 2”
• [play hbo insecure] → soundtrack and songs from the HBO’s TV Show “Insecure”
• [play my hero academia] → soundtrack and songs from the TV Series “My Hero Academia”
• [play songs from hamilton] → soundtrack and songs compilation from the Broadway’s musical
“Hamilton“
• [play music of fifa 16] → soundtracks from the game Fifa 16
• [play songs of glee season 5] → soundtrack and songs from the TV Show “Glee” of season 5
Genre/Category: Intent is for music in a certain genre, era, mood, activity, or for a collection of
songs with a common theme. Apple Music has a page here with existing genre/categorical
examples.
• [jazz]
• [kpop]
• [pop]
• [country]
• [LoFi Hip Hop]
• [motivational music]
• [classical]
• [lullabies]
• [soul]
• [meditation]
• [cafe music]
• [yoga music]
• [ocean sounds]
• [rain sounds]
• [holiday]
• [workout]
• [10’s hits]
• [happy songs]
• [play some feel good music]
• [play apple music from 1988]
Playlist/Chart: Intent is for a top charts song or a playlist which has a fixed number of tracks with a
common theme.
• [Stevie Ray Vaughan Essentials]
• [workout playlist] - user specifically asked for a playlist
• [today’s hits]
• [today’s country]
• [tik Tok songs]
• [play latest trends]
• [play UK top 40 playlist]
• [rap life]
• [我與我的愛人😍] - Apple Music playlist with emoji in title
• [mozart bedtime] - This query is classified as a Playlist/Chart query is because this is more of
an artist functional request (not a genre/mood/activity as it is specific to Mozart).
Co
nf
11 id
e
98 n
73 tia
38 l
Broadcast Radio: Intent is for conventional hosted live stations, often associated with a radio
network. This includes local, satellite and internet radio stations.
• [play 103.7 Kiss FM] → broadcast radio station 103.7 Kiss-FM
• [play CNN Radio] → broadcast radio station CNN
• [play Sirius XM Radio] → broadcast radio station Sirius XM Radio (note that it might not be
available on Apple Music)
• [play BBC Radio 1] → broadcast radio station BBC Radio 1
• [play BBC Radio 1Xtra] → broadcast radio station BBC Radio 1Xtra (a sister station to Radio 1)
Apple Music Hosted Radio: Intent is for Apple Music hosted live radio shows. There are only three
Apple hosted radio stations: Apple Music 1, Apple Music Hits, and Apple Music Country. These three
radio stations have many different shows on their programming.
• [play Apple Music 1] → Apple Music Hosted Radio Apple Music 1
• [play Apple Music Hits] → Apple Music Hosted Radio Apple Music Hits
• [play Apple Music Country] → Apple Music Hosted Radio Apple Music Country
• [play radio] → Assume the intent is for Apple Music 1
• [play Beats 1] → Apple Music 1 was previously called Beats 1
• [play Soulection Radio] → Apple Music 1 show Soulection
• [play The Zane Lowe Show] → Apple Music 1 show The Zane Lowe Show
Editorial Radio: Intent is for non-hosted radio stations, focussing on a certain genre/mood/era. This
includes utterances with a functional query + radio in the string.
• [play country radio] → Apple Music Country Station
• [play pure pop radio] → Apple Music Pop Station (previously called Pure Pop)
• [play workout radio] → a collection of Apple Music radios in the category page Fitness
• [play jazz station] → Apple Music Jazz Station
• [play 90s hits station] → Apple Music ’90 Hits Station
• [play pop songs radio] → Apple Music Pop Station
• [play rock songs radio] → Apple Music Rock Station / Classic Rock Station / Hard Rock
Station (all point to the same classification of the editorial radio)
Podcast: intent is for a podcast (My Favorite Murder, Serial, Joe Rogan, etc.)
• [Up First]
• [play the daily podcast]
• [play BBC news]
• [play Planet Money]
• [My Favorite Murder]
• [Hey Siri read me the news]
• [Hey Siri play the latest episode of Stuff You Should Know]
• [播放白雪公主的故事] (Play Snow White's story)
• [播放睡前故事] (Play Bedtime Stories)
Local: intent is for content local to a user's device, for example recently purchased or downloaded
music. Queries with “my playlist” usually indicate a local playlist and would be a “Local” query type,
not “Playlist/Chart”. In addition, for utterance with emojis, do a quick search on Apple Music to check
if there is indeed a playlist with the emojis in the title (Example: this Apple Music playlist, 我與我的愛
人😍 should be classified as "Playlist/Chart" instead), if not, this is likely a “Local” query.
• [play my recently added playlist]
• [my rock playlist]
• [shuffle my car playlist]
• [shuffle my country playlist]
• [my summer playlist]
•
•
[my recently added]
[my 🦕breathe🐛 playlist]
Co
nf
11 id
e
98 n
73 tia
38 l
Lyrics: an utterance where the title of the song does not exist within the utterance. The lyrics
are in the body of the song, but are not included in the title of the song. Add the title of the song and
artist in the disambiguation field when using this classification.
• [they see me rollin] → song Ridin’ by Chamillionaire
• [play the song that goes can't make a wife out of a ho, oh] → song WITHOUT YOU by The Kid
LAROI
• [call me when you want call me when you need] → song Montero (call me by your name) by Lil
Nas X
Personalized: an utterance that triggers content generated from “For You” or creates a personalized
mix station based on the utterance. “Made For You” personalized mix stations include “Get Up! Mix”,
“Chill Mix”, “New Music Mix”, etc. This is different from Local in that Local utterances exist in the form
of playlists that exist on your phone. Personalized music represents the user's tastes and
preferences.
• [play something]
• [play music]
• [play some music]
• [play a song]
• [play my station]
• [play music for me]
• [play my favorites]
• [my favorites mix]
• [Chill mix]
• [Hey Siri, play me something I’d like]
• [please play]
• [music on]
Action Command: This includes requests to add songs to the user’s library and other commands.
This could also include opening any other apps (like Amazon Music, Spotify or Books App for
audiobooks). Just because verbs like "Shuffle" or "Repeat" are included in the query doesn’t mean
that it automatically is "Action Command". For example, [shuffle Drake] would be an Artist query type
and [turn on radio] is a radio query.
• [add this song to my library]
• [hey siri stop playing this song]
• [next song]
• [fast forward five minutes]
• [play obama’s audiobook] → the utterance requires opening another app, in this case Books
• [can you play cardi b wap on spotify] → the utterance requires opening another app, in this
case Spotify
• [Show me heat waves lyrics] → the Apple Music app will open the lyrics view instead of playing
the song
• [play my daily mix] → the utterance requires opening another app, in this case Spotify
Co
nf
11 id
e
98 n
73 tia
38 l
Knowledge Based: Utterances where the user is asking knowledge based questions.
• [who sings this song?]
• [when did this album come out?]
• [what’s the song that goes like do do do do]
• [Hey Siri what’s the news]
• [Hey Siri when did this song come out?]
Ambiguous – Multiple Classifications: A query that has more than one equally popular intents in
different classifications. When this classification is chosen, it is mandatory to leave a comment in the
disambiguation field describing the possible classifications. Please only use this classification when
no single other classification fits and likely primary intents are in multiple classifications.
• [heartbreak] → "Heartbreak Anniversary" by GIVEON (Song Navigational) or heartbreak songs
(Genre/Category)
• [station] → “Station” by Låpsley or a radio station (Apple Music 1, etc).
• [play jungle] → band Jungle (Artist Navigational) or song “Jungle“ by Drake (Song
Navigational)
• [play taylor swift evermore] → album evermore (Album Navigational) or song “evermore” (Song
Navigational)
• [play inside out] → song Inside Out by Eve 6 (Song Navigational) or for movie “Inside Out”
(Soundtrack Navigational)
Ambiguous – Intent Unclear: A query that doesn’t point to any content and for which intent is
unclear.
• [play old] → no clear primary intent, could be name of artists, songs or genre/category
• [play and] → no clear primary intent
Language Selection
What is the language of this query?
Co
nf
11 id
e
98 n
73 tia
38 l
Please facilitate the decision tree below to identify how to select the language of a query and when a
translation or disambiguation field entry is required.
Before applying the decision tree:
• For utterances that include an action verb (e.g. “hey Siri play”), please ignore the action verb
when determining language.
• For misspelled queries, please correct the spelling of the remaining utterance.
• Special cases:
o Queries where users say “<song> by <artist>” or “<album> by <artist>” shall be
classified based on the language of the “by”.
o Other variations that apply: “<song> from <artist>” / “<album> from <artist>”
o Additional words such as song/songs/the song. Example: "play the song la bachata"
-> this would still be considered English due to the additional English words.
Language selection guidelines.png 695 KB
Spelling
Is this utterance correctly spelled?
Co
nf
11 id
e
98 n
73 tia
38 l
Answer No if the utterance is not correctly recognized by Siri.
Answer Yes if the utterance is correctly recognized by Siri.
• [Play hellcats and track hawks by Lil Durk] is missing an ampersand, and one word is decompounded; “Hellcats & Trackhawks”. This is fine since '&' is pronounced as 'and'.
• [play good for you] should not be marked as incorrectly recognised even though there is a
popular song titled “good 4 u” by Olivia Rodrigo. As users could be looking for "Good For You"
by Selena Gomez.
If not correctly spelled, what should be the correct spelling?
If the query is misspelled, enter the correct spelling. It is mandatory to provide the correct
spelling if the query is misspelled. Add the complete utterance in this field, not only the corrected
part. For example, for the misspelled utterance [hey siri play lil kel], enter "hey siri play luh kel". Do
not enter only “luh kel”.
• [Hey Siri play Tapatia by Kali Uchis] is not correctly recognized; the correct form is “Hey Siri
play telepatía by Kali Uchis”.
• [Play walk him down by NLE Choppa] is not correctly recognized; the correct form of the song
title is "Play walk em down by NLE Choppa".
• [play lords latest album] is not correctly recognized; the correct name of the artist is "play
Lorde's latest album".
• [joue a pile ou face] is not correctly recognized; there is a missing accent and it is corrected to
“joue à pile ou face”, even though the meaning doesn't change.
misspelled query example (Siri).png 174 KB
Translation
What is the English translation of this query?
Co
nf
11 id
e
98 n
73 tia
38 l
For all non-English queries, provide a translation of the correctly spelled query. It is mandatory to
provide a translation of the correctly spelled query if the query is not in English.
If the query is NOT correctly spelled, provide the translation for the correct spelling of the query and
not for the misspelled query. Example: [la danse de bandit]: The correct spelling is [la danse des
bandits], so the translation should be ‘the dance of the bandits’, and not ‘the dance of the bandit’.
• Example: [joue la qui france de naps]
o If not correctly spelled, what should be the correct spelling?: joue la kiffance de
naps.
o What is the English translation of this utterance?: Play the love by Naps.
Should the utterance be in a language you do not speak, utilize Google Translate or other translation
tools to understand what the utterance is. Also do more thorough research to identify the intent of
the utterance before classifying.
Intent Disambiguation
If unclear, what is the intent of this query?
If the query is unclear, incomplete, or misspelled, add the most likely primary intent to the
disambiguation field. Your comment aims to help the rater understand primary intent.
• Even if the query type is not "Ambiguous", it can sometimes still be helpful to add a comment to
this field.
• Keep your comment concise and clear.
o Do not add redundant words such as "I think that...", "It could possibly be the case
that", ...
o IMPORTANT: Do not enter links in the intent disambiguation field. Everything
entered in this field will become a part of the Input Metadata on the far left hand side
for the query and links can break as content is removed from the catalogue.
•
•
For Ambiguous query types: If even after doing research, it is truly impossible to determine the
intent, no need to add anything in the disambiguation field.
Examples:
o [play Carter five]: Query type is Album. Add “The album tha carter v” in the
disambiguation field.
o [joue la qui france]: Query type is Song. Add “The song la kiffance by Naps” in the
disambiguation field. In this case, the field with correct spelling should still be filled
out as well.
o [play jealous girl]: Query type is Song. Add "The unreleased song “Jealous girl” by
Lana Del Rey (TikTok version)" in the disambiguation field.
Additional notes
Co
nf
11 id
e
98 n
73 tia
38 l
Don’t put anything in the additional notes. Capture all your research notes in the disambiguation
field.