To play a song, video, or playlist from the media library tap on the item you wish to play. It will begin playing immediately, clearing any other items that may be in the queue.
You can also begin playing a collection of songs at once. For example, you can play all songs within an album or by a particular artist.
The first item in the group will begin playing and all other items in the group are automatically added to the queue.