You can search for Albums By Artists, simply select an Artist from the Menu, and submit

Search by Artist