Australia boasts a rich rock history — but picking the country’s Big 4 is no mean feat. At the dawn of rock, most Down Under artists covered popular tunes made famous by English and American bands.

Artists sometimes look back in history to find inspiration for their current projects. Some might say that Australian band the Church, which draws inspiration from late 1960s-era psychedelia, has made ...