Australian government study claims AI is bad at summarizing information

An Australian study, conducted by Amazon, found:

Artificial intelligence is worse than humans in every way at summarising documents and might actually create additional work for people

I applaud the attempt to study this, but using Llama2-70B, a model that’s over a year old now, tell us little about the current state of the art.