In front of it, seated in chairs, as in a garden of public diversion, are a number of women, busily knitting.
"’Then, with that man’s permission and even with his aid, his brother took her away; in spite of what I know she must have told his brother—and what that is, will not be long unknown to you, Doctor, if it is now—his brother took her away—for his pleasure and diversion, for a little while.
There are no more uses of "diversion" in the book.
Show samples from other sources
The attack on the capital was actually a diversion to draw troops away from the port city.
And I’d bet my broomstick he let that troll in, to make a diversion!
J.K. Rowling -- Harry Potter and the Sorcerer’s Stone