All of the purple books will have audio clues when clicked in the correct order, and you’re correct to be trying the order on the paper on the desk. Many of the designs are similar to each other, just mirrored, so make sure you’re looking carefully at the designs and clicking the right book.
Or, if you’d like to DM me on discord, @seedborne, I can send you the exact puzzle solution.