How do I close the desktop app and keep the positions of windows?

To have all windows restore their position, you need to use Exit in the drop-down menu of the window title:

For the macOS version, this button can be found in the main application menu: