I took another look at diagrams.net. Seems like a well established solution for block diagrams. It also supports a sketch mode so with a graphics tablet, you can easily mix standard shapes and hand sketches (see below for an example).
There is also a desktop version (Electron based) which is handy. For Arch Linux, install
drawio-desktop-bin from the AUR.