Yes.
As of October 2018, any non-steam shortcuts added to the Steam client on the host machine will also appear in the Library tabs in those clients that can potentially stream games from there. You need to be on the same network and the clients should see each other, otherwise the shortcut will not appear.
All you need to do is open the library on the host machine and click ADD A GAME in the bottom left corner, then click Add a Non-Steam Game... and chose your game. If the game is not in the list, you can click BROWSE... and select the executable file manually.
You can stream any programs this way, not just games. For example, the picture below shows the wordpad.exe entry:
This is what Steam Support articles have to say about the feature:
Streaming non-Steam games in the Steam library may work but is not officially supported.
As for the old (rather hacky) method with alt-tabbing to desktop, the same article states:
If your game loses focus, Steam will start streaming the desktop so that you can get back to it. This is a feature of Steam In-Home Streaming.
So at least we know for sure that this functionality is intentional and thus likely is not going to be removed.
I could not find any information as to when non-Steam entries started showing up across machines, but Steam Client changelog from Mar 21, 2018 mentions this:
Fixed a bug where non-Steam games would use a desktop configuration when streaming if the controller wasn’t opted into Steam Input support.
So you could suggest that it's been supported from at least since then.