The store version of the Windows Subsystem for Linux isn't available in Windows 10, nor is the Amazon Appstore or its underlying Windows Subsystem for Android. Not everything in Windows 11's app store will make it to Windows 10.
Once installed, the apps look and work the same way as the standalone versions. Microsoft has loosened the rules for the kinds of apps that can be submitted to and downloaded from the store, and apps like Zoom, Discord, the VLC Player, Adobe Reader, the LibreOffice suite, and even the Epic Games Store are all available to download through the store. But the real reason to install it is its dramatically improved app selection. The new Microsoft Store isn't dramatically different from the old one in its design, though a few of the changes are clear improvements-viewing your app library and grabbing updates for the apps you already have installed happens on the same screen now, which is handy.
Further Reading Epic Games Store, Discord, and Zoom all join Windows 11’s more flexible app store