Not always, which is why apps like AppCleaner are a thing under MacOS. https://freemacsoft.net/appcleaner/MacOS puts all the App in a folder with a specific extension that is not interpreted as a folder.
It also does this with bundles, etc.
That's why removing an Application in MacOS is as simple as dragging the icon to Trash, deletes the "folder".