Does your Windows 11/10 Taskbar appear in fullscreen video or game? If the Taskbar does not hide in full-screen mode see this post.

You can hide your taskbar using Windows 11 settings, but that won't hide it completely. The only way to do that is to use a third-party application.