Once you schedule or start a Google Meet call, you can invite anyone by sharing the joining link with them.
You can get rid of the Meet video icon from the Gmail app's bottom-left corner by removing it through the app's Settings menu.