I can only hear chat audio when using CloudX Chat

By design, Xbox One detects when a chat headset is connected and in turn will only output chat audio. Unfortunately, there is no workaround at this time.