Can I exchange chat messages without making an Audio/Video call?

Yes, you do not necessarily need to join an audio/video call to enter the Room. Once you join the Room, you can exchange text chats with other users in the Room.