I don’t have Chromecast (I use Miracast) so I can’t answer your specific question. Mirroring the Android screen to the TV is quite a pain (as least with Firefox) since full screen mode ends after each lesson and you have to re-enable it for the next lesson.
I like to use the VLC player with downloaded videos. It will only show controls on the phone or tablet and a full-screen video on the TV.