You can watch it on DVD on Walt Disney Treasures: Silly Symphonies volume 1 or you can watch it from any 2 DVD releases and a blu-ray release on the 1940 Disney movie Dumbo in the bonus features.
However, in the 70th anniversary DVD Edition of Dumbo, it doesn't include "The Flying Mouse" mostly likely to get the person to buy the blu-ray release.