Normal
You might need to short the terminals of the unused driver otherwise sympathetic resonance can occur just from the acoustic output of the driver under test, but yes, you should be able to do that comparison. Depending on how loud you need to drive it to get a decent measurement, you might also need to secure the filler material a bit to make sure it doesn't vibrate in the box too.