Admittedly I've only done the one real night dive so far, but we turned off our lights to observe the fluorescents. What reason were you given for not turning them off? was it just a safety thing from there point of view to be able to track you?
We were told never to turn off the light under water in case the light doest turn back on again.
What we did is hide the light under are BCD to see what no light looks like. I thought this was a PADI directive to never turn off the light under water.