Yes. An EDF glider is extremely possible and fun. Here's mine. Its a hobbyking Pearl glider.
It still glides and flies like a glider should but also sounds cool at WOT and goes like a rocket.
The only thing it lacks is throttle response but on a glider I don't think that's a problem.
I say go for it !