It's not so much a question of the compilation process taking overly long out and of itself (though it will still take longer on a zero than a Pi3 for sure), but more that it's unlikely going to work first time.
Case in point I just tried on a zero and it took under an hour, but the build does not start up. I'm sure I could poke around and eventually it might work, but I'm not sure I can see the benefit of that.
I'm not entirely sure what you mean by all-in-one development environment... besides the minimal extra footprint a Pi3 will do the job as well. But I get your point having none at hand it's not an option for you.
Still, if you'd like to give it a go on the zero, but be prepared to do extra work, the following is a streamlined overview of the process, and assuming all goes well, that's all there is to it: