Yes, you can join the challenge if you leave in between.