What i would do is, leave stems behind. Tree grows, leaves stems behind. Next tick, stem checks it's surrounding blocks, stem realizes environment has changed. Stem scans, stem finds tree again. Stem shifts it's self back into the tree.
Alternatively, stem has move function. Tree passes...