Can I copy paste multiple phrases into 1 measure without them replacing each other?

I need to condense my entire score into a single piano part so I can more evenly distribute the parts based on soprano/alto/tenor/bass, but I don't know how I can easily go about that since I cant copy one part over another without the first part getting replaced.
Is there way to do this? Or will I just have to do it all manually.