In short, the human experience is a ~fun~ way for the universe to learn and understand itself.
Here in the 3rd dimension, we operate from a space of duality. If there was no duality then there would be no 3rd dimension and therefore no humanity. We exist here in this realm of consciousness BECAUSE of duality.
(duality is define as an instance of opposition or contrast between two concepts or two aspects of something; ie: light vs dark, good vs evil, male vs female. etc)
During the course of one or all of our incarnations, we are meant to shed our old skins and discover deeper truths such as oneness, enlightenment, higher consciousness or whatever else you want to call it.
Now, that's not to say it will happen for every soul in every life time. Likely, it will take thousands of incarnations for a soul to fully understand and embody the true nature of reality.
Consider this: life would be boring as all hell if we didn't experience both the light and the dark here.
It is my belief that when we return to creation, the soul goes through a series of life reviews where we see the purpose behind each major event in our lives, both "good" and "bad."
From there, we learn, at a soul level, the lessons and experiences we were meant to carry over from this life with us into that space of creation; OR the next life, if that's what we choose to do.
I truly believe we get to decide what happens next.
We begin to ask ourselves questions in that space like: do we need more human experience? If the answer is yes, then we decide to reincarnate. If the answer is no, then we don't.
When we do decide to reincarnate, however, we are able to the decision as to what we want to do or experience on Earth in a human body.
Then we choose a time, place and family that will accommodate those experiences.
(Remember: since we do not perceive "good" or "bad" in the space of creation (5D+) you might choose a life full of hardships simply for the experience. While that may make for a difficult life, you are learning EXACTLY what you're meant to on a soul level)
So since higher dimensional beings don't perceive duality as good or bad, they understand that all that is just.. IS, the value of a negative experience for the soul exists in the experience itself.
Our worst experiences not only grow us in ways the good experiences don't, they also act as a catalyst for change. ie: leading us to ask big life questions we may have avoided in the past.
Either way, whether we choose to reincarnate or not, we are met with the most loving, calming presence at the time of our death. This is evident in many works regarding near death experiences as well as works regarding people's last words before passing.
From my research, there is no heaven or hell, just the space of unconditional love which we all derived from in the first place. In that place, there is no pain or suffering.
Death is not something to be feared. It is something instead to be embraced as a natural part of the life cycle. Energy cannot be created or destroyed, only transformed. Death is not the end of consciousness; it is the transformation of consciousness.