Warning and Disclaimer.
All parts of Brugmansia and Datura plants are poisonous both to humans and animals.
It is worth noting that many house hold plants and garden plants are just as toxic.
i.e. Daffodils, Bulbs in general, Poinsettias, many Ficus, one could named hundreds.
For instance if I touch any part of a daffodil, and then touch my face, it would itch and go red and swell. I have NEVER had this reaction or any other from Brugmansia and Datura. We are all very different.
A point to remember on toxicity for children and pets, plants of this type are almost always extremely bitter so it is unlikely that pets or children would indulge in the quantity of plant material that would be needed to cause poisoning.
The seeds and seed capsules would be the only part of the plant that would have significant concentrations of toxins in a small enough package to be consumed.
If you do have sensitive skin wear gloves, the throw away kind are the ones which I use for bulbs.
ALWAYS wash your hands after touching any plants.
NOTE:
I would like to mention that the vast majority of confirmed Brugmansia – Datura poisonings are the result of intentional ingestion by seekers of visionary experiences…ill informed at that.