These white to transparent worms are incredibly common in mushrooms found in the wild. Don't worry, they are totally harmless, they are just extra proteins.
Even though they are harmless, if you don't want to eat insects, make sure the mushrooms you eat or make into a tea are completely dry. When the mushroom dries, the worms will escape.