I've never had anyone crash that bad from any herbs that were recommended. Are some herbs better for some people then others, sure, but none of them are going to decimate you. They wouldn't be recommended if that was even the case. Typically for the guys that don't respond favorably to some herbs, it's recommended they simply chose another one and stop taking the ones that don't sit right with them.
Carnivore diet, while it can have it's place, isn't going to be as cleansing as fruit and veggies.
Tongkat is more then just an AI. Even the Ai properties it has isn't enough to crash you. You'd get more benefit from it then not. Maca.....that one can be tricky for some guys. Some love it, some hate it. Tongkat is tried and true.
You're doing yourself a disservice by excluding the herbs as it's a huge component of getting your hormones sorted.
If you're not already, I would suggest taking pine pollen daily, as it has DHEA as one of it's constituents which helps the body regulate ALL hormones. If he shou wu isn't in your line up, it should be as well as that is another one that modulates estrogen.