The trade-offs are debatable. however, if the goal is a downstream classification model where interpretability, reproducibility, dimensionality reduction and stability matters, i would prefer PCA. PCA is mathematically or statistically well grounded. it allows us to quantify how much variance each component explains and understand variable contributions. The resulting components are uncorrelated which can help address multicollinearity and reduce dimensionality, noise and computational costs. PCA is deterministic and provides a consistent transformation making it stable in production pipelines than t-SNE.
t-SNE is mainly exploratory/visualization technique.
------------------------------
Sandeep N
------------------------------