This is naïve, the government and corporations are already working towards the dystopian result. Just because we don’t “know” doesn’t mean people can’t make an educated guess. You need people to put Llms on the good path before you can say the bad path won’t happen. Right now people are loyal to corporations that offer it, that’s the bad path.
Its like predicting avalanches in avalanche prone areas.
You may not know the individual particle interactions and forces that will inevitably set the next avalanche off, but you know it will happen based on factors that increase the likelihood dramatically.
For example the event of an avalanche increases the more snowpack there is, and it goes to zero when snowpack is gone. The same could be said of LLMs.
You know corporations will do absolutely anything even destroy their business model, so long as they make more money in the short term. John Deere is a perfect example of this, and Mexico just finally took action because we couldn't, that culminated in ~14bn drop in capex on Wall Street for the the stock. It was over 10 years in the making, but it happened.
The more concentrated the marketshare to decisionmaking, the greater the damage, and the more impact bad decisions have compared to good decisions. You tread water until you drown.
