OpenAI itself says that the amount of compute used in the largest AI training runs has been increasing exponentially, doubling every few months.
Sam Mugel, Chief Technology Officer of Multiverse, which uses tensor networks and quantum computing to bring down costs, estimates that training the next generation of large language models will pass $1 billion within a few years.
Full article here