@pamelalove Honestly not 100% sure.
Taking some clues from OpenAI themselves: you can set a monthly spending limit. This gives some comfort that you aren't going to be billed a gazillion dollars at the end of the month.
Obviously cutting off service completey isn't going to work for a lot of customers, so maybe you could start reducing
price per token as the user uses more per month. So it starts curving downwards towards
cost per token. The user doesn't get a
massive invoice, they can still use your service and you keep making at least
some money. Far from perfect though. Dunno how much I like it.
TBH... IDK. As OP noted, entirely new pricing models are going to emerge. I'd imagine once the tech matures and its no longer so computationally expensive & electricity-hungry, things will lighten up.