I don’t know of any studies unfortunately, but I did want to point out that training is not quite a one time cost in practice, because training has already been done loads times and is still being done! I’m theory, if we stopped training all AI and just kept the ones we have, then indeed the training cost would be bounded just like you say, I’m just afraid we’re quite far from that.
this is true, but this is always going to lead to a different AI and a different product eventually, it’s not like it’s going to be sustained entirely by the whims of chatgpt 3.5 for example.
I don’t know of any studies unfortunately, but I did want to point out that training is not quite a one time cost in practice, because training has already been done loads times and is still being done! I’m theory, if we stopped training all AI and just kept the ones we have, then indeed the training cost would be bounded just like you say, I’m just afraid we’re quite far from that.
this is true, but this is always going to lead to a different AI and a different product eventually, it’s not like it’s going to be sustained entirely by the whims of chatgpt 3.5 for example.