What are the biggest challenges that developers face when implementing ChatGPT into their apps?

In my experience, the hardest aspects were to get a predictable experience and to make it safe. 1) User inputs are often unpredictable to begin with. Then add on top of that the fact that you don't know what the exact output of ChatGPT will be. In the best case this results in a slightly unexpected experience, in the worst case it could result in errors if the ChatGPT output doesn't match some expected format. 2) If you somehow use the outputs of ChatGPT in your app or potentially run some ChatGPT generated code, there are a host of security issues coming with that