I recently made a cli chatgpt interface. Quick hack in Rust, always planned to clean it up, not entirely sure where the source code is for it anymore but I use the compiled binary all the time.
The regular chatgpt interface is nice but sometimes don't want to break out of the terminal.
Did you get ChatGPT to help you write this and is one of your main use cases generating bash commands? (Code writing code, there’s a total feedback loop happening here) I did too but wrote mine in Python. A compiled language would be much faster and using their streaming function I’m yet to implement. Any other ways you can increase the speed?
I don't think language would matter much as the primary delay is getting a response from OpenAI apis. The advantage of Rust (or other similar language) is you get a simple single executable. Otherwise Python is completely fine.
I basically use this any time that I am in the terminal already and have a question that I think could reasonably be formatted fine there. I'd say, I use it for 30% (conservatively) of my ChatGpt queries. Naturally the web interface is way better for lots of stuff, but sometimes breaking out of a terminal session is jarring.
The regular chatgpt interface is nice but sometimes don't want to break out of the terminal.