Yes--if you target Node.js which I believe is supported first-class for AWS Lambda. ReScript compiles to very clean JS that looks almost hand-written. Should be easy to deploy to a lambda.
The quality of the generated JS is a bit irrelevant as they'll probably want to minify the generated JS to reduce the size of the assets and make cold starts quicker anyways.