I don’t know what AWS RDS is, Gitlab uses PostgreSQL so you have to use PostgreSQL for the database. I don’t use AWS so I cannot help you there.
All the info relating to setting up a cluster is explained in the Gitlab documentation. I don’t run a cluster and have no intention of configuring one either.