Using AWS credentials in Powershell scripts

Lately I was updating a couple of my scripts, and when I re-used my script that automatically updates AWS records for Let's Encrypt DNS challenges, I realised that I never stored my AWS credentials anywhere, but I was just using those cached into my powershell environment. Time to have some proper credential management.