Sounds fun already, right?
I know it shows you how to set secrets for docker creds here, but I'm unsure as to how to label my s3 creds for tektoncd. Does anyone have an example so that I can do this for my pipeline?
It must be using AWS SDK to access S3 underneath. Thus it uses the Credential Chain to obtain AWS creds. Java SDK example https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/credentials.html, but it's same in all SDKs. Based on that you have multiple options:
~/.aws/credentials
to a tektoncd container filesystem (maybe)