Merge branch 'allow-auth-config-job-token-and-basic-auth' into 'master'

Support JOB-TOKEN authentication header for generic packages

See merge request https://gitlab.com/gitlab-org/gitlab/-/merge_requests/138770



Merged-by: Smriti Garg <sgarg@gitlab.com>
Approved-by: David Fernandez <dfernandez@gitlab.com>
Approved-by: Smriti Garg <sgarg@gitlab.com>
Reviewed-by: David Fernandez <dfernandez@gitlab.com>
Reviewed-by: Moaz Khalifa <mkhalifa@gitlab.com>
Co-authored-by: Kristupas Antanavicius <kristupas.antanavicius@nordsec.com>