ci: Add Job to cleanup older images for all builds

Closes #265

See merge request rc/hpc-factory!209

Dylan Wheeler authored 2 weeks ago and Eesaan Atluri committed 2 weeks ago

During cleanup, --name filter will only match the exact string, not a pattern match.
Since we use datetime in the name, we can't use it to match a set of images.
We use a tag constructed from BUILD_TARGET-BUILD_TAG-ENV for filtering.

Use creation time as sort key rather than using image name with timestamp.
Currently, the name only allows either a build tag or datetime. So
filtering and sorting by image name won't give us complete list because we
can only select images with buildtag or datetime in their name.
This change allows flexibility in changing the image naming format in
future

- Keep the latest $NUM_IMAGES_TO_KEEP no. of images in a list sorted by
  creation time in descending order.
- The NUM_IMAGES_TO_KEEP value should always be postive so that the
  list of servers to delete will be calculated correctly
- Never run the cleanup_img job if NUM_IMAGES_TO_KEEP is non-postive.
  So if you intend to not cleanup the images for any reason, just pass
  a negative value or 0 to the NUM_IMAGES_TO_KEEP

Enable callback plugins to format the ansible log

Closes #260

See merge request !207

* feat: Colorize packer ansible provisioner tasks



Closes rc/hpc-factory#260

Automate ood knightly build and deploy in a single pipeline

Closes #231

See merge request !197

* Detach the floating ips to assign to new instance

* Detach internal port to assign it to new instance

* Install NetworkManager required during deploy

  NetworkManager is restarted during cloud-init final module but it
  failsbecause the package was not available. So install it during build
  to make it available during deploy

FEAT: paramaterize centos repos

See merge request !205

feat: update group_vars to have variable for centos_repos and update the related ansible playbook to pull from that variable

Add missing pasword auth config for catchall in sshpiper

Closes #247

See merge request !202

fix: openldap-servers pkg install failure

Closes #237

See merge request !199

Feat gl cicd var scripts

Closes #232

See merge request !196

Feat deploy ood

See merge request rc/hpc-factory!193

This MR merges the feat-hpc-factory branch, which was focused on building and deploying proxy images for the COD cluster.

Closes #181, #203, #173, #176, and #175

See merge request !117

Use BUILD_TAG for image build if set, else fallback to BUILD_DATE

See merge request !192

fix: use ENV variable in ansible var url

See merge request !191

fix: bash syntax error

See merge request !190

refactor: only run build pipeline in build environment

See merge request !189

Since build env is setup for building images, it makes more sense to
have all build jobs in that environment.

ci: Add OOD image build job to gitlab CI

See merge request !171

# Conflicts:
#   openstack-ood/variables.pkr.hcl

We do not run merge request pipeline, so no need to check for it