Integration Testing: Sequential Merge and Validation of Four Feature Branches (PR #43,#44, #45,#46)

The purpose of this branch is to facilitate the testing and integration of changes from four separate feature branches:

1. Remove remote-exec provisioners in Terraform script (Merge Request #46): This commit focuses on removing remote-exec provisioners from the Terraform script. By eliminating these provisioners, we aim to enhance the reliability and security of the infrastructure setup.

2. Include mount commands in user_data_script for Terraform instance initialization (Merge Request #45): This merge request introduces mount commands in the user_data_script of the Terraform script. The inclusion of these commands ensures proper initialization of instances by facilitating the mounting of specified devices to relevant directories during the initial boot process. This change enhances the robustness and efficiency of instance initialization procedures.

3. WIP: Feat vol download from s3 (Merge Request #44): This work-in-progress merge request aims to implement functionality for downloading volumes from Amazon S3 (Simple Storage Service) within the Terraform setup. Once completed, this feature will enable the seamless integration of volume download capabilities, enhancing data management and accessibility within the infrastructure.

4. feat: Add new data volume for XDMod queue data (Merge Request #43): This merge request focuses on the addition of a new data volume specifically designed for XDMod queue data. By incorporating this new volume into the infrastructure configuration, we aim to optimize data storage and management processes, thereby improving the overall efficiency and functionality of the system.

.gitlab-ci.yml

@@ -35,9 +35,9 @@ prep-deploy:
     - |
       if [ "$TARGET_ENV" = "dev" ]; then
            TF_VAR_data_volume="xdmod-dev-volume-$BUILD_DATE"
-           TF_VAR_data_queue_volume= "xdmod-queue-volume-$BUILD_DATE"
+           TF_VAR_xdmod_queue_data_volume= "xdmod-queue-volume-$BUILD_DATE"
            openstack volume create --snapshot xdmod-dev-volume-snap --size 20 $TF_VAR_data_volume
-           openstack volume create --snapshot xdmod-queue-volume-snap --size 20 $TF_VAR_data_queue_volume
+           openstack volume create --snapshot xdmod-queue-volume-snap --size 20 $TF_VAR_xdmod_queue_data_volume
       elif [ "$TARGET_ENV" = "staging" ]; then
            TF_VAR_data_volume="xdmod-staging-volume-$BUILD_DATE"
            openstack volume create --snapshot xdmod-staging-vol-snapshot --size 150 $TF_VAR_data_volume
@@ -63,6 +63,10 @@ prep-deploy:
            echo "Make a copy of prod volume $prod_volume to be used in tf-apply"
            TF_VAR_data_volume="xdmod-prod-vol-$BUILD_DATE"
            openstack volume create --snapshot xdmod-prod-vol-snapshot-$BUILD_DATE --size 150 $TF_VAR_data_volume
+
+           echo "Make a copy of prod volume $prod_volume to be used in tf-apply"
+           TF_VAR_xdmod_queue_data_volume="xdmod-prod-vol-$BUILD_DATE"
+           openstack volume create --snapshot xdmod-prod_queue_volume-snapshot-$BUILD_DATE --size 1 $TF_VAR_xdmod_queue_data_volume
       else
            echo "Unknown TARGET_ENV: $TARGET_ENV"
            exit 1