[NFR]: Remove dependencies from other containers in CI

Several times now, we have seen failures in the CI due to issues with retrieving remote images. Not the issue on the image (in most cases), more the retrieval of the image into GA.

Devise a way to not depend so much on remote images and utilize packages coming say from apt.