Template Automation Lambda

Overview

This repository contains the Python code for the Lambda function that automates the creation and configuration of new repositories from templates. It is a core part of a four-repository system for automated infrastructure provisioning and repository bootstrapping.

System Integration

This repository works together with the following:

template-repos-lambda-deployment: Contains Terraform code to deploy this Lambda function, manage IAM roles, permissions, and environment variables in AWS.
terraform-aws-template-automation: Provides reusable Terraform modules for deploying and managing the Lambda and related infrastructure. Used by the deployment repository.
packer-pipeline: Powers the CI/CD process by automating the build of Lambda container images in AWS CodeBuild.

Current Deployment

AWS Account: csvd-dev-ew
AWS Region: us-gov-west-1

Architecture

AWS Lambda container image built with Packer and stored in ECR
Infrastructure managed with Terraform
Automated CI/CD using GitHub Actions
Secret management using AWS Systems Manager Parameter Store

Repository Structure

template-automation-lambda/
├── template_automation/          # Python code for the Lambda function
│   ├── __init__.py
│   ├── app.py                  # Main application file
│   ├── config.py              # Configuration handling
│   ├── github_integration.py   # GitHub API interactions
│   └── requirements.txt        # Python dependencies
├── tests/                      # Unit and integration tests
│   ├── __init__.py
│   └── test_app.py            # Tests for the application
├── packer.pkr.hcl             # Packer configuration for the Lambda image
└── README.md                  # This README file

Prerequisites

AWS credentials with appropriate permissions
GitHub Personal Access Token (PAT) stored in AWS Systems Manager Parameter Store
Docker (for local development)
Terraform
Packer
Python 3.11+

Container Build Process with packer-pipeline

This Lambda function is packaged and deployed as a container image using the packer-pipeline tool, which provides several advantages:

Consistent Builds: Every build runs in an isolated AWS CodeBuild environment with the same configuration
Dependency Management: All Python packages are installed during the build
Version Control: Container images are tagged and stored in ECR for easy rollback
CI/CD Integration: Automated builds via GitHub Actions

Build Configuration

The container build is defined in packer.pkr.hcl and automated with packer-pipeline. To trigger a build:

# Install the packer-pipeline tool
pip install packer-pipeline

# Run the build process
python -m packer_pipeline --config config_packer.hcl

The config_packer.hcl file configures the build environment:

packer_pipeline {
  repo_path              = "."
  packer_template_file   = "packer.pkr.hcl"
  s3_bucket              = "template-automation-builds"
  codebuild_project_name = "template-automation-lambda-builder"
  create_role            = true
  
  create_ecr_repository  = true
  ecr_repository_name    = "template-automation-lambda"
  push_to_ecr            = true
  
  environment_variables  = {
    LAMBDA_VERSION = "1.0.0"
  }
}

GitHub Actions Integration

The repository includes GitHub Actions workflows that automatically build the container image using packer-pipeline:

# .github/workflows/build.yml
name: Build Lambda Container

on:
  push:
    branches: [main]

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v3
      - name: Install packer-pipeline
        run: pip install packer-pipeline
      - name: Configure AWS credentials
        uses: aws-actions/configure-aws-credentials@v2
        with:
          aws-access-key-id: ${{ secrets.AWS_ACCESS_KEY_ID }}
          aws-secret-access-key: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
          aws-region: us-east-1
      - name: Build container image
        run: python -m packer_pipeline --config config_packer.hcl

Configuration

Lambda Configuration

The Lambda function gets its configuration from SSM Parameter Store with the following parameters:

/template-automation/GITHUB_API - GitHub API URL
/template-automation/GITHUB_ORG_NAME - GitHub organization name
/template-automation/TEMPLATE_REPO_NAME - Name of the template repository
/template-automation/TEMPLATE_CONFIG_FILE - Name of the config file (default: config.json)
/template-automation/GITHUB_COMMIT_AUTHOR_NAME - Name for commit author
/template-automation/GITHUB_COMMIT_AUTHOR_EMAIL - Email for commit author
/template-automation/TEMPLATE_TOPICS - Comma-separated list of repository topics

Terraform Module Configuration

These parameters are managed by the terraform-aws-template-automation module. When deploying the Lambda function using the Terraform module, configure these variables in the module:

module "template_automation" {
  source = "github.com/HappyPathway/terraform-aws-template-automation"

  # GitHub configuration
  github_api_url            = "https://api.github.com"
  github_org_name           = "your-org"
  template_repo_name        = "your-template-repo"
  
  # Other module configuration...
}

Deployment

The project uses GitHub Actions for automated deployments. On push to main:

Creates/updates ECR repository using Terraform
Builds Lambda container image using Packer
Pushes image to ECR
Tags the release

For manual deployment:

Initialize Terraform:
```
terraform init
```
Apply Terraform configuration:
```
terraform apply
```

Build and push container image:

packer init packer.pkr.hcl
packer build -var "repository_uri=$(terraform output -raw repository_uri)" -var "tag=latest" packer.pkr.hcl

Resources

AWS Lambda Container Images
HashiCorp Packer
AWS ECR Public
GitHub Actions
Terraform AWS Provider
Packer Pipeline - Tool for automating image builds

SCT-Engineering/template-automation-lambda

About

Resources

Stars

Watchers

Forks

Releases

Contributors 2

Languages