Skip to content

[Major] Code Freeze PR #23

Merged
merged 126 commits into from
Jun 26, 2025
Merged
Show file tree
Hide file tree
Changes from 84 commits
Commits
Show all changes
126 commits
Select commit Hold shift + click to select a range
f078cda
yep
morga471 Feb 22, 2025
b8f4fcb
set back to normal
morga471 Feb 24, 2025
8bf1188
missed tempo
morga471 Feb 24, 2025
17213b7
change branch ref to test provider-resolution
morga471 Feb 25, 2025
d93462c
fix min vals
morga471 Feb 25, 2025
ea3d98e
2 is the lowest
morga471 Feb 25, 2025
5ebbfd7
docs and keycloak
morga471 Feb 26, 2025
484a3ff
use default for eks again
morga471 Feb 26, 2025
53adaab
tempo and kiali updates while working on keycloak
morga471 Feb 26, 2025
173a49f
almost
morga471 Feb 27, 2025
7259ae0
no v
morga471 Feb 27, 2025
94b86f8
cleanup
morga471 Feb 27, 2025
918871e
namespaces
morga471 Feb 27, 2025
f821a2a
use main
morga471 Feb 27, 2025
a998091
fmt
morga471 Feb 27, 2025
6cae9ad
namespace changes
morga471 Feb 27, 2025
28e97d9
update internal url ref
morga471 Feb 27, 2025
b0ae984
fmt
morga471 Feb 28, 2025
20f1940
versions
morga471 Feb 28, 2025
5d2d47e
more wip:
morga471 Feb 28, 2025
29bdf77
keycloak wip
morga471 Feb 28, 2025
6e98a22
update prom internal url input value
morga471 Feb 28, 2025
1e784cd
test changes on prom
morga471 Feb 28, 2025
d5b28eb
deleted old cluster platform-eng-eks-test and created new cluster pla…
nangu001 Feb 28, 2025
5a1bc49
testing more autoscaling stuffs
morga471 Feb 28, 2025
66d964a
wip
morga471 Mar 3, 2025
95a3fe5
wip
morga471 Mar 4, 2025
b8637a1
use my eks
morga471 Mar 5, 2025
04ebf44
otel added
morga471 Mar 7, 2025
903cbd1
ordering
morga471 Mar 7, 2025
c4d2018
test branch
morga471 Mar 7, 2025
cdcdb38
removed a few folders from workspace
morga471 Mar 11, 2025
cb0fbff
reset branches to default
morga471 Mar 11, 2025
6b71724
missed one
morga471 Mar 11, 2025
36cd88c
fmt
morga471 Mar 12, 2025
227bbab
use client id and secret
morga471 Mar 12, 2025
0469313
fix service name regex violation
morga471 Mar 12, 2025
79131e0
updates
morga471 Mar 13, 2025
f4c9769
update from lukes pr
morga471 Mar 13, 2025
d36cee3
disable gatekeeper
morga471 Mar 13, 2025
0d709f3
updated
morga471 Mar 17, 2025
a938d5d
update eks module renaming
morga471 Mar 20, 2025
66ae5d8
updated vars
morga471 Mar 21, 2025
564dfcc
revert dashboard stuff
morga471 Mar 22, 2025
ba67c9e
update inputs
morga471 Mar 22, 2025
3fd535c
fix profile
morga471 Mar 24, 2025
17b6935
latest
morga471 Apr 1, 2025
15c3214
updated eks module version and sorted namespaces
morga471 Apr 2, 2025
bd6d024
update to pass account and regino
morga471 Apr 15, 2025
0356b68
back to functional
morga471 Apr 16, 2025
609d0d0
initial arcgis module
morga471 Apr 16, 2025
74dc304
fix ordering
morga471 Apr 16, 2025
a604bba
add skip modules ability
morga471 Apr 16, 2025
1e8d5ad
add enterprise ecr stuff
morga471 Apr 17, 2025
8f00b5c
fmt
morga471 Apr 17, 2025
ad53131
wip
morga471 Apr 17, 2025
4462ccc
cross account pulls
morga471 Apr 17, 2025
5bb0891
updating readme (#22)
arnol377 Apr 17, 2025
360fa5d
full cluster
morga471 Apr 17, 2025
7eb461e
clean up ws
morga471 Apr 17, 2025
25df5e1
fix profile and update versions
morga471 Apr 17, 2025
3d81059
update ordering is istio is after otel
morga471 Apr 18, 2025
1726a12
match the version in eecr
morga471 Apr 18, 2025
6fd3843
add otel
morga471 Apr 18, 2025
3d3847e
add image versions passthrough
morga471 Apr 18, 2025
df5df84
fmt
morga471 Apr 18, 2025
cd4d2fc
move eecr data item to provider
morga471 Apr 18, 2025
943c453
pass ecr_info
morga471 Apr 19, 2025
219c63f
dupe
morga471 Apr 21, 2025
01bf24c
add gatekeeper
morga471 Apr 21, 2025
7057fc2
add gatekeeper
morga471 Apr 21, 2025
59b2752
add gatekeeper to workspace
morga471 Apr 21, 2025
3a73f89
update gatekeeper stuff
morga471 Apr 21, 2025
2b6adcf
fmt
morga471 Apr 21, 2025
19a4c29
add keycloak_public_url
morga471 Apr 21, 2025
d6b1691
add discovery_url
morga471 Apr 21, 2025
73e833a
fix enabled_modules ref
morga471 Apr 21, 2025
2e08564
fix discovery_url source
morga471 Apr 21, 2025
a18b316
add mock value to support run-all destroy after keycloak has been des…
morga471 Apr 22, 2025
c9b08a0
update input_vars.hcl contents
morga471 Apr 22, 2025
4dc4f34
use the right gatekeeper
morga471 Apr 22, 2025
054780a
fmt
morga471 Apr 23, 2025
0fc99eb
add release versions map
morga471 Apr 23, 2025
f09ffde
add module_versions and dynamic lookup for release_version
morga471 Apr 23, 2025
ed70cb1
rename release date
morga471 Apr 23, 2025
f32479f
update karpenter version, fmt
morga471 Apr 24, 2025
838c40a
fix(eks-gatekeeper): update inputs after module change
morga471 Apr 24, 2025
14d21ae
wip
morga471 Apr 29, 2025
6601f93
update versions after merges
morga471 Apr 29, 2025
8fe8025
updated gatekeeper for plan
morga471 May 2, 2025
a1fe4a4
move buildspecs to buildspecs dir
morga471 May 7, 2025
1bb45bb
python3.9 on this image
morga471 May 7, 2025
d982195
refactor pipeline stuff
morga471 May 10, 2025
92a8055
min
morga471 May 12, 2025
692671c
turn pipeline back on
morga471 May 13, 2025
e992d71
more wip
morga471 May 13, 2025
3285c2b
update
morga471 May 13, 2025
cabcbfc
updated from tfmod-pipeline
morga471 May 13, 2025
fdf1e44
add and delete for less git churn
morga471 May 13, 2025
234b863
add and delete for less git churn
morga471 May 13, 2025
b02a74c
add prefixes
morga471 May 13, 2025
ef394ab
add prefixes into locals context
morga471 May 13, 2025
dd0f4f2
add prefixes into root
morga471 May 13, 2025
182b34f
add aws-logs output
morga471 May 13, 2025
06b5314
add log tailing
morga471 May 14, 2025
278dc92
update source strings to use https
morga471 May 14, 2025
dbbbb39
central settings for codebuild
morga471 May 14, 2025
5a60910
ssh stuff
morga471 May 14, 2025
1f89b5d
wip
morga471 May 14, 2025
17e2238
back to ssh
morga471 May 14, 2025
279ffdb
back to https now that network works
morga471 May 14, 2025
5e3899b
ssh again
morga471 May 14, 2025
a415542
https again
morga471 May 15, 2025
0a36347
use a more recent image
morga471 May 16, 2025
f6f8f3f
add downloader
morga471 May 16, 2025
caf0f0b
updates to state mgmt
morga471 May 16, 2025
4b31d81
testing
morga471 May 16, 2025
a0e3a4c
fmt
morga471 May 16, 2025
7ffcbad
state issues
morga471 May 19, 2025
83282dc
update to gitlab
morga471 May 21, 2025
0fbf537
wip
morga471 May 28, 2025
51f796f
back to github
morga471 May 28, 2025
b44121e
getting sboms
morga471 Jun 3, 2025
9b87069
skip if in codebuild
morga471 Jun 3, 2025
38b25db
cleanup/cruft removal
morga471 Jun 18, 2025
b8ce910
new cluster updates
morga471 Jun 25, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
31 changes: 18 additions & 13 deletions .github/platform-tg-infra.code-workspace
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,14 @@
"name": "tfmod-cert-mgr",
"path": "../../tfmod-cert-mgr"
},
{
"name": "tfmod-config-job",
"path": "../../tfmod-config-job"
},
{
"name": "tfmod-custom-iam-role-for-service-account-eks",
"path": "../../tfmod-custom-iam-role-for-service-account-eks"
},
{
"name": "tfmod-eks",
"path": "../../tfmod-eks"
Expand All @@ -21,8 +29,12 @@
"path": "../../tfmod-eks-dns"
},
{
"name": "tfmod-gogatekeeper",
"path": "../../tfmod-gogatekeeper"
"name": "tfmod-esri-arcgis",
"path": "../../tfmod-esri-arcgis"
},
{
"name": "tfmod-gatekeeper",
"path": "../../tfmod-gatekeeper"
},
{
"name": "tfmod-grafana",
Expand Down Expand Up @@ -69,19 +81,12 @@
"path": "../../tfmod-prometheus"
},
{
"name": "tfmod-tempo",
"path": "../../tfmod-tempo"
},
{
"name": "terraform-aws-eks",
"path": "../../terraform-aws-eks"
},
{
"name": "terragrunt",
"path": "../../terragrunt"
"name": "tfmod-postgresql",
"path": "../../tfmod-postgresql"
},
{
"path": "../../tfmod-config-job"
"name": "tfmod-tempo",
"path": "../../tfmod-tempo"
}
]
}
168 changes: 114 additions & 54 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,55 +1,115 @@
## How to setup and run terragrunt scripts for EKS related modules in a LAB account

### Lab Account request and setup:
- Open a REMEDY ticket for creating an account in LAB environment, preferably with t3-admin role.
- LAB account url:https://pssvlab.tco.census.gov/PSS/
- Make a note that the LAB account password is different from laptop password
- Once you have successful log proceed to next steps below
### Access LAB jumphost (bromine):
Refer this page for additional help on sso credentials: https://github.e.it.census.gov/terraform/support/tree/master/docs/how-to/aws-sso

1. Goto LAB workspace:https://clients.amazonworkspaces.com/
2. Hit the web access login on the top right corner
3. Enter the following registration code: FRosu+FMEXNZ and click Register
4. Use your jbid and password (use lab password)
5. Open reflection client and ssh connect to bromine.cto.census.gov
6. On bromine, sso login to lab-gov as:
$ aws-sso-login.sh lab-gov
7. On a browser goto auth-dev.census.gov
8. Use PIV card option to login
9. Copy the link from step 6 and paste it on the portal and authenticate
10. Go back to bromine and doubleclick at an empty space, you should get successful login lab env

### Environment Setup:
- Set your profile as a default profile by exporting AWS_PROFILE variable
$ export AWS_PROFILE="224384469011-lab-dev-gov.inf-admin-t3"
$ aws sts get-caller-identity <to verify you are getting the credential from 224384469011>
- Run any aws commands to make sure you are getting responses from the account your profile is set to:
$ aws s3 ls

### Terraform/Terragrunt binaries and versions:
The following binaries used:
- Terraform version: v1.7.5
- Terragrunt version: v0.55.21
These versions can be found on bromine.cto.census.gov host at:
/app/terraform/bin/terr* folder
### Run the Terragrunt script:
- Cd to specifc folder (example: cd eks) and Run terragrunt plan
$ terragrunt plan
- Verify the plan output and make sure there are no errors
- Run terragrunt apply
$ terragrunt apply
- Verify apply completes successfully and verify the resources on AWS Console.

### Accessing the cluster:
$ aws eks --region us-gov-east-1 update-kubeconfig --name platform-eng-eks-test
$ kubectl config use-context arn:aws-us-gov:eks:us-gov-east-1:224384469011:cluster/platform-eng-eks-test
$ kubectl config get-contexts

### Run few kubectl commands to verify you are accessing the cluster
$ kubectl cluster-info
$ kubectl get pods -A
$ kubectl get ns
# Platform Infrastructure with Terragrunt

This repository helps manage cloud infrastructure using Terragrunt. It is designed to make managing infrastructure easier and more organized. Terragrunt is used to handle infrastructure as code for different environments.

## What's in This Repository

- `/configs` - Files for setting up things like node groups and resource limits
- `/docs` - Guides and rules for how to set up and manage the infrastructure
- `/lab` - Settings for testing and development environments
- `/monitoring` - Tools for keeping an eye on the system
- `/tests` - Tests to make sure everything works as expected

## Documentation

You can find detailed guides in the `/docs` folder:

- [Architecture](docs/ARCHITECTURE.md) - How the system is built
- [Documentation Standards](docs/DOCUMENTATION_STANDARDS.md) - How to write good documentation
- [Infrastructure Standards](docs/INFRASTRUCTURE_STANDARDS.md) - Rules for setting up infrastructure
- [Module Dependencies](docs/MODULE_DEPENDENCIES.md) - How different parts depend on each other
- [Module Standards](docs/MODULE_STANDARDS.md) - Rules for creating modules
- [Observability Standards](docs/OBSERVABILITY_STANDARDS.md) - How to monitor the system
- [Security Audit Checklist](docs/SECURITY_AUDIT_CHECKLIST.md) - Steps to check for security issues
- [Security Baseline](docs/SECURITY_BASELINE.md) - Basic security requirements
- [Testing Standards](docs/TESTING_STANDARDS.md) - Rules for testing
- [Version Control](docs/VERSION_CONTROL.md) - How to manage code versions

## What You Need

- Terraform v1.0.0 or newer
- Terragrunt v0.36.0 or newer
- AWS CLI set up with the right permissions
- Access to AWS resources

## How to Get Started

### Using the Makefile

This repository has a Makefile with helpful commands:

```bash
make help # See available commands
make init # Set up Terragrunt
make validate # Check if everything is set up correctly
make plan # Preview changes
make fmt # Format files
make check # Run all checks
make clean # Clean up temporary files
```

### Manual Terragrunt Commands

Go to the folder with the Terragrunt configuration you want to use:

```bash
cd lab/environment/component

# Set up Terragrunt
terragrunt init

# Preview changes
terragrunt plan

# Apply changes
terragrunt apply

# Remove resources
terragrunt destroy
```

### Running All Configurations

Run commands for all Terragrunt configurations:

```bash
# Set up everything
terragrunt run-all init

# Preview all changes
terragrunt run-all plan

# Apply all changes
terragrunt run-all apply
```

## Configuration

Terragrunt configurations are organized like this:

1. Main settings for each environment
2. Specific settings for different parts of the system
3. Overrides for special cases

Check the environment folders for more details.

## Testing

The `/tests` folder has tools to check if everything works. To run tests:

```bash
cd tests
./run_tests.sh
```

## How to Contribute

1. Make a copy of this repository
2. Create a new branch for your changes
3. Make your updates
4. Run `make check` to ensure everything is correct
5. Submit a pull request

## License

Copyright © 2025 Your Organization. All rights reserved.
Binary file added docs/enterprise_ecr_v1.drawio 1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading