AWS Load and Performance tests
I'm going to keep a history here of our load tests as we learn about it.
These generally involve locust.io scripts (kept in the loadtests/ subfolder of our code), and HTML output files you can look at.
Test 1 - 28 April 2021 - our server versus Amazon
Comparing: - our current dev server (without cloudfront) - AWS T3.medium instance with 1024 CPU and 2048 memory with 2 processes
Scenario: test ramps up to 400 users with spawn rate of 2 per second. Each user logs in, and visits about 5 pages, then logs out. Using the 'micro UK match'
Results summary: AWS wins hands down. AWS seems to hande logins in 200ms versus 500ms on app1. Far less errors (only 5 in entire test). CPU load appeared to 'drop' twice during the test, presumably as it added a new ser ver so was not at 100%
The baseline instance looks better than our current one!
Test 2 - 29 April 2021 - one instance versus 3
AWS environment. 800 users spawning 4 per second.
Comparing 1 medium T3 instance against 3 instances (manually scaled)
Test 3 - 5 May 2021 10:15ish am - on new Fargate stack
AWS environment after rebuilding with Fargate. Results here
We saw the system scale up to 3 processes. 0.5% error rate