Page Comparison

...

AWS EC2 c5.xlarge
    CPU: 4 vCPU
    RAM: 16 GB
    Storage: 10 GB
    OS: Ubuntu 22.04.2 LTS
Execution Tools:
    Java 11 JDK
    Performance Suite: https://github.com/Bahmni/performance-test/tree/bahmni-standard-ciel
    Test Data Generator: https://github.com/Bahmni/bahmni-test-data-generator
    Initial Data Generated using generator: 99995 patients, 70931 visits, 70931 encounters, 425586 observations

The initial backup taken after generating the above test data is available here.

📗 Test 1 - 70 Concurrent Users 4 Hours

Report Link: https://bahmni.github.io/performance-test/bahmnistandard-70users-5hours-20240726/index.html

Observations:

• No.of Patient Created: 1730, No.of Visits created: 4991, No.of Encounters Created: 2040, No.of Observations Created: 12970

Expand
title CPU, Memory, Network Performance Visualisation
Image Modified

📗 Test 2 - 70 Concurrent Users 8 Hours

Report Link: https://bahmni.github.io/performance-test/bahmnistandard-70users-8hours-20240726/index.html

Observations:

• No.of Patient Created: 3410, No.of Visits created: 9912, No.of Encounters Created: 4060, No.of Observations Created: 25296

• There were 20 encounter API call failure with 400 which due to the system trying to add the same drug order which is already active.

Expand
title CPU, Memory, Network Performance Visualisation
Image Modified

📗 Test 3 - 120 Concurrent Users 8 Hours

Report Link: https://bahmni.github.io/performance-test/bahmnistandard-120users-8hours-20240727

Observations:

• No.of Patient Created: 5810, No.of Visits created: 17449, No.of Encounters Created: 7049, No.of Observations Created: 42969

• There were 151 encounter API call failure with 400 which due to the system trying to add the same drug order which is already active.

• Note: The 99th percentile of post encounter went above expected to 1257

Expand
title CPU, Memory, Network Performance Visualisation
Note: The CPU usage load was high above ~60% compared to 70 users run which was at ~35%

📗 Test 4 - 120 Concurrent Users 24 Hours

Report Link: https://bahmni.github.io/performance-test/bahmnistandard-120users-8hours24hours-20240727

Observations:

• No.of Patient Created: 17336, No.of Visits created: 51462, No.of Encounters Created: 20716, No.of Observations Created: 124238

• There were

...

• 884 encounter API call failure with 400 which due to the system trying to add the same drug order which is already active.

• There are 3(delete session, getAllObservation Templates, getActive visits) requests failed with a 502 status

• Note:

  • The 99th percentile of post encounter went above expected

...

• • (1000ms) to 1413

  • The max time of post encounter went above expected(3000ms) to 4015

  • The 95th percentile of emrapi.sqlSearch.activePatientsByLocation went above expected(1000ms) to 1056

  • The 99th percentile of emrapi.sqlSearch.activePatientsByLocation went above expected(1000ms) to 1545

  • The max of emrapi.sqlSearch.activePatientsByLocation went above expected(3000ms) to 4056

Expand
title CPU, Memory, Network Performance Visualisation

📗 Test 5 - 200 Concurrent Users 8 Hours

Report Link: https://bahmni.github.io/performance-test/bahmnistandard-120users200users-8hours-2024072720240728

Observations:

• No.of Patient Created: 9110, No.of Visits created: 28142, No.of Encounters Created: 10738, No.of Observations Created: 64412

• There were

...

• 1262 encounter API call failure with 400 which due to the system trying to add the same drug order which is already active.

...

• There are 3(find drug, get login locations, find encounter, start visit, search by ID) requests failed with a 502 status

• Note: APIs which exceeded expected results

Expand
title CPU, Memory, Network Performance Visualisation
Image Modified

Final Database State: 137931 patients, 182887 visits, 115534 encounters, 695471 observations. The backup of the all the subsystems is available here.