Release Notes

Real Load Release Notes

4.6.8 | 2022-5-19

  • Bug Fixes:
    • Adding of cluster members to AWS/EC2 ‘Cluster Controller’ instances which have launched by cloud credits did fail.
    • The status of cluster jobs was not updated by the real-time monitor.
    • Deleting of test jobs did fail if the corresponding cluster was no longer defined.
    • Starting of cloud instances is now prevented if the portal’s internal monitoring system is no longer working.
  • Portal Server version 4.6.8 requires now Measuring Agent version 4.2.0 (bug fix: incorrect measurement results were reported sporadically)

4.6.7 | 2022-5-18

  • New Features:
    • AWS/EC2 ‘Remote Proxy Recorders’ can now be started by cloud credits.
    • Preview of ‘Remote Proxy Recorder CA Root Certificate’ added when downloading a remote proxy recorder CA root certificate.
    • 40 seconds countdown to left navigation added when launching EC2 instances by cloud credits.

4.6.5 | 2022-5-10

  • New Features:
    • Support for team member accounts added:
      • Depending on the license (price plan), a normal user (main user) can also define sub-users (so-called team member accounts).
      • Team members can login as usual, with their email and password.
      • Team members can either have the same rights as the main user or alternatively only have read rights.
      • The team members (including the main user) can communicate with each other via push messages. The portal also shows which team member is currently online. Offline team members receive an email instead of an online push notification.
      • A list of all team members is provided for each team member (inclusive the main user), which contains the profile text and profile image of each team member.
      • Team member accounts are not portal-wide ‘public users’, and cannot act as public technical expert.
  • Bug Fixes:
    • Deleting of test jobs did fail if the corresponding measuring agent was no longer defined.

4.6.4 | 2022-4-18

  • New Features:
    • Support of special licenses to top up the amount of ‘Cloud Credits’.
    • License restrictions on the maximum number of Measuring Agents and Remote Proxy Recorders no longer apply when such components are launched by spending Cloud Credits.
    • The Web Browser interface has been optimized to support large screens.

4.6.2 | 2022-4-12

  • New Features:
    • Support of ‘Sign in with Microsoft’ added.

4.6.0 | 2022-4-10

  • New Features:
    • The list of excluded AWS/EC2 regions can now be edited in the admin menu.
    • The additional data transfer costs of AWS/EC2 instances which are started via the Portal Server are now billed via Cloud Credits.
    • A new Measuring Agent version 4.1.0 is available which is able to automatically configure the Java memory of the ‘Data Collector’ and the Java memory of executed Java test programs.
  • Portal Server version 4.6.0 supports Measuring Agent version 4.0.4 and version 4.1.0

In order to enable the automatic Java memory configuration of a Measuring Agent 4.1.0, the following Java program arguments must be set in the startup script: -autoAdjustMemory -osReservedMemory 1GB

Furthermore, the Java memory of the Measuring Agent should be set in the startup script as shown in the table below:

OS Physical Memory Measuring Agent Java -Xmx setting
<2 GiB 256m
2..3 GiB 512m
4..7 GiB 512m
8..15 GiB 1536m
16..31 GiB 3072m
32..63 GiB 4096m
64..96 GiB 6144m
>96 GiB 8192m
Odd number of GiB should be rounded up (e.g. 7.7 = 8 = 1536m).

Example: sudo -H -u dkfqs bash -c ‘CLASSPATH=/home/dkfqs/agent/bin/bcpkix-jdk15on-160.jar:/home/dkfqs/agent/bin/bcprov-jdk15on-160.jar:/home/dkfqs/agent/bin/bctls-jdk15on-160.jar:/home/dkfqs/agent/bin/DKFQSMeasuringAgent.jar;export CLASSPATH;nohup java -Xmx512m -DdkfqsMeasuringAgentProperties=/home/dkfqs/agent/config/measuringagent.properties -Dnashorn.args="–no-deprecation-warning" com.dkfqs.measuringagent.internal.StartDKFQSMeasuringAgent -autoAdjustMemory -osReservedMemory 1GB 1>/home/dkfqs/agent/log/MeasuringAgent.log 2>&1 &’

4.5.0 | 2022-3-27

  • New Features:
    • Amazon AWS/EC2 instances of ‘Measuring Agents’ and ‘Cluster Controllers’ can now be started directly in the Portal Server - without the customer needing an Amazon AWS account. The costs of such started AWS/EC2 instances are charged to the customer via so-called ‘Cloud Credits’, whereby the number of ‘Cloud Credits’ can be purchased as an integral part of a license or can also be purchased separately. For customers who register for the first time at the Portal Server, a free amount of ‘Cloud Credits’ will be credited to allow them try out this functionality. Note: It is still fully supported to launch Amazon AWS/EC2 instances of ‘Measuring Agents’ and ‘Cluster Controllers’ with your own Amazon AWS account by using the standalone tool ‘Desktop Companion’.
    • User Top Navigation: Link to Download Server and to Real Load Store added (both links are manageable by the administrator menu).
    • HTTP Test Wizard: Review and Edit URLs menu added.
    • Launched Cloud Instances menu added.
    • Cloud Credit Statement menu added.
    • Measuring Agents & Cluster Controllers menu: The ‘List of Predefined AWS/EC2 Measuring Agent AMIs’ shows no longer incompatible AMI versions.
    • The following new functions have been added for administrators:
      • User Accounts menu: Cloud Credit Statement menu per user added.
      • Server Settings menu: AWS/EC2 Cloud Provider API Settings section added.
      • Customize Auth Users Navigation menu: Download Components and Shop sections added.
      • Cloud Providers & Instance Type Credit Costs menu added.
      • Inspect AWS/EC2 Cloud Instances menu added.
      • Launched Cloud Instances menu added.
      • Cloud Credit Transactions menu added.

Advantages and disadvantages of ‘Cloud Credits’ versus launching AWS/EC2 instances by the ‘Desktop Companion’:

Benefits of ‘Cloud Credits’:

  • Full cost control. Cloud instances are automatically terminated after a selected time.
  • Easy to use. Seamless integration with the portal server.
  • No Amazon AWS account required and therefore no security issue for unauthorized AWS access.

Advantages of the ‘Desktop Companion’:

  • Lower costs for cloud instances compared to ‘Cloud Credits’(AWS self-cost are charged only).
  • Suitable for customers who use cloud instances frequently and are aware of AWS/EC2 costs involved.

4.4.4 | 2022-1-30

  • New Features:
    • Load-releasing Clusters of Measuring Agents are now supported. In order to operate a cluster, a separate process/component is required (so-called “Cluster Controller”) which is not part of the portal server and is operated by the customer himself. Cluster-Features:
      • Multiple clusters can be registered in the portal server using the UI, and the cluster members (measuring agents) can be assigned to the clusters with simple clicks.
      • Depending on the power of the Cluster Controller, a cluster can have several 100 members, which allows to perform load tests of almost unlimited strength (up to millions of concurrent users).
      • A cluster job can be started as easily as a normal job. The only difference is that a cluster is selected for execution instead of a single measuring agent.
      • Optionally, the content of input files can be automatically divided among the cluster members (e.g. if they contain user account credentials).
      • Cluster jobs support all runtime features like normal jobs: suspend job, resume job, stop job and kill job. Entering annotations at runtime is also supported.
      • The real-time display of cluster jobs is exactly the same as for normal jobs, but the statistics displayed at real time already contain the combined values of all cluster members. In addition, a table about the current operating status of each cluster member is available.
      • After a cluster job has been completed, the test result contains the combined values of all cluster members (analogous to the real-time display). In addition, the individual test results of the cluster members can also be displayed.
    • The following functions have been added to the “Remote User API”:
      • getMinRequiredMeasuringAgentVersion
      • getMinRequiredClusterControllerVersion
      • getMinRequiredProxyRecorderVersion
      • getMeasuringAgentClusters
      • getClusterControllers
      • pingClusterController
      • addMeasuringAgentCluster
      • addMemberToMeasuringAgentCluster
      • removeMemberFromMeasuringAgentCluster
      • pingMeasuringAgentClusterMembers
      • setMeasuringAgentClusterActive
      • deleteMeasuringAgentCluster
    • Portal Server “Measuring Agents” menu: The AWS/EC2 popup highlights now incompatible AMI versions.
    • Portal Server “Test Jobs” menu: The log files of executed jobs can now directly copied to the project tree.
  • Bug Fixes:
    • A test job can now also have the state “execution failed”.
  • Portal Server version 4.4.4 requires now Measuring Agent version 4.0.4

4.3.23 | 2021-11-13

  • New Features:
    • HTTP Test Wizard: New Session Element ‘Outbound IP Address’ added. In order that this element can be used, multiple valid IP addresses must be assigned to the network interface of the Measuring Agent(s).
    • HTTP Test Wizard: Support of specific HTTP processing timeout per URL added.
    • Test Results: Support of annotation and annotation events added. The annotation and annotation events can be added at runtime during the test and are shown in the test result. In addition, annotation events can also be reported via the All Purpose Interface and generated, for example, by HTTP Test Wizard plug-ins.
  • Bug Fixes:
    • The cached HTTP Test Wizard Session in the Portal Server UI is now updated when a variable is defined, modified or deleted, and when a variable extractor or a variable assigner is deleted.
    • Invalid Java code was generated by the HTTP Test Wizard if the error handling of URLs was set to ‘Continue as usual’.
    • Performance bottleneck fixed in com.dkfqs.tools.http.HTTPClient (occurred since previous version 4.3.22).
    • An incorrect error exception was thrown in com.dkfqs.tools.crypto.EncryptedSocket when an SSL handshake timeout occurred
    • Realtime charts sometimes showed inexact measurement results.
  • Portal Server version 4.3.23 requires now Measuring Agent version 3.9.33 and DKFQS Tools version 2.2.25

4.3.22 | 2021-10-24

  • Documentation: All Purpose Interface added.
  • The All Purpose Interface has been extended by 3 new statistics types that can be declared at runtime:
    • average-and-current-value : An average and current value
    • efficiency-ratio-percent : An efficiency ratio in percent (0..100%)
    • throughput-time-chart : A chart of a throughput per second
  • The measurement results of the HTTP Test Wizard now contain the following additional test-specific values (if the executed HTTP Test Wizard session contains URL session elements):
    • Total Bytes Sent
    • Total Bytes Received
    • Network Throughput in Mbps (real-time: current value, test result: average value and chart)
    • Average TCP Connect Time in milliseconds (real-time: + latest value)
    • Average SSL Handshake Time in milliseconds (real-time: + latest value)
    • HTTP Keep-Alive Efficiency (0..100%)
  • Bug fix: The time in the name of the test result files is now always set in the time zone of the portal server, regardless of which time zone the Measuring Agents are operated.
  • Portal Server version 4.3.22 requires now Measuring Agent version 3.9.32 and DKFQS Tools version 2.2.24

4.3.21 | 2021-09-18

  • Searching for a text in all files of the project tree is now supported.
  • Support to upload files by drag and drop added.
  • Bug fix for assigning variables to HTTP requests in HTTP Test Wizard debugger.
  • Bug fix on real time statistics and test results if the measured unit is other than ms.
  • User profile images can now have a max size of 400 KB instead of 200 KB.
  • CA Root Certificates of HTTP/S Proxy Recorder(s) can now be downloaded via the Portal Server UI.
  • Documentation: User Guide added.
  • SNMP Plug-In published at https://portal.realload.com/publicPublishedPlugins

Portal Server Installation / Ubuntu 20: The “fontconfig” package has to be installed in order that the captcha generator is working:

sudo apt-get update
sudo apt-get install fontconfig

4.3.20 | 2021-08-07

  • HTTP Test Wizard Plug-Ins can now be published and are then available to other users.
  • The following HTTP Test Wizard Plugin fields are now protected by algorithms and cannot be manually modified by the JSON editor:
    • pluginId
    • authorNickname
  • A (new) “Resources Library” project is automatically created for each user in the Project Tree which contains by default the following “Resource Sets”:
    • “HTTP Test Wizard Plug-Ins”: by default empty
    • “Java”: contans always the latest version of com.dkfqs.tools.jar
    • “PowerShell”: contans always the latest version of DKFQSLibrary2.psm1
  • The “Resources Library” project contains common resources which are used by multiple projects. The users can add additional resource sets and files as needed to this project.
  • The file com.dkfqs.tools.jar is no longer copied to the corresponding resource set when a HTTP Test Wizard test is generated. Instead of this the generated test contain now a reference to “Resources Library / Java / com.dkfqs.tools.jar”.
  • New created HTTP Test Wizard Plug-Ins contain now by default a reference to the resource file “Resources Library / Java / com.dkfqs.tools.jar”.
  • More than 50 minor bugs have been fixed and some improvements have been made to the portal user interface.
  • Portal Server version 4.3.20 requires now Measuring Agent version 3.9.31
  • Existing tests and plug-ins should be upgraded to use com.dkfqs.tools.jar version 2.2.21 (located at “Resource Sets / Java”). This means that the tests have to be generated and defined once again.
  • The tuning parameters of Linux operating systems on which “Measuring Agents” run must be increased:

in /etc/security/limits.conf add or modify:

# TCP/IP Tuning
# =============
* soft     nproc          262140
* hard     nproc          262140
* soft     nofile         262140
* hard     nofile         262140
root soft     nproc          262140
root hard     nproc          262140
root soft     nofile         262140
root hard     nofile         262140

Enter: systemctl show -p TasksMax user-0

output: TasksMax=8966

if you get a value less than 262140 then add in /etc/systemd/system.conf

# System Tuning
# =============
DefaultTasksMax=262140

Reboot the system and verify the settings. Enter: ulimit -n

output: 262140

Enter: systemctl show -p TasksMax user-0

output: TasksMax=262140

4.3.18 | 2021-07-06

  • Support of Licenses added. Multiple licenses per user account are supported. New licenses can be entered via the Admin Menu and via the User Menu. Users whose license has expired can enter a new license during sign-in.
  • Pluggable Architecture for License Providers implemented.
  • Remote Admin API and Remote User API added. The corresponding API Authentication Tokens can be generated via the Admin Menu and via the User Menu. See API Documentation.
  • Unix Time Tool in User Menu added.
  • User accounts that are since a long time expired are now automatically deleted - including all user specific data. The number of days between the expiry date and the deletion date can be configured in the Admin Menu.
  • Deleted user accounts can now be viewed in the Admin Menu.
  • Portal Server version 4.3.18 requires now Measuring Agent version 3.9.30

4.3.14 | 2021-04-08

  • Support of multiple Price Plans / Limits for User Accounts such as Disk-Space, Number of Measuring Agents, Account expires time … (Admin Menu).
  • Access to Measuring Agents can now (optional) protected by an Authentication Token (password).
  • Configurable Default Price Plan for Sign Up (Admin Menu).
  • Configurable HTML content for Sign Up steps 1 to 4 and for (new) Sign Up completed “Welcome Page” (Admin Menu).
  • Test jobs are now digitally signed. This means that the following job settings on a Measuring Agent cannot be modified after the job has been transmitted to the Measuring Agent: type of job, local test job ID, number of users, maximum test duration.