-
Notifications
You must be signed in to change notification settings - Fork 1
Expand file tree
/
Copy pathindex.html
More file actions
126 lines (102 loc) · 9.09 KB
/
Copy pathindex.html
File metadata and controls
126 lines (102 loc) · 9.09 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
<!DOCTYPE html>
<html>
<head>
<meta charset='utf-8'>
<meta http-equiv="X-UA-Compatible" content="chrome=1">
<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1">
<link href='https://fonts.googleapis.com/css?family=Architects+Daughter' rel='stylesheet' type='text/css'>
<link rel="stylesheet" type="text/css" href="stylesheets/stylesheet.css" media="screen">
<link rel="stylesheet" type="text/css" href="stylesheets/pygment_trac.css" media="screen">
<link rel="stylesheet" type="text/css" href="stylesheets/print.css" media="print">
<!--[if lt IE 9]>
<script src="//html5shiv.googlecode.com/svn/trunk/html5.js"></script>
<![endif]-->
<title>ContinuITy: Automated Performance Testing in Continuous Software Engineering</title>
</head>
<body>
<header>
<div class="logo">
<h1> <img src="images/logo_continuity-500x240.png" alt="ContinuITy" width="40%" height="40%" /> </h1>
</div>
<div class="subtitle">
<div class="inner">
<h2>ContinuITy: Automated Performance Testing in Continuous Software Engineering</h2>
<a href="https://github.com/ContinuITy-Project" class="button"><small>Follow us on</small> GitHub</a>
<div class="navigation">
<ul>
<li>
<a href="index.html" class="currentlink">Home</a>
</li>
<li>
<a href="downloads.html"">Downloads</a>
</li>
<li>
<a href="publications.html">Publications</a>
</li>
<li>
<a href="contact.html">Contact</a>
</li>
</ul>
</div>
</div>
</div>
</header>
<div id="content-wrapper">
<div class="inner clearfix">
<section id="main-content">
<h3>
<a id="aboutProject" class="anchor" href="#description" aria-hidden="true"><span class="octicon octicon-link"></span></a>ContinuITy Research Project</h3>
<p>
To create responsive and cost-effective application systems, performance regressions must be detected early in the software development process and especially before delivery. However, practice shows that load tests, as the relevant form of performance tests, either do not exist or are performed in poor quality — i.e. they are not representative of the actual usage profile in productive operation. This is due to the effort and competence required to create the load test scripts. In addition, the scripts quickly become obsolete due to system and usage profile changes and their maintenance is associated with a high effort. The problem is aggravated in the context of the emerging continuous software development (DevOps), in which software changes are put into operation ever faster and more frequently. Due to the required test duration, it is not practicable to perform a load test for each change in order to detect performance regressions, for example. If regressions are performed via aggregated changes, a manual diagnosis is necessary to determine the responsible change in the software or the usage profile.
</p>
<p>
Therefore, <a href="http://www.novatec-gmbh.de/">Novatec Consulting GmbH</a> and the <a href="http://uni-stuttgart.de/">University of Stuttgart</a> (<a href="http://www.iste.uni-stuttgart.de/rss/">Reliable Software Systems Group</a>) launched the collaborative research project ContinuITy on “Automated Performance Testing in Continuous Software Engineering”. It has the goal to ensure automated, efficient and sustainable load testing by using continuously recorded measurement data from productive operation and to integrate it into continuous software development. Load tests are automatically extracted from measurement data and evolved. Load tests are defined by a modular description language and can be enriched by additional semantics — e.g. by test type and targets. As part of the automation of the software development process (Continuous Delivery), a selection of relevant load tests, the detection of regressions and their diagnosis is carried out.
</p>
<p>
ContinuITy started in September 2017 with a duration of two and a half years, funded by the <a href="http://www.bmbf.de/">German Federal Ministry of Education and Research (BMBF)</a>. Novatec Consulting GmbH and the Reliable Software Systems Group possess comprehensive experience in APM and performance engineering of enterprise software systems from industry and academia. The ContinuITy approach is being evaluated in qualitative and quantitative studies, including laboratory experiments and enterprise software systems used in industry, which are provided by our associated partners. These are a German company from the logistics sector operating a cloud-based IoT platform and a software management company.
</p>
<h3><a id="framework" class="anchor" href="#description" aria-hidden="true"><span class="octicon octicon-link"></span></a>ContinuITy Framework</h3>
<p>
ContinuITy provides a web-based framework for collecting productive measurement data continuously and generating load tests efficiently. It defines a RESTful API for uploading the data and submitting orders for extracting, parameterizing, and executing load tests. The API can be both accessed by users and software such as Continuous Integration and Delivery pipelines. Besides, ContinuITy provides means for creating load tests and analyses based on a user concern formulated in a natural-like language.
</p>
<p>
The framework provides a high degree of automation. Creating load tests or analyses does not require expert knowledge. Instead, users can describe their concerns in easily understandable languages, and the framework takes care of generating the tests or reports automatically. For that, it leverages different approaches for workload analysis, clustering, forecasting, and transformation.
</p>
<p>
ContinuITy integrates with various tools, approaches, and formats on all sides. It can process numerous measurement data formats such as Apache logs or traces in a tool-independent format, which integrates with commercial and open-source monitoring and APM tools. At the same time, it can create load tests for different load testing tools. Hence, it adjusts to already existing infrastructure.
</p>
<p>
ContinuITy can be easily set up using the provided Docker images as a standalone application. As soon as the application to be load-tested sends productive monitoring data in an accepted format, and ContinuITy was able to learn the end-users' behavior, it is ready to generate load tests.
</p>
</section>
<aside id="sidebar">
<br />
<p align="center"><a class="twitter-timeline" data-lang="en" href="https://twitter.com/ContinuITy_proj">Tweets by ContinuITy_proj</a> <script async src="https://platform.twitter.com/widgets.js" charset="utf-8"></script></p>
<br /><br />
<h3>
<a id="consortium" class="anchor" href="#consortium" aria-hidden="true"><span class="octicon octicon-link"></span></a>Consortium</h3>
<br />
<a href="http://www.novatec-gmbh.de/"><img src="images/logo-novatec.png" alt="NovaTec Consulting GmbH" title="NovaTec Consulting GmbH" width="70%" height="70%" /></a>
<br /><br /><br />
<a href="http://www.uni-stuttgart.de/"><img src="images/logo-ustuttgart-140x29.png" alt="Universität Stuttgart" title="Universität Stuttgart" width="140" height="29" /></a>
<br /><br /><br />
<h3><a id="tools" class="anchor" href="#tools" aria-hidden="true"><span class="octicon octicon-link"></span></a>Partners</h3>
<br />
<a href="http://www.inspectit.rocks"><img src="images/Logo_inspectIT.png" alt="inspectIT APM" title="inspectIT APM" width="65%" height="65%" /></a>
<br /><br /><br />
<a href="http://kieker-monitoring.net"><img src="images/Kieker-logo-trans-140x42.png" alt="Kieker Monitoring" title="Kieker Monitoring" width="140" height="42" /></a>
<br /><br /><br />
<a href="http://research.spec.org"><img src="images/SPECreseach-logo-SM-65x110.png" alt="SPEC Research Group (RG)" title="SPEC Research Group (RG)" width="65" height="110" /></a><a href="http://research.spec.org/working-groups/devops-performance-working-group/"><img src="images/RGDevOps-logo-crop-whitebg-65x110.png" alt="SPEC RG DevOps Performance Working Group" title="SPEC RG DevOps Performance Working Group" width="65" height="107" /></a>
<br /><br /><br />
<h3><a id="sponsor" class="anchor" href="#sponsor" aria-hidden="true"><span class="octicon octicon-link"></span></a>Sponsor</h3>
<br />
<a href="http://www.bmbf.de/"><img src="images/BMBF_CMYK_Gef_e-transp-140x107.png" alt="Sponsored by the German Federal Ministry of Education and Research" title="Sponsored by the German Federal Ministry of Education and Research" /></a>
<br /><br />
<p>
<p>This page was generated by <a href="https://pages.github.com">GitHub Pages</a> using the Architect theme by <a href="https://twitter.com/jasonlong">Jason Long</a>.</p>
<p>This site uses Google Analytics. More details are available on the <a href="privacystatement.html">privacy statement page</a>.</p>
</aside>
</div>
</div>
</body>
</html>