CS 6553 Performance Evaluation, Spring 2004 Assignment 0
Due Thursday, January 22, 2004
This assignment related to Example 1.7 on page 7 of the text.
Consider a generalization of the example in which the throughputs of
System A are a1 and a2 and the corresponding throughputs of
System B are b1 and b2. Assume that both have the same average
throughput, that is a1+a2 = b1+b2. Do not assume that
a1=b2 or a2=b1.
Under what conditions (values if a1, a2, b1, b2) will comparing the
throughput with respect to System B (Table 1.4) give
- A the same average throughput as B
- A better average throughput than B
- A worse average throughput than B
There are three major evaluation techniques discussed in the text.
See Table 3.1 on page 31. They are analytical modeling,
simulation, and measurement. In this example, they would correspond to
using algebra, writing a program, and building hardware, respectively.
The building hardware option is not available for this assignment so your
choices are analytical analysis and simulation (programming).
You may use either or both.
Analytical analysis would involve writing down an inequality in terms of
the variables a1, a2, b1, b2 along with the constraints (a1+a2=b1+b2)
and solving the inequality. If you could do this in general, it would
give the most detailed answer.
Simulation involves writing a program that will calculate the average
throughput of A with respect to B and comparing it with the
average throughput of B for different values of the parameters.
You would need to decide what parameter values to use.
Fill in the following table comparing the two methods for this problem.
The table is like that of Table 3.1 on page 31, but you should fill it
in based on this particular problem. Some of the entries may not be
the same as in Table 3.1.
| Criterion | Analytical Modeling | Simulation |
| Time Required | | |
| Tools | | |
| Accuracy | | |
| Cost | | |
Turn in a report giving your analysis. The first page of the report should
contain a paragraph describing the method or methods you used
and why you chose it.
The second paragraph should contain a summary of your results, the answers to
the three questions above.
The rest of your report should contain the details of your analysis.
If you used algebra, your calculations should be shown. If you used a program,
include a listing and the output and explain what each program did.
Write your report assuming that it will be read by other members of the class.