Probability and Statistics: Star problems
Ten optional challenges to stretch your reasoning. Work on paper, use hints when you need them, and check the answer or full solution when you are ready. You can skip these problems and continue the course.
- 1 of 3 stars: Stretch
- 2 of 3 stars: Challenge
- 3 of 3 stars: Deep challenge
Stars indicate difficulty within this set.
0 of 10 completed · 0 skipped
Progress saved in this browser.
Progress can't be saved in this browser, so your choices last for this visit only.
-
Problem 1 Two order rules and a separation rule
Difficulty: 1 of 3 stars, Stretch
Six distinct cards numbered are placed in a row. How many arrangements have somewhere to the left of , have somewhere to the left of , and do not place and next to each other? Explain why every division or multiplication in your count is valid.
- Hint 1
First count arrangements satisfying just the two left-to-right rules.
- Hint 2
Among those arrangements, forbidden neighbors can occur only as the ordered block . Treat this block as one object.
Answer
arrangements.
Full solution
There are unrestricted arrangements.
Swapping the labels and pairs every arrangement with one having the opposite order of that pair.
Thus exactly half have before .
Within that half, swapping and preserves the first condition and reverses the second, so exactly half also have before .
This gives .
Now remove the arrangements in which and are neighbors.
Since must precede , they form the single ordered block .
Together with this gives five distinct objects.
Exactly half of their orders have before , by the same label-swap pairing.
There are therefore forbidden arrangements.
The desired count is
Treating adjacency as an unordered block would incorrectly double the subtracted count: the block was never among the arrangements.
The pairing explanations also avoid assuming that unrelated-looking restrictions are automatically independent.
Answer
arrangements.
Key idea
A symmetry count needs a bijection that preserves every restriction already imposed.
- Hint 1
-
Problem 2 Evidence from an unmarked bag
Difficulty: 1 of 3 stars, Stretch
Bag contains four red and two blue counters; bag contains two red and four blue counters. A fair coin selects a bag, and then two counters are drawn uniformly at random from that same bag without replacement. Both drawn counters are red.
(a) Given this evidence, what is the probability that bag was selected?
(b) Repeat the experiment with replacement: return the first counter before an independent uniform second draw. If both are red, what is the new conditional probability? Explain why the two answers differ.
- Hint 1
Compute the probability of two reds under each bag separately, then include the equal bag-selection probabilities.
- Hint 2
Conditioning keeps only the two-red outcomes. The relative likelihoods of that evidence, rather than the original equal chances of the bags, determine the answer.
Answer
(a) . (b) .
Full solution
Without replacement, the two-red probabilities are from and from .
After including the fair bag choice, the probabilities of the joint events are and .
The probability of the evidence is their sum, .
Therefore
With replacement, the second draw has the original color probabilities and is independent of the first, conditional on the chosen bag.
The likelihoods are now and
Including the equal bag weights and conditioning gives
Without replacement, a first red removes half of bag 's red counters but only one quarter of bag 's.
A second red is consequently stronger evidence for in that experiment: the likelihood ratio is instead of .
Equal prior chances do not remain equal after evidence is observed.
Answer
(a) . (b) .
Key idea
Conditional probabilities depend on how evidence was generated; replacement changes the likelihood even when the bag contents stay the same.
- Hint 1
-
Problem 3 An impossible statistical report
Difficulty: 1 of 3 stars, Stretch
A report claims that five real measurements have mean , population variance , and include the value . Here population variance means the sum of the squared deviations from the mean divided by .
Prove that the report is impossible. If the mean and the measurement are retained, find the least possible population variance and describe every list attaining it.
- Hint 1
The other four measurements have a forced sum and hence a forced mean.
- Hint 2
Write the other measurements as , where . Expand their squared deviations from .
Answer
The population variance must be at least . Equality occurs only for the list , in any order; variance is impossible.
Full solution
The five measurements sum to .
After one occurrence of is set aside, the other four sum to , so their mean is .
Write them as for , with
The total squared deviation from is
Dividing by gives population variance at least , contradicting the reported value .
Notice that the single value contributes only to the squared-deviation total.
Comparing with the claimed total would miss the contradiction: the remaining measurements must collectively balance its positive deviation and cannot all equal .
Equality in the derived bound requires for all four remaining measurements.
Thus they must all be .
This list has mean and variance , proving both attainability and the complete equality classification.
Answer
The population variance must be at least . Equality occurs only for the list , in any order; variance is impossible.
Key idea
A reported mean constrains the remaining deviations; an extreme observation forces spread elsewhere in the data.
- Hint 1
-
Problem 4 Arranging a repeated-letter code
Difficulty: 2 of 3 stars, Challenge
A code uses exactly three copies of , two copies of , and two copies of . Copies of the same letter are indistinguishable. How many distinct seven-letter codes have no adjacent 's and no adjacent 's? Adjacent 's are allowed.
If a code is selected uniformly from all distinct arrangements of these seven letters, what is the probability that it satisfies both restrictions? Explain why your construction counts each allowed code once.
- Hint 1
Delete the three 's from an allowed code. What four-letter skeleton remains?
- Hint 2
Insert the 's into three different gaps of a skeleton. If the two 's touch in the skeleton, their intervening gap must be chosen.
Answer
allowed codes, with probability .
Full solution
First arrange the non- letters .
There are skeletons, each with five gaps: before the first letter, between successive letters, and after the last.
To avoid adjacent 's, insert one into each of three distinct gaps.
Three skeletons have adjacent 's: .
For each, the gap between the two 's must receive an .
The other two occupied gaps can be any two of the remaining four, giving choices.
In the other three skeletons the 's are already separated, so any three of the five gaps work: choices.
There are therefore allowed codes.
Deleting every from a finished code recovers its unique skeleton, and the positions of the deleted letters recover its occupied gaps.
This proves that the construction neither duplicates nor omits an allowed code.
All distinct codes number
Under the stated uniform selection, the probability is
One should divide by , not by , because identical-letter permutations are not different outcomes.
Answer
allowed codes, with probability .
Key idea
Deleting one letter type can expose a smaller skeleton whose gaps encode the remaining restrictions.
- Hint 1
-
Problem 5 Reading until the order breaks
Difficulty: 2 of 3 stars, Challenge
Eight distinct cards numbered through are shuffled uniformly among all orders. Read cards from left to right, stopping as soon as a newly read number is smaller than the immediately preceding number. If this never happens, stop after reading all eight cards. Let be the number of cards read, including the card that causes a stop.
(a) What is the probability that the first decrease occurs on the fourth card?
(b) Find the exact mean value of , meaning . Explain your method without listing all shuffles.
- Hint 1
For any chosen positions at the beginning, every relative order of their distinct values is equally likely. How often are the first increasing?
- Hint 2
A shuffle with contributes to each of the counts . Thus the mean equals .
Answer
(a) . (b) .
Full solution
The first cards are increasing with probability : for every chosen set of values, exactly one of its relative orders is increasing, and all are equally likely.
This statement does not assert that comparisons of neighboring cards are independent.
The first decrease occurs on card four precisely when the first three cards are increasing but the first four are not.
Since the latter increasing event is contained in the former, its probability is
For the mean, a fixed outcome with can be counted as indicators: one each for
Averaging this finite identity over all equally likely shuffles gives
The first two probabilities are .
For , reaching card means that the first cards were increasing, so the probability is .
Consequently the mean is
Both a last-card decrease and a completely increasing shuffle have ; the reaching-card calculation correctly includes both without confusing their stopping reasons.
Answer
(a) . (b) .
Key idea
For a stopping count, averaging how many stages are reached can be simpler than finding every exact stopping probability.
- Hint 1
-
Problem 6 Combining and adjusting two groups
Difficulty: 2 of 3 stars, Challenge
Group has real measurements with mean and population variance . Group has real measurements with mean and population variance . Population variances use the group size as the divisor.
(a) Find the mean and population variance of the combined measurements.
(b) Add a constant to every measurement in and a constant to every measurement in , while keeping the combined mean unchanged. Find the least possible combined population variance and all pairs attaining it. Explain why averaging the two given variances is insufficient.
- Hint 1
For each group, expand its deviations from the combined mean as deviations from its own mean plus a constant.
- Hint 2
The deviations within each group add to zero. The combined squared-deviation total splits into fixed within-group terms and terms measuring the two group means' distances from the overall mean.
Answer
(a) Mean and population variance . (b) Minimum , attained only at .
Full solution
The combined mean is
For a group of size , mean , and population variance , expanding around gives
because the cross term contains
Thus the original combined variance is
The weighted within-group contribution alone is ; the different group means add another .
After the shifts, keeping the combined mean requires .
Adding a constant does not change deviations from a group's own mean, so its own variance stays fixed.
The new combined variance is therefore
The last numerator is a sum of nonnegative squares.
Its minimum is zero exactly when and , and this pair satisfies .
Both adjusted group means then equal .
This proves the minimum and uniqueness.
An unweighted average ignores the unequal group sizes; even a weighted average misses the spread between their means.
Answer
(a) Mean and population variance . (b) Minimum , attained only at .
Key idea
Pooled variance contains both variation within groups and variation between group means.
- Hint 1
-
Problem 7 Which distribution has the larger upper tail?
Difficulty: 2 of 3 stars, Challenge
Two real-valued performance measurements are modeled as normal: has mean and standard deviation , and has mean and standard deviation . Success means a measurement is at least a cutoff .
(a) Find all real for which , and identify the equality cutoff.
(b) At , estimate both success probabilities. You may use and for a standard normal . Its upper-tail probability is strictly decreasing in the cutoff.
(c) If only the stated means and standard deviations are known, construct two non-normal distributions with those same summaries for which the success-probability ranking at reverses. For a finite distribution, use probability-weighted means and variances.
- Hint 1
Convert the same cutoff into a standard normal input for each measurement and compare those inputs.
- Hint 2
For the counterexample, try two equally likely values for . For , place some probability exactly at and choose one lower value and its probability to preserve both summaries.
Answer
(a) Exactly , with equality at ; has the larger success probability for . (b) Approximately for , for . (c) Let equal or with probability each; let equal with probability and with probability .
Full solution
Under the normal models, the standardized cutoffs are and .
Since the same standard-normal upper-tail function is strictly decreasing, has the larger success probability exactly when
which simplifies to .
Equality holds exactly at , and the comparison reverses below it.
Thus the higher mean alone does not determine the chance of passing every possible cutoff.
At , the inputs are for and for , giving the supplied estimates and .
The decimals are rounded normal-table values, not exact fractions.
For a counterexample without normality, take with equal probabilities.
Its mean is , its variance is , and
Take with probability and with probability .
Its mean is and its variance is , but
The ranking has reversed while both summaries are preserved.
The endpoint counts in this discrete example, unlike a single point under a continuous normal model.
Answer
(a) Exactly , with equality at ; has the larger success probability for . (b) Approximately for , for . (c) Let equal or with probability each; let equal with probability and with probability .
Key idea
Mean and standard deviation support a tail calculation only after a distributional model is justified.
- Hint 1
-
Problem 8 Failures without an independence promise
Difficulty: 3 of 3 stars, Deep challenge
Three sensors are used on the same trial. Each sensor individually fails with probability . No independence assumption is made. Let be the probability that at least two sensors fail.
(a) Find the smallest and largest possible values of . Prove both bounds and describe joint failure patterns attaining each.
(b) Show that every value between your bounds can occur while all three individual failure probabilities remain .
(c) What would be if the three failures were mutually independent?
- Hint 1
Let be the probability of exactly failures. Count the total failure probability by sensors and by the number of failures in a trial.
- Hint 2
For an upper-bound construction, allow either no failures or exactly two. In the latter case, treat the three possible failing pairs symmetrically.
Answer
(a) , with both endpoints attainable. (b) Every in this interval is attainable. (c) Under mutual independence, .
Full solution
Let be the probability of exactly failures.
Summing the three individual failure probabilities counts a trial with failures times, so
Since , it follows that , while probabilities give .
This argument uses no independence.
To attain , choose exactly one failing sensor uniformly among the three on every trial.
Each sensor fails with probability , and two never fail together.
To attain , use no failures with probability and choose each of the three failing pairs with probability .
Each sensor belongs to two pairs and again fails with probability .
For any target , first choose the second construction with probability and the first with probability , using an auxiliary random choice.
Both constructions have the same individual failure probabilities, so their mixture does too.
Only the second can produce at least two failures, giving probability
Under mutual independence, exactly two fail with probability , and all three fail with probability .
Their sum is , one particular value within the full possible interval.
Answer
(a) , with both endpoints attainable. (b) Every in this interval is attainable. (c) Under mutual independence, .
Key idea
Individual probabilities do not determine joint behavior; bounds and explicit constructions reveal what dependence can change.
- Hint 1
-
Problem 9 A fixed median with the least spread
Difficulty: 3 of 3 stars, Deep challenge
Five real numbers lie in , have mean , and have median . Repeated values are allowed, and the median is the third value after sorting.
(a) Find every possible value of .
(b) For each possible , find the least population variance and describe every data set attaining it. Your proof must respect the order restrictions imposed by the median.
- Hint 1
Write the values in order as and use their sum to bound .
- Hint 2
For , at least three values are no larger than . Fix the sum of those three and bound the squared deviations of each group by the square of its group mean. Treat by using the last three values.
Answer
(a) . (b) The least variance is . The unique multiset attaining it consists of three copies of and two copies of .
Full solution
For sorted values, the total is at most and at least .
Since it equals , necessity gives
For every such , the list containing three 's and two copies of lies in , has mean , and has median .
This proves sufficiency.
For the variance bound, recall that numbers with sum have squared deviations from totaling at least .
This follows by expanding around their own mean ; equality requires all numbers equal.
If , let
Then
Applying the group bound to these three values and the other two gives total squared deviation at least
If , use instead; the same expression and inequality follow.
Dividing by gives variance at least .
Equality forces , the selected three values all equal to , and the other two equal to .
The constructed list realizes these conditions, including , where all values are .
Answer
(a) . (b) The least variance is . The unique multiset attaining it consists of three copies of and two copies of .
Key idea
An order statistic imposes active constraints on several data points, so variance minimization must respect groups on each side of it.
- Hint 1
-
Problem 10 How many values can exceed a threshold?
Difficulty: 3 of 3 stars, Deep challenge
Twenty real scores in have mean and population variance .
(a) What is the largest possible number of scores that are at least ? Prove the bound and describe every list attaining it.
(b) More generally, let real values have mean and positive population variance . For , prove that the fraction of values at least satisfies . State the equality conditions, including any restriction needed for a finite list. No normal-distribution assumption is available.
- Hint 1
Using only squared deviations from wastes the information that the deviations sum to zero. Try squaring distances from a different center.
- Hint 2
For part (a), expand . For part (b), use the shifted center and compare every qualifying term with .
Answer
(a) At most scores; equality requires sixteen scores equal to and four equal to . (b) ; equality requires only the values and , with respective fractions and , so both counts must be integers.
Full solution
For part (a), the mean makes , and the variance gives
Therefore
Each score at least contributes at least , while all other terms are nonnegative.
There can be at most four such scores.
Equality requires every qualifying score to be exactly and all others to be exactly .
This list lies in the required interval and has mean and variance .
For the general result, set
Expanding around the mean yields
Each of the qualifying values contributes at least , and the remaining terms are nonnegative.
Consequently
Equality requires all qualifying values to be and all others to equal .
Balancing their deviations from gives exactly the stated fractions, and direct substitution gives variance .
For a finite list, must be an integer; when it is, the two-value construction proves attainability.
If it is not, the real-valued fraction bound still holds, but equality cannot occur.
Answer
(a) At most scores; equality requires sixteen scores equal to and four equal to . (b) ; equality requires only the values and , with respective fractions and , so both counts must be integers.
Key idea
A carefully shifted square can combine mean and variance into a sharper tail bound than deviation squares alone.
- Hint 1