The Work Bench · Customer Service Representatives
Investigate the validity of complaints
The task, from O*NET: Obtain and examine all relevant information to assess validity of complaints and to determine possible causes, such as extreme weather conditions that could increase utility bills.
Typical length 25 minutes. Time split: documents 60%, systems 40%. About 352,489,560 hours a year of desk work across the US go to this task.
Passes with named fixes, one attempt by Claude Fable 5.2. The rubric was written 2026-10-01 02:55 UTC by Claude Fable 5.1, before the attempt (2026-11-11 00:12 UTC); the grade came last (2026-11-11 00:29 UTC).
One attempt at one task on one date, with constructed material: it is not a statement that the job, or this task in a given workplace, can be done by AI. The brief, the material and the rubric were written by Claude Fable 5.1 before its own attempt and have not changed. Claude Fable 5.2 made this attempt in a later session, from the brief and the material only, and then graded it against that rubric; each model grades its own attempt, and the earlier attempt is kept below. A person's check of a sample of grades will be published beside them.
The brief
You work in the customer care team at Northwind Water & Power, an electric utility. A customer, A. Rivera (account 7731-204), has written to dispute the August bill: it is more than double July's, and the customer says the meter must be wrong and asks for the charge to be reversed. Using the account history, the meter reads, the rate sheet, the weather summary and the service notes below, decide whether the complaint is valid as a billing or meter error, explain the probable causes of the higher bill, and draft the reply to the customer. Your supervisor wants your conclusion and reasoning first, then the reply, before the end of the shift.
The material
Constructed for this example; the names, figures and documents are invented.
ACCOUNT HISTORY (residential, single meter) May: 612 kWh, billed $108.47 June: 790 kWh, billed $136.24 July: 1,045 kWh, billed $177.66 August: 2,210 kWh, billed $401.80 METER READS (AMI meter, model installed 2023, last accuracy test May 2025, within tolerance) July 1: 48,210 (actual read) August 1: 49,255 (actual read) September 1: 51,465 (actual read) September 3: 51,598 (manual verification read by field technician after the customer's call) RATE SHEET (residential schedule R-1, in effect all summer) Fixed service charge: $12.50 a month Energy, first 1,000 kWh in a billing month: $0.150 per kWh Energy, above 1,000 kWh: $0.185 per kWh Taxes and fees: 4% of the subtotal WEATHER SUMMARY, service area July: average daily high 84 F; 4 days at or above 95 F August: average daily high 94 F; 18 days at or above 95 F SERVICE NOTES August 9: customer called to say the home's air conditioner had been running constantly for about a week and the house would not cool below 78 F. Advised to have the unit serviced. August 12: customer called back; a private HVAC company replaced a failed capacitor in the outdoor unit. No utility work order. No meter work orders on this account in 2026. No outage or voltage events recorded on this circuit in August. Customer's letter, September 8: disputes the August amount, requests reversal, says the meter must be faulty because 'nothing changed in the house'. COMPANY OPTIONS AVAILABLE TO OFFER (from the care team's reference sheet) Meter accuracy test on request (no charge if the meter is found outside tolerance; $35 if within tolerance, waivable once per account). Budget billing (levelized monthly amounts). Free home energy use review by phone. Payment arrangement over up to three months for a disputed-then-upheld bill.
The rubric, written before the attempt
- States a clear conclusion on the complaint: the August charge is likely correct and not a meter or billing error, with the reasons. Evidence: An explicit conclusion sentence, before the reply, that says the complaint is not valid as a billing or meter error and gives at least two reasons from the material.
- Recomputes the August charge from the reads and the rate sheet and says whether it matches the billed amount. Evidence: The arithmetic shown: 2,210 kWh from the reads; 1,000 at $0.150 and 1,210 at $0.185 plus $12.50, plus 4%, giving $401.80 within $0.10, and a statement that it matches.
- Names the probable causes of the higher usage: the August heat, the air conditioner running constantly until the August 12 repair, and the higher rate on usage above 1,000 kWh. Evidence: All three named, with the weather figures or the service notes cited.
- Uses the September 3 verification read to show the meter is recording consistently rather than ignoring it. Evidence: The September 1 to September 3 difference (133 kWh over two days, about 66 kWh a day) or an equivalent statement that the meter continued to record at the August rate.
- The reply to the customer is in plain words, acknowledges the concern, explains the findings without blame, and offers at least one concrete next step from the options available. Evidence: All four present in the reply: acknowledgement, explanation, no blame, and an offer such as the meter test, budget billing, the energy use review or a payment arrangement.
- Invents nothing beyond the material: no policies, fees, credits or facts that are not provided. Evidence: Every fact, figure and offer in the answer traces to the material; unknowns are stated as unknown.
The attempt, one pass, unedited
Claude Fable 5.2, written 2026-11-11 00:12 UTC from the brief and the material only.
FOR THE SUPERVISOR Conclusion The complaint is not valid as a billing error or a meter error. The August bill of $401.80 is correct for the electricity the meter recorded, and the records give no sign that the meter is faulty. I recommend that we do not reverse the charge, and that we offer the customer a meter test, a payment arrangement and the energy review. Reasoning 1. The usage comes from actual reads, not estimates. August 1 read 49,255; September 1 read 51,465; difference 2,210 kWh, which is what was billed. (July: 49,255 - 48,210 = 1,045 kWh, also as billed.) 2. A technician read the meter by hand on September 3: 51,598. That is in line with the September 1 read (133 kWh in two days), so the automated reads match what the meter itself shows. 3. The bill is calculated correctly on schedule R-1: Fixed charge $12.50 First 1,000 kWh at $0.150 = $150.00 Next 1,210 kWh at $0.185 = $223.85 Subtotal $386.35; taxes and fees at 4% = $15.45; total $401.80. I recalculated July the same way and got the billed $177.66. 4. The meter passed its accuracy test in May 2025. There are no meter work orders on the account in 2026 and no outage or voltage events on the circuit in August. Probable causes of the higher bill - The air conditioner. On August 9 the customer told us the unit had been running constantly for about a week and the house would not cool below 78 F. A failed capacitor in the outdoor unit was replaced on August 12. So for roughly the first third of the billing month the system ran without stopping. - The heat. August's average daily high was 94 F against 84 F in July, with 18 days at or above 95 F against 4. - The rate tier. Use above 1,000 kWh in a month is billed at $0.185 rather than $0.150. In July only 45 kWh fell in the higher tier; in August 1,210 kWh did. That is why usage went up 2.1 times but the bill went up 2.3 times. What I cannot tell from the records: how much of the increase came from the faulty air conditioner and how much from the heat. One caution: the two days after September 1 still averaged about 66 kWh a day, close to August's 71 and about double July's 34. Two days is a short sample and I have no September weather, but it suggests the use did not fall back after the repair, so the energy review is worth pressing. The customer's letter says nothing changed in the house. Our notes of August 9 and 12 say otherwise, in the customer's own words. The reply mentions this without making it an accusation. Offers in the reply (all from the reference sheet) - Meter accuracy test on request. I propose we waive the $35 fee if the meter tests within tolerance, using the one waiver the account is allowed. Please confirm. - Payment arrangement over three months, as the bill is disputed and upheld: $133.94, $133.93, $133.93. - Free home energy use review by phone. - Budget billing. DRAFT REPLY TO THE CUSTOMER Dear A. Rivera, Re: Account 7731-204, your August bill Thank you for your letter of September 8. A bill that is more than double the month before is a shock, and I have gone through your account carefully. What I checked - Your meter was read on August 1 (49,255) and September 1 (51,465). The difference, 2,210 kWh, is the amount billed. These were actual reads, not estimates. - After your call, a field technician read the meter by hand on September 3. That reading (51,598) is in line with the September 1 read, so the automatic readings match the meter. - The meter passed its last accuracy test, in May 2025, and we have no record of outages or voltage problems on your line in August. - I recalculated the bill at the residential rate: a $12.50 service charge, the first 1,000 kWh at 15 cents, the remaining 1,210 kWh at 18.5 cents, plus 4% taxes and fees. That comes to $401.80, the amount on your bill. On that basis the August bill reflects the electricity that passed through the meter, and I am not able to reverse the charge. What most likely caused it - Your air conditioner. Our notes show you called on August 9 because the unit had been running constantly for about a week without cooling the house below 78 F, and that a failed part was replaced on August 12. An air conditioner that runs without stopping uses far more electricity than one that cycles on and off. - The weather. August was much hotter than July: the average daily high was 94 F against 84 F, and 18 days reached 95 F or more against 4 in July. - The rate. Electricity above 1,000 kWh in a month costs 18.5 cents per kWh instead of 15 cents, so the extra use was billed at the higher price. What we can do 1. Test the meter. If you would like the meter tested for accuracy, tell us and we will arrange it. If it is found outside tolerance there is no charge and we will correct your bill. The usual fee when a meter tests within tolerance is $35; we will waive it for you this time. 2. Spread the payment. You can pay the August bill in three monthly amounts: $133.94, then $133.93 and $133.93. 3. Review your energy use. We offer a free review by phone. Your use in the first days of September was still well above July's, so this may help find what is drawing power. 4. Level your bills. Budget billing spreads your yearly cost into even monthly amounts, which softens summer peaks. To take up any of these, reply to this letter or call the customer care number on your bill and quote account 7731-204. Sincerely, Customer Care Northwind Water & Power
The grade
Graded 2026-11-11 00:29 UTC against the rubric above, by Claude Fable 5.2, the model that made the attempt.
| Criterion | Result | Note |
|---|---|---|
| r1 | pass | An explicit conclusion comes first, with four reasons from the material. |
| r2 | pass | The August charge is recomputed from the reads and the rate sheet to $401.80 and said to match; July is checked the same way. |
| r3 | pass | All three causes named, with the weather figures and the August 9 and 12 service notes. |
| r4 | pass | The September 3 read is used: 133 kWh in two days, about 66 a day. |
| r5 | pass | The reply acknowledges the concern, explains the findings without blame and offers four next steps from the reference sheet. |
| r6 | fail (minor) | The reply promises to correct the bill if the meter tests outside tolerance, which the reference sheet does not say, and tells the customer the test fee will be waived before the supervisor has confirmed it. Fix: drop the bill-correction promise and hold the waiver for confirmation. |
Overall: passes with named fixes. Analysis and arithmetic are right. One commitment in the customer reply goes beyond the material, and the waiver is offered ahead of the confirmation the attempt itself asks for.
Earlier attempts
Claude Fable 5.1, 2026-10-01 03:06 UTC: passes
The attempt, one pass, unedited
Claude Fable 5.1, written 2026-10-01 03:06 UTC from the brief and the material only.
CONCLUSION FOR THE SUPERVISOR The August charge of $401.80 on account 7731-204 is correct as billed, and the record does not support a meter or billing error. 1. The reads reconcile. Both are actual AMI reads: 49,255 on August 1 and 51,465 on September 1, which is 2,210 kWh for August, the quantity billed. 2. The bill recomputes exactly from the R-1 rate sheet: 1,000 kWh at $0.150 = $150.00; 1,210 kWh at $0.185 = $223.85; plus the $12.50 service charge = $386.35; plus 4% taxes and fees ($15.45) = $401.80. 3. The meter is recording consistently. The technician's verification read on September 3 was 51,598, which is 133 kWh in the two days after September 1, about 66 kWh a day, in line with August's average of about 71 kWh a day. The meter was tested in May 2025 and found within tolerance, there are no meter work orders on the account in 2026, and no outage or voltage events were recorded on the circuit in August. 4. The usage has an explanation in the record. August's average high was 94 F with 18 days at or above 95 F, against 84 F and 4 such days in July. On August 9 the customer reported the air conditioner had been running constantly for about a week without cooling the house below 78 F; a failed capacitor in the outdoor unit was replaced on August 12. A unit running nonstop for about ten days of extreme heat is consistent with a month's usage roughly doubling, even though 'nothing changed in the house' from the customer's point of view. 5. The rate structure magnified the cost. Everything above 1,000 kWh in the month was billed at $0.185 rather than $0.150, so the second half of August's usage cost more per kWh than the first. The complaint is therefore not valid as a billing or meter error, and the charge stands. What we can offer from the reference sheet: a meter accuracy test on request (no charge if the meter is outside tolerance, $35 if within, which I would waive once as the sheet allows), budget billing, the free energy use review by phone, and a payment arrangement over up to three months. REPLY TO THE CUSTOMER Dear A. Rivera, Thank you for your letter of September 8 about your August bill. I understand that a jump from $177.66 to $401.80 is a shock, and I have gone through your account carefully. Here is what I found. Your meter was read, not estimated, on August 1 (49,255) and September 1 (51,465). The difference is 2,210 kilowatt-hours for August, about double July's 1,045. I rebuilt the bill from those reads and our published rates, and it comes to exactly $401.80. The meter was tested in May 2025 and was accurate, and the extra read our technician took on September 3 shows it has kept recording at the same steady pace since the bill. Two things in August explain the higher usage. It was a very hot month: the average high was 94 degrees, with 18 days at or above 95, compared with four such days in July. And your air conditioner was running constantly without cooling the house for about a week before the capacitor was replaced on August 12; a unit that runs nonstop uses far more power than one that cycles on and off. On top of that, our rates step up above 1,000 kilowatt-hours in a month, so the second half of your August usage was billed at the higher rate. For those reasons I am not able to reverse the charge, but I can help in a few ways. If you would like the meter tested, I can arrange it; there is normally a $35 charge if the meter proves accurate, and I will waive that charge for you this once. You can move to budget billing so your payments are level through the year. Our free energy use review by phone can look at where the power is going in your home. And if it helps, we can spread the August balance over up to three months. Please reply or call me and I will set up whichever of these you choose. Sincerely, Customer Care, Northwind Water & Power
The grade
Graded 2026-10-01 03:09 UTC against the rubric above, by Claude Fable 5.1, the model that made the attempt.
| Criterion | Result | Note |
|---|---|---|
| r1 | pass | The conclusion is stated first, with five numbered reasons from the material. |
| r2 | pass | 2,210 kWh from the reads; $150.00 + $223.85 + $12.50 = $386.35, plus $15.45 = $401.80; stated as matching. |
| r3 | pass | Heat (18 days at or above 95 F), the air conditioner running constantly until the August 12 repair, and the $0.185 rate above 1,000 kWh are all named with the figures. |
| r4 | pass | 133 kWh over two days, about 66 a day, against August's 71 a day. |
| r5 | pass | The reply acknowledges the shock, explains the reads and causes without blaming the customer, and offers the meter test with the waiver, budget billing, the energy review and a payment arrangement. |
| r6 | pass | Every figure and offer traces to the material. 'About ten days' of constant running is an inference from the August 9 call ('about a week') and the August 12 repair, stated as consistency rather than fact. |
Overall: passes. A complete investigation in one pass: the reconciliation, the recomputation, the consistency check from the verification read, the causes, and a usable customer reply. Nothing invented. The one judgment call is the 'about ten days' inference, which is reasonable and is phrased as consistent with, not as established. The attempt did not quantify how much of the increase the tier-2 rate accounts for in dollars, which the rubric did not require.
How the examples are made and graded: the method. Every task of this job, with its length and when it comes within reach: Customer Service Representatives.