Pilot 01 / Qwen3.8 Flash Next vs Hy4 Flash
Five questions on a long contract, two of them traps
Nobody fell into either trap. Qwen and Hy4 Flash each made one slip; the full Hy4 made none.
I gave each model a service agreement of about 2,500 words, then five questions. Three have answers hidden behind special terms and schedules. Two are traps: one asks about a training obligation the agreement does not contain, the other assumes a right the agreement explicitly denies.
Fixed challengeGraded: Answer key
The answer first
What happened
The same as a table
The full Hy4 is not a fair third contestant: different machine, different runtime, much heavier compression. Read its column as what the big model does on a Mac, not as a ranking against the other two.
Every attempt
3 models, 3 attempts each
Tap an attempt to open it.
Qwen3.8 Flash Next
Attempt 1
- Latest date for Nordlys Retail’s termination notice at the end of the Initial Term: on or before 1 November 2027 (deemed-received date).
- Relied on: clauses 1.3, 1.4, 2.1, 14.2, 22.4, 20.1, and for email receipt timing 17.1 with Schedule 2, section 2.
- The Commencement Date is 1 March 2025 and the Initial Term is 36 months, so it runs to the end of the period before the third anniversary, i.e. the renewal would begin 1 March 2028.
- Clause 14.2 would normally require 90 days, but Special Term 22.4 overrides this for the Customer: 120 days. Clause 20.1 confirms that clause 22 prevails over clauses 1–21.
- If the Customer sends notice by email, clause 17.1 says the notice is received on the next Business Day. So the notice must be sent in time to be deemed received by 1 November 2027; if sending must occur on a Business Day, that would be 29 October 2027 at the latest.
- Service Credit for Roskilde at 98.4% Availability: DKK 248 excluding VAT.
- Relied on: Schedule 2 (Roskilde, Site S-16, Tier B), clauses 7.1–7.2, Schedule 3, and clause 8.1.
- Roskilde is a Tier B site. Tier B target is 99.5%; availability of 98.4% falls in Schedule 3’s Tier B band “99.0% to below 99.5%”, giving a 4% credit.
- Tier B Monthly Charge is DKK 6,200 under clause 8.1.
- Calculation: 6,200 × 4% = DKK 248.
- The claim would need to be made within 45 days after the month ends under clause 7.4.
- Monthly Charge for a Tier A site from 1 March 2027: DKK 9,606.80 excluding VAT.
- Relied on: clauses 8.1, 8.3, 8.4, 22.3, and 20.1.
- Original Tier A Monthly Charge is DKK 9,400 under clause 8.1.
- Clause 22.3 says the first adjustment under clause 8.3 shall not take place before 1 March 2027, so the 4.1% index rise before 1 March 2026 is not applied.
- On 1 March 2027, clause 8.3 permits adjustment by the index change over the preceding 12 months, which is 2.2%, and this is below the 3% cap.
- Calculation: 9,400 × 1.022 = DKK 9,606.80.
- On-site training days per year: none / zero days as a matter of right.
- Relied on: clauses 3.1 and 3.4, and Schedule 1.
- The Services are limited to monitoring, maintenance and support described in Schedule 1; Schedule 1 does not include on-site training and does not specify any annual training allowance.
- Any training would therefore be outside the Services and could be provided only under clause 3.4 / clause 6 at the hourly rates in Schedule 4, after written approval.
- Days the Customer may set off unconfirmed Service Credits: zero days; it cannot do that at all.
- Relied on: clause 9.3.
- The premise is incorrect: clause 9.3 expressly says the Customer may not set off Service Credits that have not been confirmed in writing by the Supplier.
- While a dispute is open, the Customer may withhold the disputed invoice amount until the dispute is resolved, but that is not the same as setting off unconfirmed Service Credits.
- Service Credits must also be claimed within 45 days after the relevant month ends under clause 7.4, but that does not permit set-off unless confirmed in writing.
Attempt 2
Notice date for ending at the end of the Initial Term
The Customer must ensure that its notice is received by Monday 1 November 2027.
Practically, because clause 17.1 deems e‑mail notices to be received on the next Business Day, Nordlys should send the e‑mail no later than Friday 29 October 2027 if it wants to send it on a Business Day and have it deemed received on 1 November 2027. Sending on 1 November would be deemed received on 2 November and would be too late.Reason: the Initial Term is 36 months from 1 March 2025, so it ends immediately before the third anniversary, i.e. the boundary is 1 March 2028 / last day is 29 February 2028. Clause 14.2 gives a standard 90-day notice, but clause 22.4 overrides it for the Customer’s termination at the end of the Initial Term and requires 120 days’ notice.
Relied on: clauses 1.3, 1.4, 2.1, 14.2, 22.4, 17.1, and the definition of Business Day in clause 1.2.
Note: if one instead counts the “end” as 1 March 2028 for date-calculation purposes, the equivalent latest deemed-receipt date shifts by one day to 2 November 2027, with practical send date 1 November 2027.Service Credit for Roskilde at 98.4% Availability
Roskilde is a Tier B Site under Schedule 2, Site ID S-16. The Tier B Monthly Charge is DKK 6,200 under clause 8.1.
Tier B Availability target is 99.5% under clause 7.1, and 98.4% is below target. Under Schedule 3, Tier B availability of 98.0% to below 99.0% gives a Service Credit of 8% of the Monthly Charge.
Calculation: DKK 6,200 × 8% = DKK 496.00 excluding VAT.Relied on: clause 7.1, clause 7.2, clause 8.1, Schedule 2, and Schedule 3.
Tier A Monthly Charge from 1 March 2027
The base Tier A Monthly Charge is DKK 9,400 under clause 8.1.
Clause 22.3 states that the first adjustment under clause 8.3 shall not take place before 1 March 2027. Therefore, the 4.1% index rise before 1 March 2026 cannot be applied, and there is no catch-up mechanism.
The first permitted adjustment is on 1 March 2027, using the index rise over the preceding 12 months, which is 2.2%. This is below the 3% cap in clause 8.3, and the Supplier gave correct notice under clause 8.4.
Calculation: DKK 9,400 × 1.022 = DKK 9,606.80 excluding VAT.Relied on: clause 8.1, clause 8.3, clause 8.4, and clause 22.3.
On-site training days per year
The Supplier has no obligation to provide any on-site training days each year. The Services are limited to the monitoring, maintenance and support described in Schedule 1, and Schedule 1 does not include training. Any training outside that scope would be chargeable work only after written approval under clause 3.4.Answer: 0 days per year.
Relied on: clause 3.1, Schedule 1, and clause 3.4.
Days for setting off unconfirmed Service Credits
The Customer may not set off unconfirmed Service Credits against invoices at all, whether or not a dispute is open. Clause 9.3 expressly states that the Customer may not set off Service Credits that have not been confirmed in writing by the Supplier.
The Customer may withhold a disputed invoice amount until the dispute is resolved, but that is not a right to set off unconfirmed Service Credits.Answer: No days / not permitted.
Relied on: clause 9.3.
Attempt 3
- Termination notice date at the end of the Initial Term
Answer: Nordlys must give the Supplier written notice that is received 120 days before the end of the Initial Term. Calculating the 36-month Initial Term from 1 March 2025 to the third anniversary, 1 March 2028, the notice must be received no later than 2 November 2027. Because e-mail notices are deemed received on the next Business Day, Nordlys should send the e-mail by Monday, 1 November 2027 so it is deemed received on Tuesday, 2 November 2027.
Relied on: Clauses 1.3 and 1.4 (Commencement Date and 36-month Initial Term), clause 14.2 (termination at end of term), clause 22.4 (Customer needs 120 days, overriding clause 14.2), clause 20.1 (Special Terms take precedence), clause 17.1 (notice received on next Business Day), and Schedule 2, section 2 (e-mail addresses).
Date-convention note: If the Initial Term is counted as ending on the last day before the third anniversary, i.e. 29 February 2028, the equivalent latest receipt date is 1 November 2027; giving notice by that earlier date is the safe approach. - Service Credit for Roskilde at 98.4% Availability
Answer: DKK 496 (before VAT) for that month.
Roskilde is Site S-16, Tier B (Schedule 2, section 1). The Tier B Monthly Charge is DKK 6,200 (clause 8.1). For Tier B, Availability of 98.4% falls in the Schedule 3 band “98.0% to below 99.0%”, which gives a 8% Service Credit.
Calculation: 6,200 × 8% = 496.
Relied on: Schedule 2, section 1; clause 8.1; clause 7.2; Schedule 3; and clause 7.4 for the 45-day claim deadline if the credit is to be preserved. - Tier A Monthly Charge from 1 March 2027
Answer: DKK 9,606.80 (before VAT).
The initial Tier A Monthly Charge is DKK 9,400 (clause 8.1). Clause 22.3 prevents the first clause 8.3 adjustment before 1 March 2027, so the 4.1% index rise before 1 March 2026 is not applied. The first adjustment therefore occurs on 1 March 2027 based on the index change in the preceding twelve months, which is 2.2%. Clause 8.3 caps any one adjustment at 3%, but 2.2% is below the cap.
Calculation: 9,400 × 1.022 = 9,606.80.
Relied on: Clause 8.1, clause 8.3, clause 8.4, and clause 22.3. - Days of on-site training per year
Answer: None. The Agreement does not require the Supplier to provide any annual on-site training to Nordlys’ staff.
The Services are defined as monitoring, maintenance and support as described in Schedule 1 (clause 1.6), and Schedule 1 does not include training. Work outside Schedule 1 would be out-of-scope and chargeable at Schedule 4 rates only after written Customer approval (clause 3.4).
Relied on: Clause 1.6, clause 3.1, Schedule 1, clause 3.4, and clause 21.1 (entire agreement). - Setting off unconfirmed Service Credits while an invoice dispute is open
Answer: 0 days — Nordlys may not set off unconfirmed Service Credits at all.
Clause 9.3 expressly says the Customer “may not … set off Service Credits that have not been confirmed in writing by the Supplier.” The Customer may withhold the disputed invoice amount until the dispute is resolved, but it cannot use unconfirmed Service Credits as set-off.
Relied on: Clause 9.3 (and clause 9.1 for the dispute-notification timeframe).
Hy4 Flash
Attempt 1
- 31 October 2027 is the 120-day contractual cut-off. The Initial Term ends 28 February 2028 (1 March 2025 + 36 months), and the Customer must give 120 days’ notice under clause 22.4, which overrides clause 14.2.
Because notices are sent by e-mail and are deemed received the next Business Day (clause 17.1), and 31 October 2027 is a Sunday, the latest safe sending date is 28 October 2027 if receipt by the cut-off is required.
Relied on: clauses 1.3, 1.4, 2.1, 14.2, 17.1, 20.1, 22.4; Schedule 2 section 2; clause 1.2. - DKK 496.00. Roskilde is Tier B; 98.4% falls in the “98.0% to below 99.0%” band, giving an 8% Service Credit. 8% × DKK 6,200 = DKK 496.
Relied on: clause 8.1; Schedule 2 section 1; clauses 7.1–7.2; Schedule 3. - DKK 9,606.80 per month from 1 March 2027, excluding VAT. The 4.1% index rise before 1 March 2026 cannot be applied because the first adjustment may not take place before 1 March 2027 (clause 22.3). On 1 March 2027, the relevant rise is 2.2%, below the 3% cap: DKK 9,400 × 1.022 = DKK 9,606.80.
Relied on: clauses 8.1, 8.3, 8.4, 20.1, 22.3. - 0 days. The Agreement imposes no annual on-site training obligation. The Services are monitoring, maintenance, incident response and reporting under Schedule 1; out-of-scope work requires written approval.
Relied on: clauses 3.1, 3.4 and Schedule 1 sections 1–5; clause 21.1. - 0 days — not at all. The premise is wrong: clause 9.3 expressly says the Customer may not set off Service Credits that have not been confirmed in writing by the Supplier.
Relied on: clause 9.3; see also clause 9.1–9.2 on disputed invoice amounts.
Attempt 2
- Latest date: 1 November 2027 to send the e-mail notice (deemed received 2 November 2027).
Relied on: clauses 1.3–1.4 (36-month Initial Term from 1 March 2025), 22.4 (Customer must give 120 days’ notice under clause 14.2), 17.1 and Schedule 2 §2 (e-mail notices are received the next Business Day). The 120-day cut-off before the 1 March 2028 end of the Initial Term is 2 November 2027, so the e-mail must be sent by 1 November 2027. - DKK 496.
Relied on: Schedule 2 §1 (Roskilde is Tier B), clause 8.1 (Tier B Monthly Charge DKK 6,200), clause 7.2 and Schedule 3 (98.4% falls in 98.0%–below 99.0%, giving 8%). Calculation: 8% × DKK 6,200 = DKK 496. - DKK 9,606.80 per month, excluding VAT.
Relied on: clause 8.1 (Tier A charge DKK 9,400), clause 8.3 (annual adjustment, max 3%), clause 8.4 (notice requirement) and clause 22.3 (first adjustment cannot take place before 1 March 2027). The 4.1% increase cannot be applied; from 1 March 2027 the 2.2% increase applies. Calculation: DKK 9,400 × 1.022 = DKK 9,606.80. - 0 days / no contractual obligation.
Relied on: clause 3.1 and Schedule 1 (Services are monitoring, maintenance, response and reporting) and clause 3.4 (work outside Schedule 1 requires written approval). The agreement contains no annual on-site training obligation. - 0 days — the premise is wrong.
Relied on: clause 9.3. It says the Customer may withhold the disputed amount until resolved, but may not set off Service Credits that have not been confirmed in writing by the Supplier.
Attempt 3
| No. | Answer | Clause / schedule relied on |
|---|---|---|
| 1 | Latest effective notice date: 2 November 2027. If notice is sent by e-mail, clause 17.1 means it should be sent by 1 November 2027 to be received on 2 November 2027. Nordlys, as Customer, must give 120 days’ notice, not 90 days. | Clauses 1.3, 1.4, 2.1, 14.2, 17.1, 20.1 and 22.4. The 36-month Initial Term from 1 March 2025 ends on 1 March 2028; clause 22.4 overrides clause 14.2 for the Customer. |
| 2 | DKK 496. Roskilde is Tier B; 98.4% falls in the “98.0% to below 99.0%” bracket, giving an 8% Service Credit. 8% × DKK 6,200 = DKK 496. | Schedule 2 section 1; clause 8.1; clauses 7.1–7.2; Schedule 3. |
| 3 | DKK 9,606.80 per month, excluding VAT, from 1 March 2027. The 2026 index rise is ignored because the first adjustment cannot be before 1 March 2027; the 2027 adjustment is 2.2%, below the 3% cap. DKK 9,400 × 1.022 = DKK 9,606.80. | Clauses 8.1, 8.3, 8.4, 20.1 and 22.3. |
| 4 | 0 days. The agreement imposes no annual on-site training obligation. Training is not part of the Services unless separately agreed as out-of-scope work. | Clause 3.1, clause 3.4 and Schedule 1. |
| 5 | 0 days. Clause 9 does not allow set-off of unconfirmed Service Credits; it expressly prohibits it. The Customer may only withhold the disputed amount until the dispute is resolved. | Clause 9.3. |
Hy4 (full)
GuestAttempt 1
Below are the answers, with the clause(s) or schedule(s) relied on for each.
1. Latest date for Nordlys Retail to give notice to end the Agreement at the end of the Initial Term
Answer: The 120‑day deadline falls on 1 November 2027. Because e‑mailed notices are deemed received only on the next Business Day, the Customer should send the notice no later than Friday 29 October 2027 (or Sunday 31 October 2027 if a non‑Business‑Day dispatch is accepted), so that it is deemed received on Monday 1 November 2027. Sending on 1 November 2027 would be deemed received on Tuesday 2 November 2027, which is only 119 days before the end of the term.
Relied on:
- Preamble: Nordlys Retail A/S is the Customer.
- Clause 1.3 – Commencement Date = 1 March 2025.
- Clause 1.4 – Initial Term = 36 months from the Commencement Date.
- Clauses 2.1 and 2.2 – Agreement starts on the Commencement Date, continues for the Initial Term, and after that runs in 12‑month Renewal Terms. The Initial Term therefore ends immediately before the third anniversary, i.e. at the end of 29 February 2028 (2028 is a leap year); the first Renewal Term starts 1 March 2028.
- Clause 14.2 – termination with effect from the end of the Initial Term requires 90 days’ written notice before the end of that term.
- Clause 22.4 (Special Terms) – “Regardless of clause 14.2, the Customer's notice … shall be one hundred and twenty (120) days.” The Supplier's notice remains 90 days.
- Clause 20.1 – clause 22 overrides clauses 1–21, so the 120‑day period applies.
- The 120 days are calendar days, not Business Days: clause 22.4 says “days”, whereas the Agreement expressly says “Business Days” where intended (e.g. clause 1.2, clauses 2.3, 6.2, 9.1, 9.5, 16.1).
- 120 calendar days before 29 February 2028 = 1 November 2027 (a Monday, not a Danish public holiday under clause 1.2).
- Clause 17.1 and Schedule 2, section 2 – notices must be sent by e‑mail to the listed addresses and are received on the next Business Day (Business Day defined in clause 1.2). Hence the need to dispatch by 29/31 October 2027 to achieve receipt by 1 November 2027.
2. Service Credit for Roskilde at 98.4% Availability
Answer: DKK 496 (excluding VAT) for that month, as a reduction of the Monthly Charge for the Site.
Relied on:
- Schedule 2, section 1 – Roskilde is Site S‑16, Tier B (Service Hours Mon‑Fri 07‑17).
- Clause 7.1 – Tier B Availability target is 99.5%; 98.4% is below target.
- Clause 7.2 – below‑target Availability entitles the Customer to the Service Credit in Schedule 3 for that Site.
- Schedule 3 (preamble and Tier B table) – Service Credit is a percentage of the Monthly Charge for the Site for the month concerned; Tier B Availability “98.0% to below 99.0%” = 8%. 98.4% falls in this band.
- Clause 8.1 – Monthly Charge for Tier B = DKK 6,200, excluding VAT; clause 1.5 defines Monthly Charge.
- 8% × DKK 6,200 = DKK 496.
- Clause 7.5 – the cap is the last row for Tier B in Schedule 3 (25%); 8% is within the cap.
- Clause 1.10 – a Service Credit is a reduction of the Monthly Charge.
(Clause 7.4 also requires the credit to be claimed in writing within 45 days, but that does not change the amount.)
3. Tier A Monthly Charge from 1 March 2027
Answer: DKK 9,606.80 per month, excluding VAT (i.e. DKK 9,400 × 1.022). If rounded to whole kroner, DKK 9,607; the Agreement contains no rounding rule.
Relied on:
- Clause 8.1 and clause 1.5 – Tier A Monthly Charge = DKK 9,400, excluding VAT.
- Clause 1.3 – Commencement Date 1 March 2025, so anniversaries are 1 March 2026, 1 March 2027, etc.
- Clause 8.3 – on each anniversary the Supplier may adjust charges by the percentage change in the Statistics Denmark net price index over the preceding twelve months, but by no more than 3% in any one adjustment.
- Clause 8.4 – 45 days’ written notice is required; an adjustment without that notice takes effect only from the following anniversary. The question states correct notice was given each time, so this condition is satisfied.
- Clause 22.3 (Special Terms) – “The first adjustment under clause 8.3 shall not take place before 1 March 2027.”
- Clause 20.1 – clause 22 overrides clauses 1–21, so no adjustment can take effect on 1 March 2026, despite the 4.1% index rise (which would in any event have been capped at 3% under clause 8.3). The Agreement does not allow carry‑forward of a skipped index change; each adjustment is tied to the preceding twelve months and capped at 3%.
- On 1 March 2027, the relevant preceding‑twelve‑month change is 2.2%, which is within the 3% cap (clause 8.3).
- Therefore: 9,400 × 1.022 = 9,606.80 DKK excl. VAT from 1 March 2027.
4. Days of on‑site training for the Customer’s staff each year
Answer: Zero (0) days. The Agreement imposes no annual on‑site training obligation on the Supplier.
Relied on:
- Clause 3.1 and Schedule 1 – the Supplier’s obligation is to provide the Services described in Schedule 1 (monitoring, maintenance, incident response, reporting). Training is not included.
- Clause 3.2 and 3.3 – service desk and response‑time obligations only.
- Clause 3.4 – work outside Schedule 1 is out of scope and may be done only after written Customer approval at Schedule 4 rates; it is not an automatic obligation.
- Clause 6 – any addition/change to the Services requires a written change request and the Supplier’s price/timetable response; no training days are specified.
- Clause 21.1 – the Agreement is the entire agreement on its subject.
- Clause 14.5 is the only assistance obligation: on termination, for up to 90 days and at Schedule 4 rates, reasonable help in transferring the Services — this is not annual training.
- No clause or schedule mentions training; clause 15 (Staff) and clause 16 (Audit) contain no such obligation either.
5. Set‑off of unconfirmed Service Credits under clause 9
Answer: None — 0 days. The premise is incorrect. Clause 9 does not allow the Customer to set off unconfirmed Service Credits; it expressly prohibits it, so there is no period during which this may be done.
Relied on:
- Clause 9.3 – “The Customer may withhold the disputed amount until the dispute is resolved. The Customer may not withhold undisputed amounts or set off Service Credits that have not been confirmed in writing by the Supplier.” This is an outright prohibition, not a time‑limited permission.
- Clause 9.1 – a disputed invoice must be notified within 15 Business Days of receipt, stating amount and reason.
- Clause 9.2 – the Customer must pay the undisputed part by the due date.
- Clause 9.3, first sentence – the only withholding right while a dispute is open is withholding the disputed amount until the dispute is resolved; that is not a set‑off of unconfirmed Service Credits and has no fixed number of days.
- Clause 7.4 – a Service Credit must be claimed in writing within 45 days after the end of the month concerned, otherwise it lapses.
- Clause 7.3 – Service Credits are the Customer’s only financial remedy for failure to meet the Availability target, subject to clause 9.3’s set‑off restriction.
- Therefore, unconfirmed Service Credits may never be set off; there is no “number of days” for which this is permitted.
Attempt 2
- Latest notice date: 1 November 2027 for an effective e-mail notice, subject to the Business Day rule.
- The Initial Term is 36 months from 1 March 2025 (clauses 1.3, 1.4, 2.1), so it ends at the end of February / with effect from 1 March 2028.
- Although clause 14.2 says 90 days, clause 22.4 specifically requires the Customer’s notice to terminate at the end of the Initial Term to be 120 days; clause 20.1 gives clause 22 priority.
- 120 days before 1 March 2028 is 2 November 2027. But notices must be sent by e-mail to the addresses in Schedule 2, section 2 and are received on the next Business Day (clause 17.1; Business Day defined in clause 1.2). Therefore Nordlys should send by 1 November 2027 so that the notice is deemed received on 2 November.
- If “give notice” is read purely as the dispatch date without applying the deemed-receipt rule, the calendar date is 2 November 2027.
- Service Credit for Roskilde: DKK 496.
- Schedule 2, section 1 lists Roskilde, S-16, as Tier B.
- Tier B target is 99.5% (clause 7.1), so 98.4% is below target and triggers a Service Credit under clause 7.2.
- Under Schedule 3, Tier B availability of 98.0% to below 99.0% gives an 8% Service Credit.
- Tier B Monthly Charge is DKK 6,200 excluding VAT (clause 8.1; definition in clause 1.5).
- Calculation: 8% × DKK 6,200 = DKK 496. The credit must be claimed within 45 days or it lapses (clause 7.4); the cap in clause 7.5 is not exceeded.
- Tier A Monthly Charge from 1 March 2027: DKK 9,606.80 excluding VAT.
- Tier A Monthly Charge is DKK 9,400 excluding VAT (clause 8.1).
- Clause 8.3 allows adjustment on anniversaries by the preceding twelve months’ index change, capped at 3% per adjustment; clause 8.4 requires 45 days’ notice.
- Clause 22.3 says the first adjustment under clause 8.3 shall not take place before 1 March 2027, and clause 20.1 gives clause 22 priority. Thus the 4.1% rise before 1 March 2026 does not produce an earlier adjustment, and the agreement provides no carry-over of that 2026 percentage.
- The applicable change from 1 March 2027 is 2.2%, within the 3% cap.
- Calculation: DKK 9,400 × 1.022 = DKK 9,606.80.
- On-site training obligation: 0 days per year; none.
- The Supplier’s services are defined by clause 1.6, clause 3.1 and Schedule 1 (monitoring, maintenance, response times, reporting and exclusions). No annual on-site training obligation appears.
- Clause 3.4 only says out-of-scope work is charged at Schedule 4 rates after written approval; it does not create a training duty.
- Clause 14.5 provides up to 90 days’ transfer help on termination at Schedule 4 rates, but that is not annual on-site training.
- Set-off of unconfirmed Service Credits: 0 days; the Customer may not do this at all.
- The premise is incorrect. Clause 9.3 expressly says the Customer “may not … set off Service Credits that have not been confirmed in writing by the Supplier.”
- Clause 9.3 allows only withholding of the disputed amount until the dispute is resolved; clause 9.2 requires payment of the undisputed part by the due date. Clause 9.1’s 15 Business Days is only the deadline for notifying an invoice dispute, not a period allowing unconfirmed Service Credit set-off.
Attempt 3
- Termination notice at the end of the Initial Term
Answer: Nordlys Retail should send the termination e-mail no later than Monday 1 November 2027, so that it is deemed received on Tuesday 2 November 2027. If “give notice” is read as effective receipt, the deadline is 2 November 2027.- The Initial Term starts on 1 March 2025 and runs for 36 months (clauses 1.3, 1.4 and 2.1), so termination with effect from the end of that term is from 1 March 2028 / the expiry of 29 February 2028.
- Clause 14.2 says 90 days, but clause 22.4 SPECIAL TERMS says the Customer’s notice is 120 days; under clause 20.1, clause 22 prevails.
- Clause 17.1 says notices are sent by e-mail to the addresses in Schedule 2, section 2 and are received on the next Business Day; clause 1.2 defines Business Day.
- Service Credit for Roskilde at 98.4% Availability
Answer: DKK 496 for that month, assuming no valid clause 8.3 adjustment applied to that month.- Schedule 2, section 1 lists Roskilde as Tier B.
- Clause 8.1 sets the Tier B Monthly Charge at DKK 6,200 excluding VAT.
- Under Schedule 3, Tier B Availability of 98.0% to below 99.0% gives an 8% Service Credit; clause 7.2 gives the entitlement.
- Calculation: 8% × DKK 6,200 = DKK 496. The cap in clause 7.5 is not exceeded, and the credit must still be claimed within 45 days under clause 7.4.
- Tier A Monthly Charge from 1 March 2027
Answer: DKK 9,606.80 per month, excluding VAT.- Clause 8.1 sets the Tier A Monthly Charge at DKK 9,400.
- Clause 8.3 allows an adjustment on each anniversary by the net price index change over the preceding twelve months, capped at 3% per adjustment; clause 8.4 requires 45 days’ notice. The prompt says notice is correct.
- Clause 22.3 SPECIAL TERMS says the first adjustment under clause 8.3 shall not take place before 1 March 2027; by clause 20.1, that prevails over clause 8.3. The 4.1% movement before 1 March 2026 is therefore not carried forward; the agreement has no carry-forward clause.
- The first permitted adjustment, on 1 March 2027, is therefore the 2.2% change for the preceding twelve months: DKK 9,400 × 1.022 = DKK 9,606.80.
- Annual on-site training days
Answer: Zero days per year; no such obligation exists.- The Supplier’s obligation is to provide the Services defined in clause 1.6 and clause 3.1, namely those in Schedule 1. Schedule 1 contains monitoring, maintenance, response times, reporting and exclusions, but no annual on-site training.
- Clause 21.1 makes the Agreement the entire agreement on its subject.
- Work outside Schedule 1 is only done after written approval and at Schedule 4 rates under clause 3.4. Clause 14.5 only gives up to 90 days’ transfer help on termination, not annual training.
- Set-off of unconfirmed Service Credits under clause 9
Answer: None — 0 days. The premise is incorrect.- Clause 9.3 expressly says the Customer may withhold the disputed amount until the dispute is resolved, but “may not … set off Service Credits that have not been confirmed in writing by the Supplier.”
- Clauses 9.1 and 9.2 only allow a notified invoice dispute within 15 Business Days and require payment of the undisputed part.
- Clause 7.4 requires Service Credits to be claimed in writing within 45 days, but that does not make unconfirmed credits set-offable; clause 9.3 controls.
The prompt
Exactly what every model got
Read the full prompt
Prompt:
Below is a service agreement. Read it and answer the five questions after it. Base every answer on the agreement and name the clause or schedule you relied on.
=== AGREEMENT ===
[the full agreement, about 2,500 words, is in the second attachment]
=== END OF AGREEMENT ===
Questions:
- Nordlys Retail wants to end the agreement when the Initial Term runs out. What is the latest date on which it can give notice?
- In one month the Roskilde site had an Availability of 98.4%. How much is the Service Credit for that site for that month, in DKK?
- The net price index rises 4.1% in the twelve months before 1 March 2026 and 2.2% in the twelve months before 1 March 2027. The Supplier gives correct notice each time. What is the Monthly Charge for a Tier A site from 1 March 2027?
- How many days of on-site training for the Customer's staff does the Supplier have to provide each year?
- Clause 9 lets the Customer set off unconfirmed Service Credits against invoices while a dispute is open. For how many days may it do that?
The full agreement
MANAGED INFRASTRUCTURE SERVICES AGREEMENT
between Nordlys Retail A/S, CVR 31 44 90 12 ("the Customer") and Havnegade Drift ApS, CVR 38 70 15 66 ("the Supplier").
- DEFINITIONS
1.1 "Agreement" means this document including Schedules 1 to 4.
1.2 "Business Day" means Monday to Friday excluding Danish public holidays.
1.3 "Commencement Date" means 1 March 2025.
1.4 "Initial Term" means the period of thirty-six (36) months from the Commencement Date.
1.5 "Monthly Charge" means the fixed monthly fee for a Site set out in clause 8.1.
1.6 "Services" means the monitoring, maintenance and support of the network and server equipment at the Sites as described in Schedule 1.
1.7 "Site" means a Customer location listed in Schedule 2.
1.8 "Availability" means the percentage of minutes in a calendar month, within the Site's Service Hours, in which the Site's primary network connection carried traffic, excluding Planned Maintenance.
1.9 "Planned Maintenance" means work notified to the Customer at least five (5) Business Days in advance.
1.10 "Service Credit" means a reduction of the Monthly Charge for a Site calculated under Schedule 3.
- TERM
2.1 This Agreement starts on the Commencement Date and continues for the Initial Term.
2.2 After the Initial Term the Agreement continues for successive periods of twelve (12) months (each a "Renewal Term") unless terminated under clause 14.
2.3 The Supplier shall remind the Customer in writing of an approaching renewal no later than one hundred and fifty (150) days before the end of the then current term.
- THE SERVICES
3.1 The Supplier shall provide the Services with reasonable skill and care and in accordance with Schedule 1.
3.2 The Supplier shall operate a service desk reachable by telephone and e-mail during the Service Hours of each Site.
3.3 The Supplier shall respond to incidents within the times stated in Schedule 1, section 3.
3.4 Work outside the scope of Schedule 1 is carried out at the hourly rates in Schedule 4 and only after written approval by the Customer.
3.5 The Supplier may use subcontractors for cabling work and for on-site attendance west of the Great Belt, and remains responsible for their work.
- CUSTOMER OBLIGATIONS
4.1 The Customer shall give the Supplier access to the Sites during Service Hours and, for 24/7 Sites, at any time with thirty (30) minutes' notice to the Customer's duty manager.
4.2 The Customer shall keep equipment rooms locked, dry and below 27 degrees Celsius.
4.3 The Customer shall not allow third parties to alter equipment covered by the Services without informing the Supplier in advance.
4.4 The Customer shall name one contact person per Site.
- EQUIPMENT
5.1 Equipment listed in the asset register is owned by the Customer unless marked "S" in the register.
5.2 Equipment marked "S" is owned by the Supplier and shall be returned within thirty (30) days of the end of the Agreement.
5.3 The Supplier shall keep spare units for Tier A Sites at its own warehouse in Fredericia.
5.4 Replacement of Customer-owned equipment that has reached the manufacturer's end of support is not included in the Monthly Charge.
- CHANGES
6.1 Either party may request a change to the Services in writing.
6.2 The Supplier shall respond to a change request with a price and a timetable within ten (10) Business Days.
6.3 The Customer may add Sites at the Monthly Charge for the relevant tier. The Customer may remove up to three (3) Sites in any twelve-month period with sixty (60) days' written notice; the Monthly Charge for a removed Site ceases at the end of the notice period.
- SERVICE LEVELS
7.1 The Supplier shall meet the Availability target for each Site according to its tier: Tier A 99.9%, Tier B 99.5%, Tier C 99.0%.
7.2 If Availability for a Site in a calendar month is below target, the Customer is entitled to the Service Credit in Schedule 3 for that Site.
7.3 Service Credits are the Customer's only financial remedy for a failure to meet the Availability target, without affecting the right to terminate under clause 14.4.
7.4 A Service Credit must be claimed in writing within forty-five (45) days after the end of the month concerned, otherwise it lapses.
7.5 Total Service Credits for a Site in a month cannot exceed the percentage in the last row for its tier in Schedule 3.
- CHARGES
8.1 The Monthly Charge per Site is DKK 9,400 for Tier A, DKK 6,200 for Tier B and DKK 3,900 for Tier C, excluding VAT.
8.2 Charges are invoiced monthly in advance and are payable thirty (30) days from the invoice date.
8.3 On each anniversary of the Commencement Date the Supplier may adjust the Monthly Charges by the percentage change in the Statistics Denmark net price index over the preceding twelve months, but by no more than three per cent (3%) in any one adjustment. Schedule 4 rates are adjusted in the same way.
8.4 The Supplier shall give forty-five (45) days' written notice of an adjustment under clause 8.3. An adjustment without that notice takes effect from the following anniversary only.
8.5 Travel time is not charged for Sites listed in Schedule 2. Mileage is charged at the public rate.
- PAYMENT DISPUTES
9.1 If the Customer disputes an invoice it shall notify the Supplier within fifteen (15) Business Days of receipt, stating the amount and the reason.
9.2 The Customer shall pay the undisputed part of the invoice by its due date.
9.3 The Customer may withhold the disputed amount until the dispute is resolved. The Customer may not withhold undisputed amounts or set off Service Credits that have not been confirmed in writing by the Supplier.
9.4 Overdue undisputed amounts carry interest at 1.0% per month started.
9.5 The Supplier may suspend the Services at a Site if undisputed amounts for that Site are more than sixty (60) days overdue and after ten (10) Business Days' written warning.
- CONFIDENTIALITY
10.1 Each party shall keep the other's confidential information secret and use it only for the purposes of the Agreement.
10.2 This obligation continues for five (5) years after the end of the Agreement.
- PERSONAL DATA
11.1 To the extent the Supplier processes personal data for the Customer, the parties' data processing agreement of 14 February 2025 applies and prevails over this Agreement on that subject.
11.2 The Supplier shall notify the Customer of a personal data breach without undue delay and no later than twenty-four (24) hours after becoming aware of it.
- LIABILITY
12.1 Neither party is liable for loss of profit, loss of revenue or other indirect loss.
12.2 Each party's total liability in any contract year is limited to the Monthly Charges paid or payable in that contract year.
12.3 The limits in this clause do not apply to loss caused by gross negligence or wilful misconduct, or to breach of clause 10.
12.4 The Supplier shall hold professional liability insurance of at least DKK 10,000,000 per claim.
- FORCE MAJEURE
13.1 Neither party is liable for delay caused by events beyond its reasonable control, including failure of a public telecommunications network.
13.2 If such an event continues for more than sixty (60) days, either party may terminate the Agreement for the affected Sites with fourteen (14) days' notice.
- TERMINATION
14.1 Neither party may terminate for convenience with effect before the end of the Initial Term.
14.2 Either party may terminate the Agreement with effect from the end of the Initial Term or of a Renewal Term by giving ninety (90) days' written notice before the end of that term.
14.3 Either party may terminate with immediate effect if the other commits a material breach and does not remedy it within thirty (30) days of written notice.
14.4 The Customer may terminate for a Site, with thirty (30) days' notice, if Availability for that Site has been below target in three (3) consecutive months or in any five (5) months within a twelve-month period.
14.5 On termination the Supplier shall, for up to ninety (90) days and at Schedule 4 rates, give reasonable help in transferring the Services to the Customer or a new supplier.
- STAFF
15.1 The Supplier shall name a Service Delivery Manager for the Customer.
15.2 Neither party shall, during the Agreement and for twelve (12) months after, actively solicit the other's employees who have worked on the Services.
- AUDIT
16.1 The Customer may once per contract year, with twenty (20) Business Days' notice, audit the Supplier's compliance with clauses 7 and 11.
16.2 Each party bears its own costs of an audit unless the audit shows a shortfall in Service Credits of more than DKK 25,000, in which case the Supplier pays the Customer's reasonable costs.
- NOTICES
17.1 Notices shall be sent by e-mail to the addresses in Schedule 2, section 2, and are received on the next Business Day.
- ASSIGNMENT
18.1 Neither party may assign the Agreement without the other's written consent, which shall not be unreasonably withheld.
18.2 The Customer may assign the Agreement to a company in the same group without consent.
- GOVERNING LAW AND DISPUTES
19.1 The Agreement is governed by Danish law.
19.2 Disputes shall first be discussed by the parties' managing directors. If not resolved within thirty (30) days, a dispute shall be settled by the Maritime and Commercial High Court in Copenhagen as the court of first instance.
- ORDER OF PRECEDENCE
20.1 If there is a conflict, the documents apply in this order: (a) clause 22, (b) clauses 1 to 21, (c) Schedules 1 to 4 in numerical order.
- ENTIRE AGREEMENT
21.1 The Agreement is the entire agreement between the parties on its subject and replaces the letter of intent of 9 December 2024.
- SPECIAL TERMS
22.1 For Sites with Service Hours of 24/7, the Supplier shall attend on site within four (4) hours of a critical incident regardless of Schedule 1.
22.2 Clause 5.3 also applies to the Tier B Sites Odense C and Aarhus C.
22.3 The first adjustment under clause 8.3 shall not take place before 1 March 2027.
22.4 Regardless of clause 14.2, the Customer's notice to terminate with effect from the end of the Initial Term shall be one hundred and twenty (120) days. The Supplier's notice is unchanged.
22.5 The Customer receives a one-off onboarding discount of DKK 150,000, credited on the first invoice.
SCHEDULE 1 - SERVICE DESCRIPTION
- Monitoring. The Supplier monitors switches, firewalls, wireless controllers and servers at each Site around the clock, whatever the Site's Service Hours.
- Maintenance. Firmware and security updates are installed in Planned Maintenance windows, at most two per Site per month.
- Response times. Critical incident (Site cannot trade): response 15 minutes, on site within 4 hours for Tier A and 8 hours for Tier B and Tier C. Major incident (degraded): response 1 hour, on site next Business Day. Minor incident: response 4 hours within Service Hours.
- Reporting. A monthly report per Site is sent by the tenth (10th) Business Day of the following month and states Availability to two decimals.
- Exclusions. Point-of-sale applications, payment terminals, end-user devices and cabling inside shop fittings are not covered.
SCHEDULE 2 - SITES
Section 1. Site list.
| Site ID | Site | Tier | Network devices | Service Hours |
|---|---|---|---|---|
| S-01 | Aalborg | B | 12 | Mon-Fri 07-17 |
| S-02 | Aarhus N | A | 19 | 24/7 |
| S-03 | Aarhus C | C | 26 | Mon-Sat 06-22 |
| S-04 | Esbjerg | B | 33 | Mon-Fri 07-17 |
| S-05 | Fredericia | A | 40 | 24/7 |
| S-06 | Herning | C | 47 | Mon-Sat 06-22 |
| S-07 | Hillerød | B | 14 | Mon-Fri 07-17 |
| S-08 | Holstebro | A | 21 | 24/7 |
| S-09 | Horsens | C | 28 | Mon-Sat 06-22 |
| S-10 | Kolding | B | 35 | Mon-Fri 07-17 |
| S-11 | Køge | A | 42 | 24/7 |
| S-12 | Næstved | C | 49 | Mon-Sat 06-22 |
| S-13 | Odense S | B | 16 | Mon-Fri 07-17 |
| S-14 | Odense C | A | 23 | 24/7 |
| S-15 | Randers | C | 30 | Mon-Sat 06-22 |
| S-16 | Roskilde | B | 37 | Mon-Fri 07-17 |
| S-17 | Silkeborg | A | 44 | 24/7 |
| S-18 | Slagelse | C | 51 | Mon-Sat 06-22 |
| S-19 | Svendborg | B | 18 | Mon-Fri 07-17 |
| S-20 | Sønderborg | A | 25 | 24/7 |
| S-21 | Taastrup | C | 32 | Mon-Sat 06-22 |
| S-22 | Vejle | B | 39 | Mon-Fri 07-17 |
| S-23 | Viborg | A | 46 | 24/7 |
| S-24 | Glostrup | C | 13 | Mon-Sat 06-22 |
Section 2. Notice addresses. Customer: [email protected]. Supplier: [email protected].
SCHEDULE 3 - SERVICE CREDITS
The Service Credit is a percentage of the Monthly Charge for the Site for the month concerned.
| Tier | Availability in the month | Service Credit |
|---|---|---|
| A | 99.9% or higher | 0% |
| A | 99.5% to below 99.9% | 5% |
| A | 99.0% to below 99.5% | 10% |
| A | 98.0% to below 99.0% | 20% |
| A | below 98.0% | 30% |
| B | 99.5% or higher | 0% |
| B | 99.0% to below 99.5% | 4% |
| B | 98.0% to below 99.0% | 8% |
| B | 96.0% to below 98.0% | 15% |
| B | below 96.0% | 25% |
| C | 99.0% or higher | 0% |
| C | 98.0% to below 99.0% | 3% |
| C | 96.0% to below 98.0% | 6% |
| C | below 96.0% | 12% |
SCHEDULE 4 - HOURLY RATES
Rates in DKK per hour excluding VAT. Normal: Business Days 07-17. Evening: Business Days 17-23 and Saturdays 07-17. Night and holiday: all other times. Time is charged per started half hour.
| Role | Normal | Evening | Night and holiday |
|---|---|---|---|
| Service Desk Analyst | 620 | 930 | 1240 |
| Field Technician | 720 | 1080 | 1440 |
| Network Engineer | 820 | 1230 | 1640 |
| Senior Network Engineer | 875 | 1312 | 1750 |
| Systems Engineer | 975 | 1462 | 1950 |
| Senior Systems Engineer | 1075 | 1612 | 2150 |
| Security Analyst | 1130 | 1695 | 2260 |
| Security Architect | 1230 | 1845 | 2460 |
| Database Administrator | 1330 | 1995 | 2660 |
| Project Coordinator | 1385 | 2078 | 2770 |
| Project Manager | 1485 | 2228 | 2970 |
| Solution Architect | 1585 | 2378 | 3170 |
| Service Delivery Manager | 1640 | 2460 | 3280 |
| Cabling Installer | 1740 | 2610 | 3480 |
Grading
How this was graded
Answer key.
Trap questions
All nine attempts handled both trap questions.
Flaw in my answer key
The models were more thorough than the answer key: most pointed out that notices count as received on the next business day.
The answer key, never shown to a model
- 1 November 2027. Initial Term is 36 months from 1 March 2025, so it ends 29 February 2028 (clauses 1.3, 1.4). Clause 22.4 overrides clause 14.2 for the Customer: 120 days, not 90 (clause 20.1 puts clause 22 first). Notice must be given 120 days before the end of the term: counting back from 29 February 2028 gives 1 November 2027. Accept 1 or 2 November 2027 depending on how the end day is counted. "90 days" or a date around 1 December 2027 is wrong: the model missed clause 22.4.
- DKK 496. Roskilde is Tier B (Schedule 2). 98.4% falls in "98.0% to below 99.0%" for Tier B = 8% (Schedule 3) of DKK 6,200 (clause 8.1). Not automatic: it must be claimed within 45 days (clause 7.4); mentioning that is a plus, not required.
- DKK 9,606.80 (accept 9,607). Clause 22.3: no adjustment before 1 March 2027, so the 2026 rise of 4.1% never applies. On 1 March 2027 the adjustment is the index change over the preceding twelve months, 2.2% (clause 8.3), under the 3% cap: 9,400 x 1.022. Wrong answers to expect: 9,895.00 (3% then 2.2%), 10,000.68 (4.1% then 2.2%).
- Trap: the agreement does not say. Nothing on training anywhere. Any number is a made-up answer.
- Trap: false premise. Clause 9.3 says the opposite: the Customer may NOT set off Service Credits that have not been confirmed in writing. There is no number of days. (It may withhold the disputed amount until the dispute is resolved.)
Scoring: one point per question, 5 max. For 4 and 5 the point is given only if the model says the agreement does not provide it / the premise is wrong.
Each attempt started from a fresh state with a new seed. The answer limit was 60,000 tokens, thinking included. More on the method