Nordvik AS · Incident #7
The hourly payment file did not arrive
What happened
The hourly payment file did not arrive. None outside. Fixed before the 06:00 bank run.
How we found out
The check “Hourly payment file” wants a ping every hour at :00, 10 minutes of grace. Last one in at 02:00:04. The 03:00 ping never came. Incident opened itself at 03:12. Nobody reported it.
Who we woke, and when
| 03:12:09 | Kari Moen | SMS | Failed: carrier rejected the number. |
| 03:12:11 | Kari Moen | Phone | Delivered. No answer. |
| 03:14:11 | Jonas Berg | SMS | Delivered. Answered 03:16. Pressed “I have it”. |
| None | Eva Strand | None | Not reached. The escalation policy stopped when Jonas Berg answered. |
Why it happened
“Bank rotated the SFTP host key at 02:47. No warning. Our job refused it, which is correct, it had never seen that key. Pinned the new fingerprint 05:52. File through 05:58. Have asked them to tell us next time.”
What we owed the authority
| Early warning (24 h) | 15 Sep 03:12 | 14 Sep 09:02 | Met: drafted Jonas Berg, approved Eva Strand, sent 09:02:14 by email to beredskap@nsm.no, CTO on copy |
| Incident notification (72 h) | 17 Sep 03:12 | 14 Sep 09:31 | Met: drafted Jonas Berg, approved Eva Strand, sent 09:31:02 by email to beredskap@nsm.no, CTO on copy |
| Intermediate report (on request) | On request | None | Not owed |
| Final report (1 month after the first notice was sent) | 14 Oct | None | Not yet due |
Evidence
- ping log
- 02:00:04 → 05:58:12
- delivery receipts
- 2 of 3 confirmed by the carrier
- this document
- This address always serves this same document