Grep · sample report

Interview Kit Builder — You get a ready-to-use interview kit for your role and level: competencies, stage-by-stage questions, an anchored scoring rubric, and fair work-sample ideas.

workon demandoperational
Inputs used for this sample
Interview Kit Builder

Role description: Backend engineer on the payments team: builds and maintains card and bank-transfer APIs in Go, owns reliability of the ledger service, works with finance and fraud teams.

Level: Senior (IC3, 5+ years)

Interview stages you plan to run (optional): Recruiter screen 30 min, hiring manager call 45 min, technical deep-dive 60 min, system design 60 min, values/team panel 45 min

Must-assess competencies or values (one per line): Ownership of production systems
Clear written communication
Security and compliance mindset

Senior Backend Engineer (Payments, Go) Interview Kit: 7 Weighted Competencies Across a 4-Hour, 5-Stage Loop

Interpretation notes: (1) "Senior (IC3, 5+ years)" is read as a mid-ladder senior individual contributor, one level above a mid-level engineer and one below staff. (2) The three must-assess items are read as observable behavior: running and fixing live systems, writing that others can act on without a meeting, and designing and coding with money-movement risk and audit needs in mind. (3) The five stages are fixed slots totalling 240 minutes (4 hours). Written communication needs a written artifact, so the kit adds one short pre-stage writing sample (45 minutes, outside the 240) with a live alternative; see Open items.

Loop summary: Recruiter screen, hiring manager call, Go technical deep-dive, ledger/payments system design, and a values/team panel. Seven competencies are weighted to 100%. Every interviewer uses the same questions and the same 1 to 4 anchored rubric, scores independently, and only then joins the debrief. This is a recommendation for the hiring team to confirm, not legal advice.

1. Competency table: seven competencies, weights sum to 100%

The role tasks come from the O*NET Software Developers profile (SOC 15-1252.00, updated 2026), the closest fit. It lists tasks such as "Modify existing software to correct errors, adapt it to new hardware, or upgrade interfaces and improve performance", "Confer with systems analysts, engineers, programmers and others to design systems", and "Prepare reports or correspondence concerning project specifications, activities, or status". No separate payments-specific O*NET profile was used; payments details (Go, card and bank-transfer APIs, ledger, finance and fraud partners) come from your role description. Level expectations come from the GitLab Engineering Career Framework: Senior and, for the level below, the Intermediate framework. Where a row says "inferred", no ladder source states it.

# Competency Why it matters at this level (task + level expectation) Stage(s) Weight
1 Ownership of production systems (mandatory) Role task: owns reliability of the ledger service (role description). Senior engineers are expected to "take on large issues with vague requirements" and "resolve complex challenges"; the level below only "independently plans, estimates and, delivers small and moderate solutions". A published staff-backend posting also asks for "experience owning a project from concept to production". Incident and SLO specifics are inferred from the role description. 1, 2, 5 20%
2 Clear written communication (mandatory) Role task: O*NET lists "Prepare reports or correspondence concerning project specifications, activities, or status". Senior engineers are expected to communicate "clearly and effectively, both written and verbally, when advising, setting expectations, or suggesting improvements". Writing sample + 4 15%
3 Security and compliance mindset (mandatory) Role task: card and bank-transfer APIs touch cardholder and account data and are audited by finance (inferred from role description; no ladder source for payments compliance). The level below only "considers quality, security, and performance of assigned tasks" (Intermediate); at Senior the engineer should shape the team's approach (inferred). 3, 4 15%
4 Go and API engineering craft Role task: builds and maintains card and bank-transfer APIs in Go (role description); O*NET: "Design, develop and modify software systems". Senior engineers resolve complex challenges and coach others. 3 20%
5 Ledger and payments system design (consistency, idempotency, reconciliation) Role task: owns the ledger service (role description); O*NET: "Analyze information to determine, recommend, and plan installation of a new system or modification of an existing system". Specific design topics are inferred from the role. 4 15%
6 Cross-functional work with finance and fraud Role task: works with finance and fraud teams (role description); O*NET: "Consult with customers or other departments on project status, proposals, or technical issues". Seniors "suggest alternative solutions to customer problems" using knowledge of other areas. 1, 2, 5 10%
7 Technical leadership and mentoring Seniors act as "Coach and Mentor to others"; Google's guidance describes individual-contributor leadership as "emergent leadership": taking initiative and working across teams. 2, 5 5%
Total 100% (checked by script)

2. Stage plan: 240 minutes, every competency covered, no stage over 3 competencies

Stage Duration Interviewer (role) Competencies Notes
1. Recruiter screen 30 min Recruiter 1 (scope screen), 6 Fact-gathering with the same scripted questions; scored on the rubric's scope anchors only.
2. Hiring manager call 45 min Hiring manager 1, 6, 7 About 15 min per competency.
3. Technical deep-dive 60 min Senior peer engineer (Go) 4, 3 30 min Go code-reading exercise plus 30 min Go and security questions.
4. System design 60 min Senior or staff engineer from a neighboring service 5, 3, 2 40 min design, 10 min security and audit probes, 10 min discussion of the candidate's written sample. Tightest stage; see Open items.
5. Values/team panel 45 min Two peers, one finance-or-fraud partner 1, 6, 7 Behavioral questions split across panelists; one panelist is the cross-functional partner.
Total 240 min Weight and time totals checked by script.

Written sample (before stage 4): 45 minutes, candidate-timed, described in section 5.

3. Question bank

Google's guidance says structured interviews use vetted role-relevant questions, recorded answers, standardized rubrics, and interviewer training and calibration, with behavioral and hypothetical question types. All questions below are inferred designs for this role, not quotations from any published bank. Ask every candidate the same primary questions and follow-ups; add no off-script probing on personal topics.

Stage Competency Question Follow-ups Strong-answer signals (Senior)
1 Ownership Which production services have you been the named owner of, and what were their uptime or error targets? What did on-call look like? Who depended on the service? How did you know it was healthy? Names a service with real dependents, a target or SLO, and an alerting source; says "I owned" with specifics, not "the team handled".
1 Cross-functional Tell me about a time you worked directly with finance, risk, fraud or another non-engineering group on a technical change. What did they need that you did not expect? How did you agree what "done" meant? Describes the partner's goal in their terms; shows a shared definition of done.
2 Ownership Tell me about the worst production incident you led or helped resolve in a money-moving or data-critical system. How did you detect it? What was the customer impact and how did you measure it? What changed afterward and did you verify it worked? Calm, ordered account: detect, mitigate, then fix root cause; quantifies impact; closes the loop with a tracked follow-up that was completed.
2 Ownership Imagine you inherit a service with frequent pages and no runbook. What do you do in your first 30 days? What would you not touch yet? How would you decide what to fix first? Starts with data (pages, causes), writes minimal runbooks, picks fixes by impact, and protects the team's capacity.
2 Cross-functional Tell me about a time a fraud or finance team asked for something that conflicted with your engineering plan. How did you decide? What did you give up? What did the relationship look like afterward? Quantifies trade-offs, proposes options, documents the decision, keeps trust.
2 Cross-functional Imagine finance reports the ledger and bank statements differ by a small amount at month end. How do you investigate with them? What data would you ask finance for? How would you communicate progress while unsure? Separates timing, rounding and real loss; agrees an owner and update cadence with finance.
2 Leadership Tell me about a time you raised the quality of a teammate's work or of a team practice. How did you know it worked? What did you do when the person disagreed? Specific mentoring act with an observable result; avoids taking over the work.
2 Leadership Tell me about a vague or large piece of work you broke down for others. How did you decide the first slice? How did you handle changing requirements? Turns ambiguity into a short plan with checkpoints; hands out work with clear acceptance criteria.
3 Go craft Here is a 60-line Go handler that creates a payment and writes to a database (synthetic code). Review it as if it were a pull request. Which issues would block the merge? What would you test? What if the client retries after a timeout? Finds missing context or timeout handling, unchecked errors, goroutine or lock misuse, non-idempotent writes; ranks issues by risk and explains why.
3 Go craft Tell me about a concurrency bug you found in Go (or a similar language) and how you proved the cause. How did you reproduce it? What did you change to prevent a repeat? Uses race detection, tracing or logs as evidence; fix is structural (ownership of data, channels or locks), not a sleep.
3 Security & compliance In the code above, where could card data or account numbers leak? How would you keep secrets out of logs? What would you want reviewed by the security team? Names logging, error messages, metrics labels and request dumps; masks or tokenizes data; knows when to escalate to security.
3 Security & compliance Tell me about a time you found or prevented a security or compliance problem in code you or a teammate wrote. What was the risk? Who did you tell? What process changed? Reports early, fixes the class of bug (lint, test, review checklist), documents it.
4 Ledger design Design a ledger service that records transfers between customer accounts and an external bank (synthetic requirements provided). How do you prevent double-posting on retries? How do you reconcile with the bank file? What are your failure modes and recovery steps? Double-entry or equivalent invariants, idempotency keys, an append-only record, explicit reconciliation, clear state machine for pending and settled states, and a recovery plan for partial failure.
4 Ledger design Imagine a bank transfer was accepted by your API but the bank later rejects it. How should the system and the customer view change? How are reversals recorded? How do you notify finance? Reversal as a new entry, never an edit; defined states; alert and report for finance.
4 Security & compliance In your design, how do you control who can post or reverse entries, and how can an auditor reconstruct what happened? What would you log? How long? Who can change configuration? Least privilege, separation of duties, immutable audit trail with who/what/when, retention set by policy owner (not guessed).
4 Written communication In the sample you submitted, walk me through your recommendation and what you would change for a non-engineer reader. What did you leave out and why? How would the finance lead use this? Leads with the decision and impact, defines terms, separates facts from opinion, short enough to act on.
4 Written communication Tell me about a design or incident document you wrote that other teams relied on. How did you get feedback? How did you know it was understood? Names an artifact and its readers; revised after feedback; outcome traceable to the document.
5 Ownership Tell me about a time you were paged outside working hours. What did you do, and what did you change afterward? Who else did you bring in? What was left unfinished? Takes responsibility without heroics, hands off cleanly, follows up.
5 Cross-functional Imagine a fraud analyst needs a new real-time signal on every card authorization. What do you ask before agreeing? What is the latency budget? What if it fails? How do you measure the effect? Asks about failure behavior, latency, false positives, data handling; proposes a staged rollout.
5 Leadership Tell me about a time you disagreed with a technical decision and what you did next. What evidence did you bring? What happened to the decision? Gives evidence, disagrees respectfully, commits to the outcome; escalates only with reason.

4. Rubrics: 1 = below bar, 2 = partly meets, 3 = meets, 4 = exceeds

Anchors follow Google's approach of standardized rubrics with descriptions of poor, borderline, solid and outstanding answers. The anchors are inferred designs. To keep "this level's 3 matches the level below's 4", I used the contrast between GitLab Intermediate (plans and delivers small and moderate solutions, seeks guidance when blocked) and GitLab Senior (takes on large issues with vague requirements, resolves complex challenges). The exact alignment is inferred, not published.

1. Ownership of production systems

Score Anchor
1 Describes work only as "the team"; no named service, target or on-call role; incident stories end at the fix with no follow-up.
2 Owned a service but relied on others for detection and decisions; follow-ups were identified but not tracked to completion.
3 Owns a service with targets and alerts; led an incident from detection to root cause; completed follow-ups that were verified. Handles unclear requirements without waiting for direction.
4 As 3, and also set or reset the service's targets with stakeholders, cut repeat incidents with a structural change, and taught others the runbook and review habits.

2. Clear written communication

Score Anchor
1 Sample buries the decision; undefined jargon; reader cannot act without a meeting.
2 Accurate but disorganized or too long; the decision and impact are present but hard to find.
3 Leads with the decision and impact; terms defined; facts separated from opinion; a finance reader can act on it.
4 As 3, and tailors versions for different readers, names risks and open questions, and sets clear owners and dates.

3. Security and compliance mindset

Score Anchor
1 Does not name any data leak path; treats security as another team's task.
2 Names obvious items (encryption, auth) but misses logging, errors and audit needs; escalates late.
3 Finds leak paths in code and design, applies least privilege and audit trails, and knows when to involve security or compliance owners.
4 As 3, and turns findings into team controls (lint rules, tests, review checklists) and discusses trade-offs with policy owners without guessing policy details.

4. Go and API engineering craft

Score Anchor
1 Misses blocking defects in the code sample; no reasoning about retries or timeouts.
2 Finds style issues and some errors; weak on concurrency, context or idempotency.
3 Finds the blocking issues, ranks them by risk, proposes tests, and reasons about retries and timeouts.
4 As 3, and suggests a safer API shape or shared library, and explains Go-specific trade-offs clearly enough to coach a peer.

5. Ledger and payments system design

Score Anchor
1 Mutable balances with no retry safety or reconciliation.
2 Some correct pieces (for example idempotency keys) but gaps in states, failure recovery or reversals.
3 Consistent invariants, idempotency, a clear state machine, reversals as new entries, a reconciliation process and a recovery plan.
4 As 3, and sizes the design, plans migration and rollout, and names monitoring that would show drift early.

6. Cross-functional work with finance and fraud

Score Anchor
1 Describes partners as blockers; no shared goals.
2 Responds to requests but does not clarify needs or agree success measures.
3 Learns the partner's goal, agrees a definition of done and failure behavior, and communicates progress.
4 As 3, and builds a lasting process (shared dashboards, joint reviews) that others use.

7. Technical leadership and mentoring

Score Anchor
1 No examples of helping others improve.
2 Helps when asked; takes over work rather than coaching.
3 Coaches through reviews and pairing, breaks vague work into slices, and disagrees with evidence then commits.
4 As 3, and shapes team practice beyond their own project, with a measurable result.

5. Work samples: synthetic data only, each at 90 minutes or less

Task Time box What it measures Bias safeguards
A. Written post-incident review or design note from a synthetic incident timeline (ledger shows duplicate postings after a retry storm), written for a finance lead 45 min, candidate-timed; live alternative: 45 min written on-site or a video-call shared document Written communication (2), ownership (1), security awareness (3) Same prompt and data for all; scored by two raters on the section 4 rubric with names removed where practical; accommodations offered before the task.
B. Live system design: ledger for card and bank-transfer flows with synthetic requirements 40 min inside stage 4 Ledger design (5), security and compliance (3) Same prompt and probes; rubric scoring; notes written during the session.
C. Go code review of a synthetic payment handler 30 min inside stage 3 Go craft (4), security and compliance (3) Same code for all; scoring on a pre-set defect list; candidate may use their own editor or paper.

The EEOC says employment tests an employer requires must be necessary and related to the job, and under the ADA guidance employers must provide reasonable accommodation in the application process and give tests in a format that does not require an impaired skill unless the test measures that skill. Tell every candidate what the process involves and ask whether they need accommodation for the process. Design reasoning: Sackett and colleagues (2022) report structured interviews as the top-ranked selection procedure, with validity estimates for many procedures reduced by about .10 to .20 from earlier figures. I did not read Schmidt and Hunter (1998) and quote no figures from it.

6. Debrief and questions to avoid

Debrief process (recommendation; the re:Work guide calls for recorded feedback and calibration):

  1. Each interviewer writes evidence notes and a 1 to 4 score per competency before seeing anyone else's.
  2. A facilitator collects scores, then reads them out per competency, starting with the largest gaps.
  3. Discussion points to quoted behavior and the rubric anchor, not impressions or "fit".
  4. The decision is recorded with the reasons and the evidence used. Weighted score = sum of weight times score.
  5. After each hire cycle, review whether scores matched on-the-job results and recalibrate.

Questions to avoid, with compliant alternatives

Avoid Why Compliant alternative
"Are you a U.S. citizen?" The EEOC says most employers should not ask about citizenship before an offer. Use the EEOC sample wording: all persons hired will be required to verify identity and eligibility to work. Any other wording (for example asking whether the candidate can legally work in the job's country) is my inference, not EEOC text; confirm with counsel.
Sick days, medications, workers' compensation, mental-health treatment, any disability or health question Pre-offer disability-related questions are generally prohibited. Describe the job's duties and process and ask whether the candidate needs accommodation for the interview process. Do not ask all applicants whether they need accommodation to do the job.
Age, birth date, graduation year used as an age proxy Age 40 and over is a protected basis. Ask about years and kinds of relevant experience.
Religion, national origin, race, color, sex, pregnancy These are protected bases. Family and caregiving plans are not listed there; the SOP rule and sex-discrimination risk (inference) keep them off the list of topics to ask. Ask about availability for the on-call schedule and working hours the role requires, stated to all candidates.
Photographs; clubs, societies or lodges The EEOC advises against asking for photographs and against clubs or lodges questions that could reveal protected traits. Ask about professional associations only if job-related.
Salary history Not covered by the EEOC pages I read. Local rules vary and I did not verify any jurisdiction (inferred). Ask for salary expectations or share the posted range. Check with HR or counsel for your jurisdiction.
Personality tests, brainteasers, off-job or lifestyle questions Not job-related (SOP rule; inferred). Use the behavioral and situational questions in section 3.

The kit is a recommendation, not legal advice. Local laws may add requirements; confirm with HR or counsel.

Do next

  1. Confirm the competency weights and the rubric anchors with the hiring manager and one finance or fraud partner.
  2. Write the synthetic materials: the incident timeline, the Go handler (with a hidden defect list) and the ledger requirements. Have a non-candidate engineer test them for timing.
  3. Train and calibrate interviewers on the rubric using two or three mock answers per competency.
  4. Decide how the written sample is scheduled and scored (see Open items), and write the accommodation text for the invitation.
  5. Have HR or counsel confirm local pre-employment rules, including salary-history rules and any work-authorization wording.

Open items

Coverage

Not reached or not read: Schmidt and Hunter (1998); PCI DSS and any payments regulation; local salary-history ban sources (search leads only); a second published career ladder; the Europe PMC copy of Sackett et al. (fetched, but it returned only navigation text, so I used the SMU repository abstract). Two first-attempt URLs (a re:Work guide path and an EEOC guidance path) returned 404 and were replaced. All other sources were fetched on 6 October 2026.

Sources

  1. O*NET OnLine, Software Developers (15-1252.00), U.S. Department of Labor, updated 2026, accessed 6 Oct 2026. https://www.onetonline.org/link/summary/15-1252.00
  2. A guide to structured interviewing for better hiring practices, Google re:Work, updated March 2026. https://rework.withgoogle.com/intl/en/guides/a-guide-to-structured-interviewing-for-better-hiring-practices
  3. Sackett, Zhang, Berry and Lievens (2022), Journal of Applied Psychology 107(11), abstract at SMU Institutional Knowledge. https://ink.library.smu.edu.sg/lkcsb_research/6894/
  4. Engineering Career Framework: Senior, GitLab Handbook, last modified 12 Mar 2026. https://handbook.gitlab.com/handbook/engineering/careers/matrix/senior/
  5. Engineering Career Framework: Intermediate, GitLab Handbook, last modified 12 Mar 2026. https://handbook.gitlab.com/handbook/engineering/careers/matrix/intermediate/
  6. Staff Backend Engineer job description, GitLab Handbook, accessed 6 Oct 2026 (no page date shown). https://handbook.gitlab.com/job-description-library/engineering/development/backend/staff/
  7. Prohibited Employment Policies/Practices, U.S. EEOC, accessed 6 Oct 2026. https://www.eeoc.gov/prohibited-employment-policiespractices
  8. Pre-Employment Inquiries and Citizenship, U.S. EEOC, accessed 6 Oct 2026. https://www.eeoc.gov/pre-employment-inquiries-and-citizenship
  9. Job Applicants and the ADA, U.S. EEOC, issued 7 Oct 2003. https://www.eeoc.gov/laws/guidance/job-applicants-and-ada

Linked list: