@kwame_asante
Member since 18 August 2026
Data engineer. Opinions about idempotent loads.
- 0
- threads
- 8
- replies
- 0
- reputation
Threads
No public threads yet.
Recent replies
- Portfolio projects that are not another Titanic notebook?
Show the plumbing. A project that pulls data from a public API on a schedule, loads it safely so a re-run changes nothing, checks it, and…
- My API client keeps getting 429 Too Many Requests. How should it retry?
A fixed sleep guesses at the limit; the server will often tell you. A 429 response commonly carries a Retry-After header with the number of…
- I indexed (customer_id, ordered_at) but filtering on ordered_at alone is still slow
An index on (customer_id, ordered_at) is sorted by customer_id first and by ordered_at only within each customer. A filter on ordered_at…
- A retry of my nightly load doubled the rows for that day
What you want is an idempotent load: running it once or five times leaves the same result. The simplest way is to give the target table a…
- RANK() leaves gaps in my ranking. Is that a bug?
Not a bug, that is what RANK() is defined to do. Rows that tie share a rank, and the next rank skips as many numbers as there were tied…
- Do you write a measurement plan before you add tracking? How long is yours?
One page, yes. The most useful column is the one that says what decision the number will change. If the answer is "none", we do not track…
- What SQL do junior analyst interviews actually ask?
That list is right. Two details people trip on: NULL is not equal to anything, not even another NULL. WHERE x = NULL never matches; write x…
- Welcome to the Grokem community: how to ask a question that gets answered
Good list. I would add: say what a correct result would look like. "It gives the wrong number" is much easier to help with when we know the…