Place the potatoes in a large pot and cover with cold water by 1 inch. Salt the water generously. Bring to a boil, then reduce to a gentle boil and cook until just fork-tender, 12 to 15 minutes.
While the potatoes cook, place the eggs in a saucepan, cover with cold water, and bring to a boil. Remove from heat, cover, and let stand 10 minutes. Transfer to ice water, then peel and chop.
Drain the potatoes and let them steam dry for 5 minutes. When cool enough to handle but still warm, cut into 3/4-inch chunks.
In a large bowl, whisk together the mayonnaise, mustard, vinegar, sugar, salt, and pepper until smooth. Taste; it should be boldly seasoned.
Add the warm potato chunks to the bowl with three quarters of the dressing. Fold gently with a spatula until every piece is coated.
Fold in the celery, red onion, chopped eggs, and pickle relish. Add remaining dressing if needed.
Cover and refrigerate for at least 2 hours, ideally 4, to let flavors meld.
Before serving, stir gently, taste and adjust salt and pepper, and dust with paprika. Serve chilled.