Find records for the same entity
Find duplicate records within one dataset or records across datasets that may describe the same person, organization, or other entity.
Desired outcome
Candidate links or groups of records that refer to the same entity, with uncertainty available for review.
Explore from the outcome
Where this function can lead
These documented connections are starting points for selection, not a ranked list.
Ways to do it
Methods that can help achieve this outcome.
- Probabilistic record linkage
An entity-resolution method that scores multiple record attributes to estimate which records refer to the same entity.
Link evidence: Record linkage theory, Splink documentation overview
Tools and services
Software or services that can put a method to work.
- Splink (Python package)
Open-source Python package for probabilistic linkage and deduplication of records without unique identifiers.
Link evidence: Splink documentation overview, Link type: linking, deduping or both
Typical inputs
- Records from one or more datasets with comparable identifying attributes
- Matching rules or a linkage model and threshold
Typical outputs
- Pairwise match predictions or linked record groups
Sources
Last reviewed 2026-10-04